Jul 11 04:17:51 devstack cinder-volume[75681]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 11 04:17:51 devstack cinder-volume[75681]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 11 04:17:51 devstack cinder-volume[75681]: we strongly recommend against using it for new projects. Jul 11 04:17:51 devstack cinder-volume[75681]: If you are already using Eventlet, we recommend migrating to a different Jul 11 04:17:51 devstack cinder-volume[75681]: framework. For more detail see Jul 11 04:17:51 devstack cinder-volume[75681]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 11 04:17:51 devstack cinder-volume[75681]: import eventlet # noqa Jul 11 04:17:53 devstack cinder-volume[75681]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75681) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 11 04:17:53 devstack cinder-volume[75681]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75681) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 11 04:17:53 devstack cinder-volume[75681]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75681) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 11 04:17:54 devstack cinder-volume[75681]: INFO dbcounter [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] Registered counter for database cinder Jul 11 04:17:54 devstack cinder-volume[75681]: DEBUG oslo_db.sqlalchemy.engines [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75681) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 04:17:54 devstack cinder-volume[75681]: DEBUG dbcounter [-] [75681] Writer thread running {{(pid=75681) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 11 04:17:54 devstack cinder-volume[75681]: INFO cinder.rpc [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 11 04:17:54 devstack cinder-volume[75681]: INFO cinder.rpc [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 11 04:17:54 devstack cinder-volume[75681]: DEBUG oslo_db.sqlalchemy.engines [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75681) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 04:17:55 devstack cinder-volume[75681]: INFO cinder.volume.manager [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] Determined volume DB was empty at startup. Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG cinder.volume.manager [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75681) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 11 04:17:55 devstack cinder-volume[75681]: INFO cinder.volume.manager [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 11 04:17:55 devstack cinder-volume[75681]: WARNING stevedore.named [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 11 04:17:55 devstack cinder-volume[75681]: WARNING castellan.key_manager [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 11 04:17:55 devstack cinder-volume[75681]: WARNING cinder.keymgr.conf_key_mgr [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG cinder.volume.drivers.lvm [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75681) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_concurrency.processutils [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_concurrency.processutils [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] CMD "cinder-rtstool verify" returned: 0 in 0.428s {{(pid=75681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_db.sqlalchemy.engines [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75681) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 04:17:55 devstack cinder-volume[75681]: INFO cinder.rpc [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 11 04:17:55 devstack cinder-volume[75681]: INFO cinder.rpc [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 11 04:17:55 devstack cinder-volume[75681]: WARNING stevedore.named [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 11 04:17:55 devstack cinder-volume[75681]: WARNING castellan.key_manager [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 11 04:17:55 devstack cinder-volume[75681]: INFO cinder.volume.manager [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_db.sqlalchemy.engines [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75681) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 04:17:55 devstack cinder-volume[75681]: INFO oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] Starting 1 workers Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] Started child 75877 {{(pid=75681) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] Full set of CONF: {{(pid=75681) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] ******************************************************************************** {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] Configuration options gathered from: {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] ================================================================================ {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] allow_availability_zone_fallback = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] allow_compression_on_image_upload = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] allowed_direct_url_schemes = [] {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] api_rate_limit = True {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] auth_strategy = keystone {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] az_cache_duration = 3600 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_availability_zone = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_host = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_name = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_stats_polling_interval = 60 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backup_api_class = cinder.backup.api.API {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75877]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backup_name_template = backup-%s {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backup_use_same_host = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backup_use_temp_snapshot = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] chap_password = **** {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] chap_username = {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cinder_internal_tenant_project_id = a161bf39780c45f5b07febd6dfb3a343 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cinder_internal_tenant_user_id = caf6f024aa5b484e97b4fa548c28b774 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cloned_volume_same_az = True {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cluster = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] compression_format = gzip {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] compute_api_class = cinder.compute.nova.API {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] config_dir = [] {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] config_source = [] {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] control_exchange = openstack {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] debug = True {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] default_availability_zone = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] default_group_type = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] default_volume_type = lvmdriver-1 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] disk_geometry = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] driver_client_cert = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] driver_client_cert_key = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] driver_data_namespace = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] driver_ssl_cert_path = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] driver_ssl_cert_verify = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] driver_use_ssl = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] enable_force_upload = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] enable_new_services = True {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] enable_unsupported_driver = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] enforce_multipath_for_image_xfer = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] filter_function = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] glance_api_insecure = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] glance_api_servers = ['http://192.168.122.60/image'] {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] glance_api_ssl_compression = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] glance_ca_certificates_file = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] glance_catalog_info = image:glance:publicURL {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] glance_certfile = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] glance_keyfile = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] glance_num_retries = 3 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] glance_request_timeout = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] goodness_function = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] graceful_shutdown_timeout = 5 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] group_api_class = cinder.group.api.API {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] host = devstack {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] image_compress_on_upload = True {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] image_conversion_address_space_limit = 1 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] image_conversion_cpu_limit = 60 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] image_conversion_disable = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] image_upload_use_cinder_backend = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] image_upload_use_internal_tenant = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] image_volume_cache_enabled = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] image_volume_cache_max_count = 0 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] image_volume_cache_max_size_gb = 0 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] init_host_max_objects_retrieval = 0 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] instance_format = [instance: %(uuid)s] {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] iscsi_target_flags = {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] iscsi_write_cache = on {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] iser_helper = tgtadm {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] iser_ip_address = 192.168.122.60 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] iser_port = 3260 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] log_color = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] log_config_append = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] log_dir = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] log_file = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] log_options = True {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] log_rotate_interval = 1 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] log_rotate_interval_type = days {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] log_rotation_type = none {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] max_age = 0 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] max_logfile_count = 30 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] max_logfile_size_mb = 200 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] max_over_subscription_ratio = 20.0 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] message_reap_interval = 86400 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] message_ttl = 2592000 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] migration_create_volume_timeout_secs = 300 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] monkey_patch = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] monkey_patch_modules = [] {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] my_ip = 192.168.122.60 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] no_snapshot_gb_quota = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] num_iser_scan_tries = 3 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] num_shell_tries = 3 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] num_volume_device_scan_tries = 3 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] nvmeof_conn_info_version = 1 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] nvmet_ns_id = 10 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] nvmet_port_id = 1 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] osapi_max_limit = 1000 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] osapi_volume_ext_list = [] {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] osapi_volume_listen_port = 8776 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] osapi_volume_use_ssl = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] osapi_volume_workers = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] per_volume_size_limit = -1 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] periodic_fuzzy_delay = 60 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] periodic_interval = 60 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] public_endpoint = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] publish_errors = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] quota_backup_gigabytes = 1000 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] quota_backups = 10 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] quota_gigabytes = 1000 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] quota_groups = 10 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] quota_snapshots = 10 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] quota_volumes = 10 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] rate_limit_burst = 0 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] rate_limit_except_level = CRITICAL {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] rate_limit_interval = 0 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] reinit_driver_count = 3 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] replication_device = **** {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] report_discard_supported = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] report_interval = 120 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] reservation_clean_interval = 86400 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] reservation_expire = 86400 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] reserved_image_namespaces = [] {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] reserved_percentage = 0 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] rpc_response_timeout = 120 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] run_external_periodic_tasks = True {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] scst_target_driver = iscsi {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] scst_target_iqn_name = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] service_down_time = 720 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] shell_completion = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] snapshot_name_template = snapshot-%s {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] snapshot_same_host = True {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] split_loggers = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] state_path = /opt/stack/data/cinder {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] storage_availability_zone = nova {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] storage_protocol = iSCSI {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] syslog_log_facility = LOG_USER {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] target_helper = lioadm {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] target_ip_address = 192.168.122.60 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] target_port = 3260 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] target_protocol = iscsi {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] target_secondary_ip_addresses = [] {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] trace_flags = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] transport_url = **** {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] until_refresh = 0 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] use_chap_auth = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] use_default_quota_class = True {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] use_journal = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] use_json = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] use_multipath_for_image_xfer = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] use_stderr = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] use_syslog = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] verify_glance_signatures = enabled {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] volume_api_class = cinder.volume.api.API {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] volume_backend_name = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] volume_clear = zero {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] volume_clear_ionice = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] volume_clear_size = 0 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] volume_copy_bps_limit = 0 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] volume_dd_blocksize = 1M {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] volume_name_template = volume-%s {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] volume_service_inithost_offload = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] volume_usage_audit_period = month {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] zoning_mode = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_concurrency.disable_process_locking = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] keystone_authtoken.auth_section = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] keystone_authtoken.auth_type = password {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] keystone_authtoken.auth_version = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75877]: INFO cinder.volume.manager [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] keystone_authtoken.cache = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] keystone_authtoken.certfile = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] keystone_authtoken.include_service_catalog = True {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] keystone_authtoken.insecure = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] keystone_authtoken.interface = public {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] keystone_authtoken.keyfile = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] keystone_authtoken.memcache_password = {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] keystone_authtoken.memcache_username = {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] keystone_authtoken.region_name = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] keystone_authtoken.service_type = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.60/identity {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cache.backend = dogpile.cache.null {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cache.backend_argument = **** {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cache.backend_expiration_time = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cache.config_prefix = cache.oslo {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cache.debug_cache_backend = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cache.enable_retry_client = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cache.enable_socket_keepalive = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cache.enabled = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cache.expiration_time = 600 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cache.hashclient_retry_attempts = 2 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cache.memcache_dead_retry = 300 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cache.memcache_pool_maxsize = 10 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cache.memcache_sasl_enabled = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cache.password = **** {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cache.proxies = [] {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cache.redis_db = 0 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cache.redis_server = localhost:6379 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cache.retry_attempts = 2 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cache.retry_delay = 0.0 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cache.socket_keepalive_count = 1 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cache.socket_keepalive_idle = 1 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cache.socket_keepalive_interval = 1 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cache.socket_timeout = 1.0 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cache.tls_allowed_ciphers = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cache.tls_cafile = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cache.tls_certfile = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cache.tls_enabled = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cache.tls_keyfile = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cache.username = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] coordination.backend_url = **** {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] database.asyncio_connection = **** {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] database.asyncio_slave_connection = **** {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] database.backend = sqlalchemy {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] database.connection = **** {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] database.connection_debug = 0 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] database.connection_parameters = {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] database.connection_recycle_time = 3600 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] database.connection_trace = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] database.db_inc_retry_interval = True {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] database.db_max_retries = 20 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] database.db_max_retry_interval = 10 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] database.db_retry_interval = 1 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] database.max_overflow = 50 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] database.max_pool_size = 5 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] database.max_retries = 10 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] database.mysql_wsrep_sync_wait = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] database.pool_timeout = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] database.retry_interval = 10 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] database.slave_connection = **** {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] database.sqlite_synchronous = True {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] database.synchronous_reader = True {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] database.use_db_reconnect = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] profiler.connection_string = messaging:// {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] profiler.enabled = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] profiler.es_doc_type = notification {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] profiler.es_scroll_size = 10000 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] profiler.es_scroll_time = 2m {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] profiler.filter_error_trace = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] profiler.hmac_keys = **** {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] profiler.sentinel_service_name = mymaster {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] profiler.socket_timeout = 0.1 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] profiler.trace_requests = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] profiler.trace_sqlalchemy = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] profiler_jaeger.process_tags = {} {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] profiler_jaeger.service_name_prefix = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] profiler_otlp.service_name_prefix = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_policy.enforce_new_defaults = True {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_policy.enforce_scope = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_policy.policy_default_rule = default {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_policy.policy_file = policy.yaml {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] privsep_osbrick.group = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] privsep_osbrick.helper_command = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] privsep_osbrick.user = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cinder_sys_admin.group = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cinder_sys_admin.helper_command = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] cinder_sys_admin.user = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] service_user.auth_section = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] service_user.auth_type = password {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] service_user.cafile = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] service_user.certfile = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] service_user.collect_timing = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] service_user.insecure = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] service_user.keyfile = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] service_user.send_service_user_token = True {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] service_user.split_loggers = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] service_user.timeout = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] glance.auth_section = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] glance.auth_type = password {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] glance.certfile = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] glance.collect_timing = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] glance.insecure = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] glance.keyfile = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] glance.region_name = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] glance.split_loggers = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] glance.timeout = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.backend_availability_zone = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.chap_password = **** {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.chap_username = {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.disk_geometry = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.driver_client_cert = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.driver_client_cert_key = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.driver_data_namespace = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.driver_use_ssl = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.extra_capabilities = {} {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.filter_function = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.goodness_function = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.iscsi_target_flags = {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.iscsi_write_cache = on {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.iser_helper = tgtadm {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.iser_ip_address = 192.168.122.60 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.iser_port = 3260 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.lvm_share_target = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.lvm_type = auto {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.num_shell_tries = 3 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.replication_device = **** {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.report_discard_supported = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.reserved_percentage = 0 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.target_helper = tgtadm {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.target_ip_address = 192.168.122.60 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.target_port = 3260 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.target_protocol = iscsi {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.trace_flags = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.unique_fqdn_network = True {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.use_chap_auth = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.volume_backend_name = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.volume_clear = zero {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.volume_clear_ionice = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.volume_clear_size = 0 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_reports.file_event_handler = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_reports.log_dir = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.backend_host = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.chap_password = **** {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.chap_username = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.disk_geometry = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.driver_client_cert = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.extra_capabilities = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.filter_function = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.goodness_function = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.iser_helper = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.iser_ip_address = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.iser_port = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.lvm_share_target = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.lvm_type = auto {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.num_shell_tries = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.replication_device = **** {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.report_discard_supported = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.reserved_percentage = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.scst_target_driver = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.storage_protocol = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.target_helper = lioadm {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.target_ip_address = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.target_port = 3260 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.trace_flags = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.use_chap_auth = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.volume_clear = zero {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.volume_clear_size = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] lvmdriver-1.volumes_dir = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:55 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_rabbit.ssl = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.053s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_notifications.driver = [] {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_notifications.retry = -1 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] key_manager.fixed_key = **** {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] barbican.barbican_api_version = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] barbican.barbican_endpoint = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] barbican.barbican_endpoint_type = public {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] barbican.barbican_region_name = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] barbican.cafile = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] barbican.certfile = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] barbican.collect_timing = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] barbican.insecure = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] barbican.keyfile = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] barbican.number_of_retries = 60 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] barbican.retry_delay = 1 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] barbican.send_service_user_token = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] barbican.split_loggers = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] barbican.timeout = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] barbican.verify_ssl = True {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] barbican.verify_ssl_path = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] barbican_service_user.auth_section = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] barbican_service_user.auth_type = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] barbican_service_user.cafile = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] barbican_service_user.certfile = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] barbican_service_user.collect_timing = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] barbican_service_user.insecure = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] barbican_service_user.keyfile = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] barbican_service_user.split_loggers = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] barbican_service_user.timeout = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] vault.approle_role_id = **** {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] vault.approle_secret_id = **** {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] vault.kv_mountpoint = secret {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] vault.kv_path = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] vault.kv_version = 2 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] vault.namespace = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] vault.root_token_id = **** {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] vault.ssl_ca_crt_file = None {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] vault.timeout = 60.0 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] vault.use_ssl = False {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:17:56 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] ******************************************************************************** {{(pid=75681) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 11 04:17:56 devstack sudo[75881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 11 04:17:56 devstack sudo[75881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:17:56 devstack sudo[75881]: pam_unix(sudo:session): session closed for user root Jul 11 04:17:56 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.682s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:17:56 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:17:56 devstack sudo[75887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 04:17:56 devstack sudo[75887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:17:57 devstack sudo[75887]: pam_unix(sudo:session): session closed for user root Jul 11 04:17:57 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.675s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:17:57 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:17:57 devstack cinder-volume[75877]: INFO cinder.brick.local_dev.lvm [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 11 04:17:57 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:17:57 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:17:57 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:17:57 devstack sudo[76130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 04:17:57 devstack sudo[76130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:17:58 devstack sudo[76130]: pam_unix(sudo:session): session closed for user root Jul 11 04:17:58 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.674s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:17:58 devstack cinder-volume[75877]: DEBUG cinder.brick.local_dev.lvm [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75877) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 11 04:17:58 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:17:58 devstack sudo[76332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 04:17:58 devstack sudo[76332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:17:59 devstack sudo[76332]: pam_unix(sudo:session): session closed for user root Jul 11 04:17:59 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.671s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:17:59 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:17:59 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:17:59 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:17:59 devstack sudo[76655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 04:17:59 devstack sudo[76655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:00 devstack sudo[76655]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:00 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.676s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:00 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:00 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:00 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:00 devstack sudo[76660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 11 04:18:00 devstack sudo[76660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:01 devstack sudo[76660]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:01 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.765s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:01 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:01 devstack sudo[76664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 04:18:01 devstack sudo[76664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:02 devstack sudo[76664]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:02 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.848s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:02 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:02 devstack sudo[76676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 04:18:02 devstack sudo[76676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:03 devstack sudo[76676]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:03 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.969s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:03 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:03 devstack sudo[76681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 04:18:03 devstack sudo[76681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:03 devstack sudo[76681]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:03 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.766s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:03 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:03 devstack sudo[76690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 04:18:03 devstack sudo[76690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:04 devstack sudo[76690]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:04 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.660s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:04 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:04 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:04 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:04 devstack sudo[76695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 04:18:04 devstack sudo[76695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:05 devstack sudo[76695]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:05 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.822s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:05 devstack cinder-volume[75877]: INFO cinder.volume.drivers.lvm [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 11 04:18:05 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:05 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:05 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:05 devstack sudo[76708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 04:18:05 devstack sudo[76708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:05 devstack cinder-volume[75681]: DEBUG dbcounter [-] [75681] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75681) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:18:06 devstack sudo[76708]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:06 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.666s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:06 devstack cinder-volume[75877]: DEBUG cinder.volume.drivers.lvm [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Updating volume stats {{(pid=75877) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 11 04:18:06 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:06 devstack sudo[76822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 04:18:06 devstack sudo[76822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:06 devstack sudo[76822]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:06 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.648s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:06 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:06 devstack sudo[76962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 04:18:06 devstack sudo[76962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:07 devstack sudo[76962]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:07 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:07 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:07 devstack sudo[76965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 04:18:07 devstack sudo[76965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:07 devstack sudo[76965]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:07 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.620s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:07 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:07 devstack sudo[76968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 04:18:07 devstack sudo[76968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:08 devstack sudo[76968]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:08 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.617s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:08 devstack cinder-volume[75877]: INFO cinder.volume.driver [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Driver hasn't implemented _init_vendor_properties() Jul 11 04:18:08 devstack cinder-volume[75877]: DEBUG cinder.volume.driver [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75877) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 11 04:18:08 devstack cinder-volume[75877]: DEBUG oslo_db.sqlalchemy.engines [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75877) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 04:18:08 devstack cinder-volume[75877]: DEBUG dbcounter [-] [75877] Writer thread running {{(pid=75877) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 11 04:18:08 devstack cinder-volume[75877]: DEBUG cinder.db.api [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Building query based on filter {{(pid=75877) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 11 04:18:08 devstack cinder-volume[75877]: DEBUG cinder.image.image_utils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75877) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 11 04:18:08 devstack cinder-volume[75877]: INFO cinder.keymgr.migration [None req-cac4fc7e-8c6a-4552-a547-35ba927e21df None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 11 04:18:08 devstack cinder-volume[75877]: DEBUG cinder.volume.drivers.lvm [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Updating volume stats {{(pid=75877) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 11 04:18:08 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:08 devstack sudo[76977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 04:18:08 devstack sudo[76977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:09 devstack sudo[76977]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:09 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.622s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:09 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:09 devstack sudo[76980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 04:18:09 devstack sudo[76980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:09 devstack sudo[76980]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:09 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:09 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:09 devstack sudo[76983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 04:18:09 devstack sudo[76983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:10 devstack sudo[76983]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:10 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.621s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:10 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:10 devstack sudo[76986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 04:18:10 devstack sudo[76986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:11 devstack sudo[76986]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:11 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.699s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:11 devstack cinder-volume[75877]: DEBUG cinder.manager [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Notifying Schedulers of capabilities ... {{(pid=75877) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:18:11 devstack cinder-volume[75877]: INFO cinder.volume.manager [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Driver initialization completed successfully. Jul 11 04:18:11 devstack cinder-volume[75877]: INFO cinder.manager [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Initiating service 2 cleanup Jul 11 04:18:11 devstack cinder-volume[75877]: INFO cinder.manager [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Service 2 cleanup completed. Jul 11 04:18:11 devstack cinder-volume[75877]: DEBUG cinder.service [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Creating RPC server for service cinder-volume {{(pid=75877) start /opt/stack/cinder/cinder/service.py:231}} Jul 11 04:18:11 devstack cinder-volume[75877]: DEBUG cinder.service [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75877) start /opt/stack/cinder/cinder/service.py:237}} Jul 11 04:18:11 devstack cinder-volume[75877]: INFO cinder.volume.manager [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 11 04:18:11 devstack cinder-volume[75877]: DEBUG cinder.volume.drivers.lvm [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Updating volume stats {{(pid=75877) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 11 04:18:11 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:11 devstack sudo[76990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 04:18:11 devstack sudo[76990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:12 devstack sudo[76990]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:12 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.789s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:12 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:12 devstack sudo[76994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 04:18:12 devstack sudo[76994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:12 devstack sudo[76994]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:12 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.703s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:12 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:12 devstack sudo[77000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 04:18:12 devstack sudo[77000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:13 devstack sudo[77000]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:13 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.648s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:13 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:13 devstack sudo[77057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 04:18:13 devstack sudo[77057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:14 devstack sudo[77057]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:14 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.630s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:14 devstack cinder-volume[75877]: INFO cinder.volume.manager [None req-90e6b6cf-afb5-4367-9c8d-774048ed9412 None None] Driver post RPC initialization completed successfully. Jul 11 04:18:24 devstack cinder-volume[75877]: DEBUG dbcounter [-] [75877] Writing DB stats cinder:SELECT=4 {{(pid=75877) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:18:24 devstack cinder-volume[75877]: DEBUG dbcounter [-] [75877] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75877) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:18:53 devstack cinder-volume[75877]: DEBUG oslo_service.periodic_task [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] Running periodic task VolumeManager._thread_info {{(pid=75877) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:18:53 devstack cinder-volume[75877]: DEBUG cinder.volume.manager [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] thread count: 6 {{(pid=75877) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:18:53 devstack cinder-volume[75877]: DEBUG cinder.volume.manager [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] thread info: [<_MainThread(MainThread, started 123873880023168)>, , , , , ] {{(pid=75877) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:19:53 devstack cinder-volume[75877]: DEBUG oslo_service.periodic_task [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75877) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:19:53 devstack cinder-volume[75877]: DEBUG cinder.volume.drivers.lvm [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] Updating volume stats {{(pid=75877) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 11 04:19:53 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:53 devstack sudo[81929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 04:19:53 devstack sudo[81929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:53 devstack sudo[81929]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:53 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.692s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:53 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:53 devstack sudo[81966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 04:19:53 devstack sudo[81966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:54 devstack sudo[81966]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:54 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.653s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:54 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:54 devstack sudo[81972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 04:19:54 devstack sudo[81972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:55 devstack sudo[81972]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:55 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.634s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:55 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:55 devstack sudo[81975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 04:19:55 devstack sudo[81975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:55 devstack sudo[81975]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:55 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.629s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:55 devstack cinder-volume[75877]: DEBUG cinder.manager [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] Notifying Schedulers of capabilities ... {{(pid=75877) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:19:55 devstack cinder-volume[75877]: DEBUG oslo_service.periodic_task [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] Running periodic task VolumeManager._thread_info {{(pid=75877) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:19:55 devstack cinder-volume[75877]: DEBUG cinder.volume.manager [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] thread count: 6 {{(pid=75877) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:19:55 devstack cinder-volume[75877]: DEBUG cinder.volume.manager [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] thread info: [<_MainThread(MainThread, started 123873880023168)>, , , , , ] {{(pid=75877) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:20:24 devstack cinder-volume[75877]: DEBUG dbcounter [-] [75877] Writing DB stats cinder:SELECT=1 {{(pid=75877) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:20:24 devstack cinder-volume[75877]: DEBUG dbcounter [-] [75877] Writing DB stats cinder:UPDATE=1 {{(pid=75877) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:20:53 devstack cinder-volume[75877]: DEBUG oslo_service.periodic_task [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75877) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:20:53 devstack cinder-volume[75877]: DEBUG cinder.volume.drivers.lvm [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] Updating volume stats {{(pid=75877) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 11 04:20:53 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:53 devstack sudo[83653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 04:20:53 devstack sudo[83653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:53 devstack sudo[83653]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:53 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:53 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:53 devstack sudo[83667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 04:20:53 devstack sudo[83667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:54 devstack sudo[83667]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:54 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.654s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:54 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:54 devstack sudo[83730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 04:20:54 devstack sudo[83730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:55 devstack sudo[83730]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:55 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.666s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:55 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:55 devstack sudo[83748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 04:20:55 devstack sudo[83748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:55 devstack sudo[83748]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:55 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.661s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:55 devstack cinder-volume[75877]: DEBUG cinder.manager [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] Notifying Schedulers of capabilities ... {{(pid=75877) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:20:55 devstack cinder-volume[75877]: DEBUG oslo_service.periodic_task [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] Running periodic task VolumeManager._thread_info {{(pid=75877) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:20:55 devstack cinder-volume[75877]: DEBUG cinder.volume.manager [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] thread count: 6 {{(pid=75877) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:20:55 devstack cinder-volume[75877]: DEBUG cinder.volume.manager [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] thread info: [<_MainThread(MainThread, started 123873880023168)>, , , , , ] {{(pid=75877) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:21:53 devstack cinder-volume[75877]: DEBUG oslo_service.periodic_task [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75877) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:21:53 devstack cinder-volume[75877]: DEBUG cinder.volume.drivers.lvm [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] Updating volume stats {{(pid=75877) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 11 04:21:53 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:53 devstack sudo[84986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 04:21:53 devstack sudo[84986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:53 devstack sudo[84986]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:53 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:53 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:53 devstack sudo[85000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 04:21:53 devstack sudo[85000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:54 devstack sudo[85000]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:54 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.652s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:54 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:54 devstack sudo[85027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 04:21:54 devstack sudo[85027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:55 devstack sudo[85027]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:55 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.666s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:55 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:55 devstack sudo[85069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 04:21:55 devstack sudo[85069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:55 devstack sudo[85069]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:55 devstack cinder-volume[75877]: DEBUG oslo_concurrency.processutils [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.617s {{(pid=75877) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:55 devstack cinder-volume[75877]: DEBUG cinder.manager [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] Notifying Schedulers of capabilities ... {{(pid=75877) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:21:55 devstack cinder-volume[75877]: DEBUG oslo_service.periodic_task [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] Running periodic task VolumeManager._thread_info {{(pid=75877) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:21:55 devstack cinder-volume[75877]: DEBUG cinder.volume.manager [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] thread count: 6 {{(pid=75877) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:21:55 devstack cinder-volume[75877]: DEBUG cinder.volume.manager [None req-2cc0823f-8c49-4511-9b89-e76325f53343 None None] thread info: [<_MainThread(MainThread, started 123873880023168)>, , , , , ] {{(pid=75877) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:22:24 devstack cinder-volume[75877]: DEBUG dbcounter [-] [75877] Writing DB stats cinder:SELECT=1 {{(pid=75877) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:22:24 devstack cinder-volume[75877]: DEBUG dbcounter [-] [75877] Writing DB stats cinder:UPDATE=1 {{(pid=75877) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:22:33 devstack cinder-volume[75681]: INFO oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] Caught SIGTERM, stopping children Jul 11 04:22:33 devstack cinder-volume[75681]: DEBUG oslo_concurrency.lockutils [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] Acquiring lock "singleton_lock" {{(pid=75681) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 11 04:22:33 devstack cinder-volume[75681]: DEBUG oslo_concurrency.lockutils [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] Acquired lock "singleton_lock" {{(pid=75681) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 11 04:22:33 devstack cinder-volume[75681]: DEBUG oslo_concurrency.lockutils [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] Releasing lock "singleton_lock" {{(pid=75681) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 11 04:22:33 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] Stop services. {{(pid=75681) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 11 04:22:33 devstack cinder-volume[75681]: DEBUG oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] Killing children. {{(pid=75681) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 11 04:22:33 devstack cinder-volume[75681]: INFO oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] Waiting on 1 children to exit Jul 11 04:22:36 devstack cinder-volume[75877]: DEBUG oslo_concurrency.lockutils [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] Acquiring lock "singleton_lock" {{(pid=75877) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 11 04:22:36 devstack cinder-volume[75877]: DEBUG oslo_concurrency.lockutils [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] Acquired lock "singleton_lock" {{(pid=75877) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 11 04:22:36 devstack cinder-volume[75877]: DEBUG oslo_concurrency.lockutils [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] Releasing lock "singleton_lock" {{(pid=75877) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 11 04:22:36 devstack cinder-volume[75877]: WARNING amqp [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 11 04:22:36 devstack cinder-volume[75877]: WARNING amqp [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 11 04:22:36 devstack cinder-volume[75681]: INFO oslo_service.backend._eventlet.service [None req-f545e28a-9cfc-4161-b5c7-bf2e588b4584 None None] Child 75877 exited with status 0 Jul 11 04:22:36 devstack cinder-volume[85973]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 11 04:22:36 devstack cinder-volume[85973]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 11 04:22:36 devstack cinder-volume[85973]: we strongly recommend against using it for new projects. Jul 11 04:22:36 devstack cinder-volume[85973]: If you are already using Eventlet, we recommend migrating to a different Jul 11 04:22:36 devstack cinder-volume[85973]: framework. For more detail see Jul 11 04:22:36 devstack cinder-volume[85973]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 11 04:22:36 devstack cinder-volume[85973]: import eventlet # noqa Jul 11 04:22:38 devstack cinder-volume[85973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85973) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 11 04:22:38 devstack cinder-volume[85973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85973) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 11 04:22:38 devstack cinder-volume[85973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85973) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 11 04:22:39 devstack cinder-volume[85973]: INFO dbcounter [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] Registered counter for database cinder Jul 11 04:22:39 devstack cinder-volume[85973]: DEBUG oslo_db.sqlalchemy.engines [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85973) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 04:22:39 devstack cinder-volume[85973]: DEBUG dbcounter [-] [85973] Writer thread running {{(pid=85973) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 11 04:22:40 devstack cinder-volume[85973]: INFO cinder.rpc [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 11 04:22:40 devstack cinder-volume[85973]: INFO cinder.rpc [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_db.sqlalchemy.engines [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85973) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 04:22:40 devstack cinder-volume[85973]: INFO cinder.volume.manager [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] Determined volume DB was empty at startup. Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG cinder.volume.manager [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85973) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 11 04:22:40 devstack cinder-volume[85973]: INFO cinder.volume.manager [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 11 04:22:40 devstack cinder-volume[85973]: WARNING stevedore.named [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 11 04:22:40 devstack cinder-volume[85973]: WARNING castellan.key_manager [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 11 04:22:40 devstack cinder-volume[85973]: WARNING cinder.keymgr.conf_key_mgr [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 11 04:22:40 devstack cinder-volume[85973]: INFO cinder.volume.manager [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_db.sqlalchemy.engines [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85973) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 04:22:40 devstack cinder-volume[85973]: INFO oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] Starting 1 workers Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] Started child 86189 {{(pid=85973) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] Full set of CONF: {{(pid=85973) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] ******************************************************************************** {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] Configuration options gathered from: {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] ================================================================================ {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] allow_availability_zone_fallback = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] allow_compression_on_image_upload = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] allowed_direct_url_schemes = [] {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] api_rate_limit = True {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] auth_strategy = keystone {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_availability_zone = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_host = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_name = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_stats_polling_interval = 60 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backup_api_class = cinder.backup.api.API {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backup_name_template = backup-%s {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backup_use_same_host = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backup_use_temp_snapshot = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] chap_password = **** {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] chap_username = {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cinder_internal_tenant_project_id = a161bf39780c45f5b07febd6dfb3a343 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cinder_internal_tenant_user_id = caf6f024aa5b484e97b4fa548c28b774 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cluster = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] compression_format = gzip {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] compute_api_class = cinder.compute.nova.API {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] config_dir = [] {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] config_source = [] {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] control_exchange = openstack {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] debug = True {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] default_availability_zone = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] default_group_type = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] default_volume_type = QuobyteHD {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] disk_geometry = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[86189]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] driver_client_cert = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] driver_client_cert_key = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] driver_data_namespace = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] driver_ssl_cert_path = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] driver_ssl_cert_verify = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] driver_use_ssl = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] enable_new_services = True {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] enable_unsupported_driver = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] enabled_backends = ['QuobyteHD'] {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] enforce_multipath_for_image_xfer = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] filter_function = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] glance_api_insecure = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] glance_api_servers = ['http://192.168.122.60/image'] {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] glance_api_ssl_compression = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] glance_ca_certificates_file = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] glance_catalog_info = image:glance:publicURL {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] glance_certfile = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] glance_keyfile = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] glance_num_retries = 3 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] glance_request_timeout = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] goodness_function = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] graceful_shutdown_timeout = 5 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] group_api_class = cinder.group.api.API {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] host = devstack {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] image_compress_on_upload = True {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] image_conversion_address_space_limit = 1 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] image_conversion_cpu_limit = 60 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] image_conversion_disable = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] image_upload_use_cinder_backend = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] image_upload_use_internal_tenant = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] image_volume_cache_enabled = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] image_volume_cache_max_count = 0 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] image_volume_cache_max_size_gb = 0 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] init_host_max_objects_retrieval = 0 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] instance_format = [instance: %(uuid)s] {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] iscsi_target_flags = {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] iscsi_write_cache = on {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] iser_helper = tgtadm {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] iser_ip_address = 192.168.122.60 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] iser_port = 3260 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] log_color = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] log_config_append = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] log_dir = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] log_file = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] log_options = True {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] log_rotate_interval = 1 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] log_rotate_interval_type = days {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] log_rotation_type = none {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] max_age = 0 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] max_logfile_count = 30 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] max_logfile_size_mb = 200 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] max_over_subscription_ratio = 20.0 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] message_reap_interval = 86400 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] message_ttl = 2592000 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] migration_create_volume_timeout_secs = 300 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] monkey_patch = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] monkey_patch_modules = [] {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] my_ip = 192.168.122.60 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] no_snapshot_gb_quota = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] num_iser_scan_tries = 3 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] num_shell_tries = 3 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] num_volume_device_scan_tries = 3 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] nvmeof_conn_info_version = 1 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] nvmet_ns_id = 10 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] nvmet_port_id = 1 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] osapi_max_limit = 1000 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] osapi_volume_ext_list = [] {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] osapi_volume_listen_port = 8776 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] osapi_volume_use_ssl = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] osapi_volume_workers = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] per_volume_size_limit = -1 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] periodic_fuzzy_delay = 60 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] periodic_interval = 60 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] public_endpoint = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] publish_errors = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] quota_backup_gigabytes = 1000 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] quota_backups = 10 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] quota_gigabytes = 1000 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] quota_groups = 10 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] quota_snapshots = 10 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] quota_volumes = 10 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] rate_limit_burst = 0 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] rate_limit_except_level = CRITICAL {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] rate_limit_interval = 0 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] reinit_driver_count = 3 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] replication_device = **** {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] report_discard_supported = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] report_interval = 120 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] reservation_clean_interval = 86400 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] reservation_expire = 86400 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] reserved_image_namespaces = [] {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] reserved_percentage = 0 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] rpc_response_timeout = 120 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] run_external_periodic_tasks = True {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] scst_target_driver = iscsi {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] scst_target_iqn_name = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] service_down_time = 720 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] shell_completion = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] snapshot_name_template = snapshot-%s {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] split_loggers = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] state_path = /opt/stack/data/cinder {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] storage_availability_zone = nova {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] storage_protocol = iSCSI {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] syslog_log_facility = LOG_USER {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] target_helper = lioadm {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] target_ip_address = 192.168.122.60 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] target_port = 3260 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] target_protocol = iscsi {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] target_secondary_ip_addresses = [] {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] trace_flags = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] transport_url = **** {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] until_refresh = 0 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] use_chap_auth = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] use_default_quota_class = True {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] use_journal = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] use_json = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] use_multipath_for_image_xfer = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] use_stderr = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] use_syslog = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] verify_glance_signatures = enabled {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] volume_api_class = cinder.volume.api.API {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] volume_backend_name = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] volume_clear = zero {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] volume_clear_ionice = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] volume_clear_size = 0 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] volume_copy_bps_limit = 0 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] volume_dd_blocksize = 1M {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] volume_name_template = volume-%s {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] volume_service_inithost_offload = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] volume_usage_audit_period = month {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] zoning_mode = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_concurrency.disable_process_locking = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] keystone_authtoken.auth_section = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] keystone_authtoken.auth_type = password {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] keystone_authtoken.auth_version = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] keystone_authtoken.cache = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] keystone_authtoken.certfile = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] keystone_authtoken.include_service_catalog = True {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] keystone_authtoken.insecure = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] keystone_authtoken.interface = public {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] keystone_authtoken.keyfile = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] keystone_authtoken.memcache_password = {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] keystone_authtoken.memcache_username = {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] keystone_authtoken.region_name = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] keystone_authtoken.service_type = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.60/identity {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cache.backend = dogpile.cache.null {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cache.backend_argument = **** {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cache.backend_expiration_time = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cache.config_prefix = cache.oslo {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cache.debug_cache_backend = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cache.enable_retry_client = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cache.enable_socket_keepalive = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cache.enabled = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cache.expiration_time = 600 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cache.hashclient_retry_attempts = 2 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cache.memcache_dead_retry = 300 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cache.memcache_pool_maxsize = 10 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cache.memcache_sasl_enabled = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cache.password = **** {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cache.proxies = [] {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cache.redis_db = 0 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cache.redis_server = localhost:6379 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cache.retry_attempts = 2 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cache.retry_delay = 0.0 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cache.socket_keepalive_count = 1 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cache.socket_keepalive_idle = 1 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cache.socket_keepalive_interval = 1 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cache.socket_timeout = 1.0 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cache.tls_allowed_ciphers = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cache.tls_cafile = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cache.tls_certfile = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cache.tls_enabled = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cache.tls_keyfile = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cache.username = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] coordination.backend_url = **** {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] database.asyncio_connection = **** {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] database.asyncio_slave_connection = **** {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] database.backend = sqlalchemy {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] database.connection = **** {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] database.connection_debug = 0 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] database.connection_parameters = {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] database.connection_recycle_time = 3600 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] database.connection_trace = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] database.db_inc_retry_interval = True {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] database.db_max_retries = 20 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] database.db_max_retry_interval = 10 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] database.db_retry_interval = 1 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] database.max_overflow = 50 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] database.max_pool_size = 5 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] database.max_retries = 10 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] database.mysql_wsrep_sync_wait = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[86189]: INFO cinder.volume.manager [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] database.pool_timeout = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] database.retry_interval = 10 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] database.slave_connection = **** {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] database.sqlite_synchronous = True {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] database.synchronous_reader = True {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] database.use_db_reconnect = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] profiler.connection_string = messaging:// {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] profiler.enabled = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] profiler.es_doc_type = notification {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] profiler.es_scroll_size = 10000 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] profiler.es_scroll_time = 2m {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] profiler.filter_error_trace = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] profiler.hmac_keys = **** {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] profiler.sentinel_service_name = mymaster {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] profiler.socket_timeout = 0.1 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] profiler.trace_requests = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] profiler.trace_sqlalchemy = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] profiler_jaeger.process_tags = {} {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] profiler_jaeger.service_name_prefix = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] profiler_otlp.service_name_prefix = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_policy.enforce_new_defaults = True {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_policy.enforce_scope = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_policy.policy_default_rule = default {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_policy.policy_file = policy.yaml {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] privsep_osbrick.group = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] privsep_osbrick.helper_command = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] privsep_osbrick.user = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[86189]: DEBUG cinder.volume.drivers.remotefs [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86189) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cinder_sys_admin.group = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cinder_sys_admin.helper_command = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] cinder_sys_admin.user = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] service_user.auth_section = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] service_user.auth_type = password {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] service_user.cafile = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] service_user.certfile = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] service_user.collect_timing = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] service_user.insecure = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] service_user.keyfile = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] service_user.send_service_user_token = True {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] service_user.split_loggers = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] service_user.timeout = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] glance.auth_section = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] glance.auth_type = password {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] glance.certfile = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] glance.collect_timing = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] glance.insecure = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] glance.keyfile = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] glance.region_name = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] glance.split_loggers = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] glance.timeout = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.backend_availability_zone = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.chap_password = **** {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.chap_username = {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.disk_geometry = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.driver_client_cert = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.driver_client_cert_key = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.driver_data_namespace = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.driver_use_ssl = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.extra_capabilities = {} {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.filter_function = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.goodness_function = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.iscsi_target_flags = {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.iscsi_write_cache = on {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.iser_helper = tgtadm {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.iser_ip_address = 192.168.122.60 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.iser_port = 3260 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.nas_host = {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.nas_login = admin {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.nas_mount_options = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.nas_password = **** {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.nas_private_key = {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.nas_share_path = {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.num_shell_tries = 3 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.quobyte_volume_url = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.replication_device = **** {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.report_discard_supported = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.reserved_percentage = 0 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.target_helper = tgtadm {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.target_ip_address = 192.168.122.60 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.target_port = 3260 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.target_protocol = iscsi {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.trace_flags = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.unique_fqdn_network = True {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.use_chap_auth = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.volume_backend_name = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.volume_clear = zero {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.volume_clear_ionice = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.volume_clear_size = 0 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_reports.file_event_handler = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_reports.log_dir = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.backend_availability_zone = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.backend_host = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.chap_password = **** {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.chap_username = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.chiscsi_conf = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.disk_geometry = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.driver_client_cert = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.driver_data_namespace = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.driver_use_ssl = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.extra_capabilities = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.filter_function = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.goodness_function = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.iser_helper = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.iser_ip_address = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.iser_port = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.iser_target_prefix = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.nas_host = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.nas_login = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.nas_mount_options = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.nas_password = **** {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.nas_private_key = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.nas_share_path = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.nas_ssh_port = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.num_shell_tries = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.nvmet_port_id = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.replication_device = **** {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.report_discard_supported = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.reserved_percentage = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.scst_target_driver = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.storage_protocol = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.target_helper = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.target_ip_address = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.target_port = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.target_prefix = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.target_protocol = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.trace_flags = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.use_chap_auth = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.volume_clear = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.volume_clear_size = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] QuobyteHD.volumes_dir = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_rabbit.ssl = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_notifications.driver = [] {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_notifications.retry = -1 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] key_manager.fixed_key = **** {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] barbican.barbican_api_version = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] barbican.barbican_endpoint = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] barbican.barbican_endpoint_type = public {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] barbican.barbican_region_name = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] barbican.cafile = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] barbican.certfile = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] barbican.collect_timing = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] barbican.insecure = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] barbican.keyfile = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] barbican.number_of_retries = 60 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] barbican.retry_delay = 1 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] barbican.send_service_user_token = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] barbican.split_loggers = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] barbican.timeout = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] barbican.verify_ssl = True {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] barbican.verify_ssl_path = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] barbican_service_user.auth_section = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] barbican_service_user.auth_type = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] barbican_service_user.cafile = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] barbican_service_user.certfile = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] barbican_service_user.collect_timing = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] barbican_service_user.insecure = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] barbican_service_user.keyfile = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] barbican_service_user.split_loggers = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] barbican_service_user.timeout = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] vault.approle_role_id = **** {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] vault.approle_secret_id = **** {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] vault.kv_mountpoint = secret {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] vault.kv_path = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] vault.kv_version = 2 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] vault.namespace = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] vault.root_token_id = **** {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] vault.ssl_ca_crt_file = None {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] vault.timeout = 60.0 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] vault.use_ssl = False {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:40 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] ******************************************************************************** {{(pid=85973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 11 04:22:40 devstack cinder-volume[86189]: DEBUG cinder.volume.drivers.quobyte [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86189) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 11 04:22:40 devstack cinder-volume[86189]: WARNING cinder.volume.drivers.quobyte [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 11 04:22:40 devstack cinder-volume[86189]: WARNING cinder.volume.drivers.quobyte [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 11 04:22:40 devstack cinder-volume[86189]: DEBUG oslo_concurrency.processutils [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] Running cmd (subprocess): mount.quobyte {{(pid=86189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:40 devstack quobyte-client[86194]: Reading configuration file: /etc/quobyte/client.cfg Jul 11 04:22:40 devstack quobyte-client[86194]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 11 04:22:40 devstack cinder-volume[86189]: DEBUG oslo_concurrency.processutils [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] CMD "mount.quobyte" returned: 1 in 0.063s {{(pid=86189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:40 devstack cinder-volume[86189]: DEBUG oslo_concurrency.lockutils [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:40 devstack cinder-volume[86189]: DEBUG oslo_concurrency.lockutils [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:40 devstack cinder-volume[86189]: DEBUG cinder.volume.drivers.quobyte [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:22:40 devstack cinder-volume[86189]: INFO cinder.volume.drivers.quobyte [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 ... Jul 11 04:22:40 devstack cinder-volume[86189]: DEBUG oslo_concurrency.processutils [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 -c /etc/quobyte/client-cinder.cfg {{(pid=86189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:40 devstack sudo[86195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 -c /etc/quobyte/client-cinder.cfg Jul 11 04:22:40 devstack sudo[86195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:41 devstack sudo[86195]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:41 devstack cinder-volume[86189]: DEBUG oslo_concurrency.processutils [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.743s {{(pid=86189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:41 devstack cinder-volume[86189]: INFO cinder.volume.drivers.quobyte [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 succeeded Jul 11 04:22:41 devstack cinder-volume[86189]: DEBUG cinder.volume.drivers.quobyte [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:22:41 devstack cinder-volume[86189]: DEBUG oslo_concurrency.lockutils [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.756s {{(pid=86189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:41 devstack cinder-volume[86189]: DEBUG oslo_concurrency.processutils [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:41 devstack sudo[86264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:22:41 devstack sudo[86264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:42 devstack sudo[86264]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:42 devstack cinder-volume[86189]: DEBUG oslo_concurrency.processutils [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.620s {{(pid=86189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:42 devstack cinder-volume[86189]: INFO cinder.volume.driver [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] Driver hasn't implemented _init_vendor_properties() Jul 11 04:22:42 devstack cinder-volume[86189]: DEBUG cinder.volume.driver [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.730354309082, 'free_capacity_gb': 1775.730354309082, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86189) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 11 04:22:42 devstack cinder-volume[86189]: DEBUG oslo_db.sqlalchemy.engines [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86189) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 04:22:42 devstack cinder-volume[86189]: DEBUG dbcounter [-] [86189] Writer thread running {{(pid=86189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 11 04:22:42 devstack cinder-volume[86189]: DEBUG cinder.db.api [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] Building query based on filter {{(pid=86189) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 11 04:22:42 devstack cinder-volume[86189]: DEBUG cinder.image.image_utils [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86189) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 11 04:22:42 devstack cinder-volume[86189]: INFO cinder.keymgr.migration [None req-f75663c9-cd2c-41db-a8b6-24888110c536 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 11 04:22:42 devstack cinder-volume[86189]: DEBUG oslo_concurrency.lockutils [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:42 devstack cinder-volume[86189]: DEBUG oslo_concurrency.lockutils [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:42 devstack cinder-volume[86189]: DEBUG cinder.volume.drivers.quobyte [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:22:42 devstack cinder-volume[86189]: DEBUG cinder.volume.drivers.quobyte [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:22:42 devstack cinder-volume[86189]: DEBUG oslo_concurrency.lockutils [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:42 devstack cinder-volume[86189]: DEBUG oslo_concurrency.processutils [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:42 devstack sudo[86270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:22:42 devstack sudo[86270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:42 devstack sudo[86270]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:42 devstack cinder-volume[86189]: DEBUG oslo_concurrency.processutils [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.679s {{(pid=86189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:42 devstack cinder-volume[86189]: DEBUG cinder.manager [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] Notifying Schedulers of capabilities ... {{(pid=86189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:22:42 devstack cinder-volume[86189]: INFO cinder.volume.manager [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] Driver initialization completed successfully. Jul 11 04:22:42 devstack cinder-volume[86189]: INFO cinder.manager [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] Initiating service 3 cleanup Jul 11 04:22:42 devstack cinder-volume[86189]: INFO cinder.manager [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] Service 3 cleanup completed. Jul 11 04:22:42 devstack cinder-volume[86189]: DEBUG cinder.service [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] Creating RPC server for service cinder-volume {{(pid=86189) start /opt/stack/cinder/cinder/service.py:231}} Jul 11 04:22:42 devstack cinder-volume[86189]: DEBUG cinder.service [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86189) start /opt/stack/cinder/cinder/service.py:237}} Jul 11 04:22:43 devstack cinder-volume[86189]: INFO cinder.volume.manager [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 11 04:22:43 devstack cinder-volume[86189]: DEBUG oslo_concurrency.lockutils [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:43 devstack cinder-volume[86189]: DEBUG oslo_concurrency.lockutils [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:43 devstack cinder-volume[86189]: DEBUG cinder.volume.drivers.quobyte [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:22:43 devstack cinder-volume[86189]: DEBUG cinder.volume.drivers.quobyte [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:22:43 devstack cinder-volume[86189]: DEBUG oslo_concurrency.lockutils [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:43 devstack cinder-volume[86189]: DEBUG oslo_concurrency.processutils [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:43 devstack sudo[86286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:22:43 devstack sudo[86286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:43 devstack sudo[86286]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:43 devstack cinder-volume[86189]: DEBUG oslo_concurrency.processutils [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.889s {{(pid=86189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:44 devstack cinder-volume[86189]: INFO cinder.volume.manager [None req-fdeee1b2-0128-48cc-9f16-54fcb5526658 None None] Driver post RPC initialization completed successfully. Jul 11 04:22:48 devstack cinder-volume[86189]: DEBUG oslo_concurrency.lockutils [None req-78e92a4d-528d-4192-9bce-4add6c207fd7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:48 devstack cinder-volume[86189]: DEBUG oslo_concurrency.lockutils [None req-78e92a4d-528d-4192-9bce-4add6c207fd7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:48 devstack cinder-volume[86189]: DEBUG cinder.volume.drivers.quobyte [None req-78e92a4d-528d-4192-9bce-4add6c207fd7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:22:48 devstack cinder-volume[86189]: DEBUG cinder.volume.drivers.quobyte [None req-78e92a4d-528d-4192-9bce-4add6c207fd7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:22:48 devstack cinder-volume[86189]: DEBUG oslo_concurrency.lockutils [None req-78e92a4d-528d-4192-9bce-4add6c207fd7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86189) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:48 devstack cinder-volume[86189]: DEBUG oslo_concurrency.processutils [None req-78e92a4d-528d-4192-9bce-4add6c207fd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:48 devstack sudo[86482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:22:48 devstack sudo[86482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:48 devstack sudo[86482]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:48 devstack cinder-volume[86189]: DEBUG oslo_concurrency.processutils [None req-78e92a4d-528d-4192-9bce-4add6c207fd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.661s {{(pid=86189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:48 devstack cinder-volume[86189]: DEBUG cinder.manager [None req-78e92a4d-528d-4192-9bce-4add6c207fd7 None None] Notifying Schedulers of capabilities ... {{(pid=86189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:22:49 devstack cinder-volume[85973]: INFO oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] Caught SIGTERM, stopping children Jul 11 04:22:49 devstack cinder-volume[85973]: DEBUG oslo_concurrency.lockutils [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] Acquiring lock "singleton_lock" {{(pid=85973) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 11 04:22:49 devstack cinder-volume[85973]: DEBUG oslo_concurrency.lockutils [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] Acquired lock "singleton_lock" {{(pid=85973) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 11 04:22:49 devstack cinder-volume[85973]: DEBUG oslo_concurrency.lockutils [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] Releasing lock "singleton_lock" {{(pid=85973) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 11 04:22:49 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] Stop services. {{(pid=85973) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 11 04:22:49 devstack cinder-volume[85973]: DEBUG oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] Killing children. {{(pid=85973) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 11 04:22:49 devstack cinder-volume[85973]: INFO oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] Waiting on 1 children to exit Jul 11 04:22:51 devstack cinder-volume[86189]: DEBUG oslo_concurrency.lockutils [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] Acquiring lock "singleton_lock" {{(pid=86189) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 11 04:22:51 devstack cinder-volume[86189]: DEBUG oslo_concurrency.lockutils [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] Acquired lock "singleton_lock" {{(pid=86189) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 11 04:22:51 devstack cinder-volume[86189]: DEBUG oslo_concurrency.lockutils [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] Releasing lock "singleton_lock" {{(pid=86189) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 11 04:22:51 devstack cinder-volume[86189]: WARNING amqp [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 11 04:22:51 devstack cinder-volume[86189]: WARNING amqp [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 11 04:22:51 devstack cinder-volume[85973]: INFO oslo_service.backend._eventlet.service [None req-9d0747d5-99c6-4806-88c2-33fb337d1100 None None] Child 86189 exited with status 0 Jul 11 04:22:52 devstack cinder-volume[86616]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 11 04:22:52 devstack cinder-volume[86616]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 11 04:22:52 devstack cinder-volume[86616]: we strongly recommend against using it for new projects. Jul 11 04:22:52 devstack cinder-volume[86616]: If you are already using Eventlet, we recommend migrating to a different Jul 11 04:22:52 devstack cinder-volume[86616]: framework. For more detail see Jul 11 04:22:52 devstack cinder-volume[86616]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 11 04:22:52 devstack cinder-volume[86616]: import eventlet # noqa Jul 11 04:22:55 devstack cinder-volume[86616]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86616) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 11 04:22:55 devstack cinder-volume[86616]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86616) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 11 04:22:55 devstack cinder-volume[86616]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86616) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 11 04:22:56 devstack cinder-volume[86616]: INFO dbcounter [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] Registered counter for database cinder Jul 11 04:22:56 devstack cinder-volume[86616]: DEBUG oslo_db.sqlalchemy.engines [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86616) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG dbcounter [-] [86616] Writer thread running {{(pid=86616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 11 04:22:57 devstack cinder-volume[86616]: INFO cinder.rpc [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 11 04:22:57 devstack cinder-volume[86616]: INFO cinder.rpc [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_db.sqlalchemy.engines [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86616) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 04:22:57 devstack cinder-volume[86616]: INFO cinder.volume.manager [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] Determined volume DB was empty at startup. Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG cinder.volume.manager [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86616) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 11 04:22:57 devstack cinder-volume[86616]: WARNING stevedore.named [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 11 04:22:57 devstack cinder-volume[86616]: WARNING castellan.key_manager [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 11 04:22:57 devstack cinder-volume[86616]: WARNING cinder.keymgr.conf_key_mgr [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 11 04:22:57 devstack cinder-volume[86616]: INFO cinder.volume.manager [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_db.sqlalchemy.engines [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86616) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 04:22:57 devstack cinder-volume[86616]: INFO oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] Starting 1 workers Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] Started child 86964 {{(pid=86616) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 11 04:22:57 devstack cinder-volume[86964]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] Full set of CONF: {{(pid=86616) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] ******************************************************************************** {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] Configuration options gathered from: {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] ================================================================================ {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] allow_availability_zone_fallback = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] allow_compression_on_image_upload = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] allowed_direct_url_schemes = [] {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] api_rate_limit = True {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] auth_strategy = keystone {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_availability_zone = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_host = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_name = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_stats_polling_interval = 60 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backup_api_class = cinder.backup.api.API {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backup_name_template = backup-%s {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backup_use_same_host = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backup_use_temp_snapshot = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] chap_password = **** {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] chap_username = {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cinder_internal_tenant_project_id = a161bf39780c45f5b07febd6dfb3a343 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cinder_internal_tenant_user_id = caf6f024aa5b484e97b4fa548c28b774 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cluster = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] compression_format = gzip {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] compute_api_class = cinder.compute.nova.API {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] config_dir = [] {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] config_source = [] {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] control_exchange = openstack {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] debug = True {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] default_availability_zone = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] default_group_type = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] default_volume_type = QuobyteHD {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] disk_geometry = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] driver_client_cert = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] driver_client_cert_key = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] driver_data_namespace = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] driver_ssl_cert_path = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] driver_ssl_cert_verify = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] driver_use_ssl = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] enable_new_services = True {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] enable_unsupported_driver = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] enabled_backends = ['QuobyteHD'] {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] enforce_multipath_for_image_xfer = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] filter_function = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] glance_api_insecure = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 11 04:22:57 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86964) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] glance_api_servers = ['http://192.168.122.60/image'] {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] glance_api_ssl_compression = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] glance_ca_certificates_file = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] glance_catalog_info = image:glance:publicURL {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] glance_certfile = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] glance_keyfile = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] glance_num_retries = 3 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] glance_request_timeout = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] goodness_function = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] graceful_shutdown_timeout = 5 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] group_api_class = cinder.group.api.API {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] host = devstack {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] image_compress_on_upload = True {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] image_conversion_address_space_limit = 1 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] image_conversion_cpu_limit = 60 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] image_conversion_disable = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] image_upload_use_cinder_backend = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] image_upload_use_internal_tenant = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] image_volume_cache_enabled = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] image_volume_cache_max_count = 0 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] image_volume_cache_max_size_gb = 0 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] init_host_max_objects_retrieval = 0 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] instance_format = [instance: %(uuid)s] {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] iscsi_target_flags = {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] iscsi_write_cache = on {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] iser_helper = tgtadm {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] iser_ip_address = 192.168.122.60 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] iser_port = 3260 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] log_color = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] log_config_append = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] log_dir = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] log_file = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] log_options = True {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] log_rotate_interval = 1 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] log_rotate_interval_type = days {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] log_rotation_type = none {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] max_age = 0 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] max_logfile_count = 30 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] max_logfile_size_mb = 200 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] max_over_subscription_ratio = 20.0 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] message_reap_interval = 86400 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] message_ttl = 2592000 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] migration_create_volume_timeout_secs = 300 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] monkey_patch = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] monkey_patch_modules = [] {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] my_ip = 192.168.122.60 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] no_snapshot_gb_quota = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] num_iser_scan_tries = 3 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] num_shell_tries = 3 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] num_volume_device_scan_tries = 3 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] nvmeof_conn_info_version = 1 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] nvmet_ns_id = 10 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] nvmet_port_id = 1 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] osapi_max_limit = 1000 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] osapi_volume_ext_list = [] {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] osapi_volume_listen_port = 8776 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] osapi_volume_use_ssl = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] osapi_volume_workers = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] per_volume_size_limit = -1 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] periodic_fuzzy_delay = 60 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] periodic_interval = 60 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] public_endpoint = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] publish_errors = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] quota_backup_gigabytes = 1000 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] quota_backups = 10 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] quota_gigabytes = 1000 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] quota_groups = 10 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] quota_snapshots = 10 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] quota_volumes = 10 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] rate_limit_burst = 0 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] rate_limit_except_level = CRITICAL {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] rate_limit_interval = 0 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] reinit_driver_count = 3 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] replication_device = **** {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] report_discard_supported = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] report_interval = 120 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] reservation_clean_interval = 86400 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] reservation_expire = 86400 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] reserved_image_namespaces = [] {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] reserved_percentage = 0 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86964) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 11 04:22:57 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.quobyte [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 11 04:22:57 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.quobyte [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] rpc_response_timeout = 120 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] run_external_periodic_tasks = True {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] scst_target_driver = iscsi {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] scst_target_iqn_name = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] service_down_time = 720 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] Running cmd (subprocess): mount.quobyte {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] shell_completion = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] snapshot_name_template = snapshot-%s {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] split_loggers = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] state_path = /opt/stack/data/cinder {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] storage_availability_zone = nova {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] storage_protocol = iSCSI {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] syslog_log_facility = LOG_USER {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] target_helper = lioadm {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] target_ip_address = 192.168.122.60 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] target_port = 3260 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] target_protocol = iscsi {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] target_secondary_ip_addresses = [] {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] trace_flags = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] transport_url = **** {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] until_refresh = 0 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] use_chap_auth = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] use_default_quota_class = True {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] use_journal = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] use_json = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] use_multipath_for_image_xfer = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] use_stderr = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] use_syslog = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] verify_glance_signatures = enabled {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] volume_api_class = cinder.volume.api.API {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] volume_backend_name = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] volume_clear = zero {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] volume_clear_ionice = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] volume_clear_size = 0 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] volume_copy_bps_limit = 0 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] volume_dd_blocksize = 1M {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] volume_name_template = volume-%s {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] volume_service_inithost_offload = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] volume_usage_audit_period = month {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] zoning_mode = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_concurrency.disable_process_locking = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] keystone_authtoken.auth_section = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] keystone_authtoken.auth_type = password {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] keystone_authtoken.auth_version = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] keystone_authtoken.cache = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] keystone_authtoken.certfile = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] keystone_authtoken.include_service_catalog = True {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] keystone_authtoken.insecure = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] keystone_authtoken.interface = public {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] keystone_authtoken.keyfile = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] keystone_authtoken.memcache_password = {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] keystone_authtoken.memcache_username = {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] keystone_authtoken.region_name = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] keystone_authtoken.service_type = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.60/identity {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cache.backend = dogpile.cache.null {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cache.backend_argument = **** {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cache.backend_expiration_time = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack quobyte-client[86965]: Reading configuration file: /etc/quobyte/client.cfg Jul 11 04:22:57 devstack quobyte-client[86965]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cache.config_prefix = cache.oslo {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cache.debug_cache_backend = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cache.enable_retry_client = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cache.enable_socket_keepalive = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cache.enabled = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cache.expiration_time = 600 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cache.hashclient_retry_attempts = 2 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cache.memcache_dead_retry = 300 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cache.memcache_pool_maxsize = 10 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cache.memcache_sasl_enabled = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cache.password = **** {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] CMD "mount.quobyte" returned: 1 in 0.081s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cache.proxies = [] {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cache.redis_db = 0 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cache.redis_server = localhost:6379 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:57 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cache.retry_attempts = 2 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cache.retry_delay = 0.0 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cache.socket_keepalive_count = 1 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cache.socket_keepalive_idle = 1 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cache.socket_keepalive_interval = 1 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cache.socket_timeout = 1.0 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cache.tls_allowed_ciphers = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cache.tls_cafile = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cache.tls_certfile = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cache.tls_enabled = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cache.tls_keyfile = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cache.username = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] coordination.backend_url = **** {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] database.asyncio_connection = **** {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] database.asyncio_slave_connection = **** {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] database.backend = sqlalchemy {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] database.connection = **** {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] database.connection_debug = 0 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] database.connection_parameters = {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] database.connection_recycle_time = 3600 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] database.connection_trace = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] database.db_inc_retry_interval = True {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] database.db_max_retries = 20 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] database.db_max_retry_interval = 10 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:22:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] database.db_retry_interval = 1 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] database.max_overflow = 50 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] database.max_pool_size = 5 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] database.max_retries = 10 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] database.mysql_wsrep_sync_wait = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] database.pool_timeout = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] database.retry_interval = 10 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] database.slave_connection = **** {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] database.sqlite_synchronous = True {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] database.synchronous_reader = True {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] database.use_db_reconnect = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] profiler.connection_string = messaging:// {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] profiler.enabled = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] profiler.es_doc_type = notification {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] profiler.es_scroll_size = 10000 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] profiler.es_scroll_time = 2m {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] profiler.filter_error_trace = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] profiler.hmac_keys = **** {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] profiler.sentinel_service_name = mymaster {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] profiler.socket_timeout = 0.1 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] profiler.trace_requests = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] profiler.trace_sqlalchemy = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] profiler_jaeger.process_tags = {} {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] profiler_jaeger.service_name_prefix = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] profiler_otlp.service_name_prefix = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_policy.enforce_new_defaults = True {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_policy.enforce_scope = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_policy.policy_default_rule = default {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_policy.policy_file = policy.yaml {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] privsep_osbrick.group = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] privsep_osbrick.helper_command = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] privsep_osbrick.user = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cinder_sys_admin.group = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cinder_sys_admin.helper_command = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] cinder_sys_admin.user = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] service_user.auth_section = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] service_user.auth_type = password {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] service_user.cafile = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] service_user.certfile = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] service_user.collect_timing = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] service_user.insecure = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] service_user.keyfile = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] service_user.send_service_user_token = True {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] service_user.split_loggers = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] service_user.timeout = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] glance.auth_section = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] glance.auth_type = password {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] glance.certfile = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] glance.collect_timing = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] glance.insecure = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] glance.keyfile = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] glance.region_name = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] glance.split_loggers = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] glance.timeout = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.backend_availability_zone = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.chap_password = **** {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.chap_username = {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.disk_geometry = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.driver_client_cert = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.driver_client_cert_key = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.driver_data_namespace = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.driver_use_ssl = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack sudo[86967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.extra_capabilities = {} {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack sudo[86967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.filter_function = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.goodness_function = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.iscsi_target_flags = {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.iscsi_write_cache = on {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.iser_helper = tgtadm {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.iser_ip_address = 192.168.122.60 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.iser_port = 3260 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.nas_host = {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.nas_login = admin {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.nas_mount_options = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.nas_password = **** {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.nas_private_key = {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.nas_share_path = {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.num_shell_tries = 3 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.quobyte_volume_url = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.replication_device = **** {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.report_discard_supported = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.reserved_percentage = 0 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.target_helper = tgtadm {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.target_ip_address = 192.168.122.60 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.target_port = 3260 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.target_protocol = iscsi {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:57 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.trace_flags = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.unique_fqdn_network = True {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.use_chap_auth = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.volume_backend_name = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.volume_clear = zero {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.volume_clear_ionice = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.volume_clear_size = 0 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_reports.file_event_handler = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_reports.log_dir = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.backend_availability_zone = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.backend_host = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.chap_password = **** {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.chap_username = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.chiscsi_conf = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.disk_geometry = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.driver_client_cert = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.driver_data_namespace = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.driver_use_ssl = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.extra_capabilities = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.filter_function = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.goodness_function = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.iser_helper = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.iser_ip_address = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.iser_port = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.iser_target_prefix = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.nas_host = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.nas_login = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.nas_mount_options = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.nas_password = **** {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.nas_private_key = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.nas_share_path = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.nas_ssh_port = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.num_shell_tries = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.nvmet_port_id = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.replication_device = **** {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.report_discard_supported = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.reserved_percentage = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.scst_target_driver = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.storage_protocol = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.target_helper = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.target_ip_address = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.target_port = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.target_prefix = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.target_protocol = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.trace_flags = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.use_chap_auth = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.volume_clear = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.volume_clear_size = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] QuobyteHD.volumes_dir = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_rabbit.ssl = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_notifications.driver = [] {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_notifications.retry = -1 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] key_manager.fixed_key = **** {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] barbican.barbican_api_version = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] barbican.barbican_endpoint = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] barbican.barbican_endpoint_type = public {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] barbican.barbican_region_name = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] barbican.cafile = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] barbican.certfile = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] barbican.collect_timing = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] barbican.insecure = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] barbican.keyfile = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] barbican.number_of_retries = 60 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] barbican.retry_delay = 1 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] barbican.send_service_user_token = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] barbican.split_loggers = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] barbican.timeout = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] barbican.verify_ssl = True {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] barbican.verify_ssl_path = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] barbican_service_user.auth_section = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] barbican_service_user.auth_type = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] barbican_service_user.cafile = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] barbican_service_user.certfile = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] barbican_service_user.collect_timing = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] barbican_service_user.insecure = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] barbican_service_user.keyfile = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] barbican_service_user.split_loggers = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] barbican_service_user.timeout = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] vault.approle_role_id = **** {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] vault.approle_secret_id = **** {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] vault.kv_mountpoint = secret {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] vault.kv_path = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] vault.kv_version = 2 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] vault.namespace = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] vault.root_token_id = **** {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] vault.ssl_ca_crt_file = None {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] vault.timeout = 60.0 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] vault.use_ssl = False {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 04:22:58 devstack cinder-volume[86616]: DEBUG oslo_service.backend._eventlet.service [None req-54191708-595d-4983-9b42-2e8ac9035a19 None None] ******************************************************************************** {{(pid=86616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 11 04:22:58 devstack sudo[86967]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.714s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:58 devstack cinder-volume[86964]: INFO cinder.volume.driver [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] Driver hasn't implemented _init_vendor_properties() Jul 11 04:22:58 devstack cinder-volume[86964]: DEBUG cinder.volume.driver [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.726375579834, 'free_capacity_gb': 1775.726375579834, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86964) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 11 04:22:58 devstack cinder-volume[86964]: DEBUG oslo_db.sqlalchemy.engines [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86964) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 04:22:58 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writer thread running {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 11 04:22:58 devstack cinder-volume[86964]: DEBUG cinder.db.api [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] Building query based on filter {{(pid=86964) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 11 04:22:58 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86964) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 11 04:22:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:22:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:22:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:58 devstack cinder-volume[86964]: INFO cinder.keymgr.migration [None req-21b138aa-aa39-43c2-b556-fcaf2606df26 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 11 04:22:58 devstack sudo[86972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:22:58 devstack sudo[86972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:59 devstack sudo[86972]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.584s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:59 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:22:59 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] Driver initialization completed successfully. Jul 11 04:22:59 devstack cinder-volume[86964]: INFO cinder.manager [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] Initiating service 3 cleanup Jul 11 04:22:59 devstack cinder-volume[86964]: INFO cinder.manager [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] Service 3 cleanup completed. Jul 11 04:22:59 devstack cinder-volume[86964]: DEBUG cinder.service [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] Creating RPC server for service cinder-volume {{(pid=86964) start /opt/stack/cinder/cinder/service.py:231}} Jul 11 04:22:59 devstack cinder-volume[86964]: DEBUG cinder.service [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86964) start /opt/stack/cinder/cinder/service.py:237}} Jul 11 04:22:59 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 11 04:22:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:22:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:22:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:59 devstack sudo[86977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:22:59 devstack sudo[86977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:23:00 devstack sudo[86977]: pam_unix(sudo:session): session closed for user root Jul 11 04:23:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.614s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:23:00 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-b4a33f5e-9f7a-4514-802a-acc982b8bea7 None None] Driver post RPC initialization completed successfully. Jul 11 04:23:07 devstack cinder-volume[86616]: DEBUG dbcounter [-] [86616] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:23:09 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=1 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:23:10 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:23:58 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-23906a46-66c3-4b09-b528-b60f61be8293 tempest-GroupsV314Test-925762657 None] Group tempest-GroupsV314Test-Group-1772199204: creating Jul 11 04:23:58 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-23906a46-66c3-4b09-b528-b60f61be8293 tempest-GroupsV314Test-925762657 None] Group tempest-GroupsV314Test-Group-1772199204: created successfully Jul 11 04:23:58 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-23906a46-66c3-4b09-b528-b60f61be8293 tempest-GroupsV314Test-925762657 None] Create group completed successfully. Jul 11 04:23:59 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:23:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:23:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:23:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:23:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:23:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:23:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:23:59 devstack sudo[87259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:23:59 devstack sudo[87259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:00 devstack sudo[87259]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.960s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:00 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:24:00 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager._thread_info {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:24:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread count: 6 {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:24:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread info: [<_MainThread(MainThread, started 124675027595392)>, , , , , ] {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:24:00 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-78b1097e-b582-4e86-8fdb-f118f2dea540 tempest-GroupsV314Test-925762657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:24:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-78b1097e-b582-4e86-8fdb-f118f2dea540 tempest-GroupsV314Test-925762657 None] Flow 'volume_create_manager' (1a4cae49-9a45-4f01-a377-cd3be6ae5b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:24:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-78b1097e-b582-4e86-8fdb-f118f2dea540 tempest-GroupsV314Test-925762657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d799ac67-92b4-4f7f-be86-c37b5fbd6304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:24:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-78b1097e-b582-4e86-8fdb-f118f2dea540 tempest-GroupsV314Test-925762657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d799ac67-92b4-4f7f-be86-c37b5fbd6304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1390825222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dc672427-6ee1-4539-bb6c-3b096dcba052,host='devstack@QuobyteHD#QuobyteHD',id=c766a756-38a4-40a0-9f2d-90d0ec2354d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d7186462aa64230a00cc81381c05b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:24:00Z,use_quota=True,user_id='49913804ad80412f8763118a13de2ef5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fda4966e-c169-4580-b018-8764801303ef),volume_type_id=fda4966e-c169-4580-b018-8764801303ef)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:24:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-78b1097e-b582-4e86-8fdb-f118f2dea540 tempest-GroupsV314Test-925762657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad6d053-a2b3-4bde-b4ee-934599145161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:24:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-78b1097e-b582-4e86-8fdb-f118f2dea540 tempest-GroupsV314Test-925762657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad6d053-a2b3-4bde-b4ee-934599145161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:24:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-78b1097e-b582-4e86-8fdb-f118f2dea540 tempest-GroupsV314Test-925762657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33be58a7-3ca0-40a9-98eb-904eaeacb634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:24:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-78b1097e-b582-4e86-8fdb-f118f2dea540 tempest-GroupsV314Test-925762657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33be58a7-3ca0-40a9-98eb-904eaeacb634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c766a756-38a4-40a0-9f2d-90d0ec2354d7', 'volume_name': 'volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:24:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-78b1097e-b582-4e86-8fdb-f118f2dea540 tempest-GroupsV314Test-925762657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1402c92d-31c2-408e-a153-248b6176b865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:24:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-78b1097e-b582-4e86-8fdb-f118f2dea540 tempest-GroupsV314Test-925762657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1402c92d-31c2-408e-a153-248b6176b865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:24:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-78b1097e-b582-4e86-8fdb-f118f2dea540 tempest-GroupsV314Test-925762657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb242cde-d7c4-49fd-b8e6-b63f2a2db555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:24:00 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-78b1097e-b582-4e86-8fdb-f118f2dea540 tempest-GroupsV314Test-925762657 None] Volume c766a756-38a4-40a0-9f2d-90d0ec2354d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7', 'volume_size': 1} Jul 11 04:24:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-78b1097e-b582-4e86-8fdb-f118f2dea540 tempest-GroupsV314Test-925762657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:24:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-78b1097e-b582-4e86-8fdb-f118f2dea540 tempest-GroupsV314Test-925762657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:24:00 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-78b1097e-b582-4e86-8fdb-f118f2dea540 tempest-GroupsV314Test-925762657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dc672427-6ee1-4539-bb6c-3b096dcba052,created_at=2026-07-11T02:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1390825222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dc672427-6ee1-4539-bb6c-3b096dcba052,host='devstack@QuobyteHD#QuobyteHD',id=c766a756-38a4-40a0-9f2d-90d0ec2354d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d7186462aa64230a00cc81381c05b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:24:00Z,use_quota=True,user_id='49913804ad80412f8763118a13de2ef5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fda4966e-c169-4580-b018-8764801303ef),volume_type_id=fda4966e-c169-4580-b018-8764801303ef)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:24:00 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-78b1097e-b582-4e86-8fdb-f118f2dea540 tempest-GroupsV314Test-925762657 None] Creating volume c766a756-38a4-40a0-9f2d-90d0ec2354d7 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:24:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-78b1097e-b582-4e86-8fdb-f118f2dea540 tempest-GroupsV314Test-925762657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:24:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-78b1097e-b582-4e86-8fdb-f118f2dea540 tempest-GroupsV314Test-925762657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:24:00 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-78b1097e-b582-4e86-8fdb-f118f2dea540 tempest-GroupsV314Test-925762657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:24:00 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-78b1097e-b582-4e86-8fdb-f118f2dea540 tempest-GroupsV314Test-925762657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:24:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-78b1097e-b582-4e86-8fdb-f118f2dea540 tempest-GroupsV314Test-925762657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:24:00 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-78b1097e-b582-4e86-8fdb-f118f2dea540 tempest-GroupsV314Test-925762657 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:24:00 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-78b1097e-b582-4e86-8fdb-f118f2dea540 tempest-GroupsV314Test-925762657 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:24:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-78b1097e-b582-4e86-8fdb-f118f2dea540 tempest-GroupsV314Test-925762657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:00 devstack sudo[87267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7 1073741824 Jul 11 04:24:00 devstack sudo[87267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:02 devstack sudo[87267]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-78b1097e-b582-4e86-8fdb-f118f2dea540 tempest-GroupsV314Test-925762657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7 1073741824" returned: 0 in 1.555s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-78b1097e-b582-4e86-8fdb-f118f2dea540 tempest-GroupsV314Test-925762657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:02 devstack sudo[87628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7 Jul 11 04:24:02 devstack sudo[87628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:03 devstack sudo[87628]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-78b1097e-b582-4e86-8fdb-f118f2dea540 tempest-GroupsV314Test-925762657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7" returned: 0 in 1.207s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:03 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-78b1097e-b582-4e86-8fdb-f118f2dea540 tempest-GroupsV314Test-925762657 None] <== create_volume: return (2872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:24:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-78b1097e-b582-4e86-8fdb-f118f2dea540 tempest-GroupsV314Test-925762657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.877s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:24:03 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-78b1097e-b582-4e86-8fdb-f118f2dea540 tempest-GroupsV314Test-925762657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb242cde-d7c4-49fd-b8e6-b63f2a2db555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:24:03 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-78b1097e-b582-4e86-8fdb-f118f2dea540 tempest-GroupsV314Test-925762657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (486510f8-11c3-48e7-aed7-471c829b410f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:24:03 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-78b1097e-b582-4e86-8fdb-f118f2dea540 tempest-GroupsV314Test-925762657 None] Volume volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7 (c766a756-38a4-40a0-9f2d-90d0ec2354d7): created successfully Jul 11 04:24:03 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-78b1097e-b582-4e86-8fdb-f118f2dea540 tempest-GroupsV314Test-925762657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (486510f8-11c3-48e7-aed7-471c829b410f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:24:03 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-78b1097e-b582-4e86-8fdb-f118f2dea540 tempest-GroupsV314Test-925762657 None] Flow 'volume_create_manager' (1a4cae49-9a45-4f01-a377-cd3be6ae5b3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:24:03 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-78b1097e-b582-4e86-8fdb-f118f2dea540 tempest-GroupsV314Test-925762657 None] Created volume successfully. Jul 11 04:24:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:24:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:24:07 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Cloning volume c766a756-38a4-40a0-9f2d-90d0ec2354d7 to volume f5cff5d0-cfec-48b2-aebd-ccdb5aa8a8ba Jul 11 04:24:07 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Creating offline snapshot dbb78282-89c1-488e-b313-f8ad6572f4dd of volume c766a756-38a4-40a0-9f2d-90d0ec2354d7 {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:24:07 devstack cinder-volume[86964]: INFO oslo.privsep.daemon [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpvb5tok2l/privsep.sock'] Jul 11 04:24:07 devstack sudo[87708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpvb5tok2l/privsep.sock Jul 11 04:24:07 devstack sudo[87708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:08 devstack cinder-volume[86964]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 11 04:24:08 devstack cinder-volume[86964]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 11 04:24:08 devstack cinder-volume[86964]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 11 04:24:08 devstack cinder-volume[86964]: WARNING oslo.privsep.daemon [-] privsep log: Jul 11 04:24:08 devstack cinder-volume[86964]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 11 04:24:08 devstack cinder-volume[86964]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 11 04:24:08 devstack cinder-volume[86964]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 11 04:24:08 devstack cinder-volume[86964]: WARNING oslo.privsep.daemon [-] privsep log: Jul 11 04:24:08 devstack cinder-volume[86964]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 11 04:24:09 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4cf0e9e-175d-4fac-960e-958fb73ac611 tempest-VolumesAdminNegativeTest-1298578476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:24:09 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f4cf0e9e-175d-4fac-960e-958fb73ac611 tempest-VolumesAdminNegativeTest-1298578476 None] Flow 'volume_create_manager' (a8f7d973-e164-4994-868d-455594cecfce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:24:09 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f4cf0e9e-175d-4fac-960e-958fb73ac611 tempest-VolumesAdminNegativeTest-1298578476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d84bfaa-074c-4b9e-a3d5-58b7bfd655f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:24:09 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f4cf0e9e-175d-4fac-960e-958fb73ac611 tempest-VolumesAdminNegativeTest-1298578476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d84bfaa-074c-4b9e-a3d5-58b7bfd655f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1284890611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5a19a8a-63fd-4c64-aa11-2d53f39f157e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aabe400d06b84d63ad1729775533d94c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:24:09Z,use_quota=True,user_id='f762ded4790b4cd19ad3dc6c80947c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:24:09 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f4cf0e9e-175d-4fac-960e-958fb73ac611 tempest-VolumesAdminNegativeTest-1298578476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4fffbd5-7baf-41c6-8f39-f99cea7d201a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:24:09 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f4cf0e9e-175d-4fac-960e-958fb73ac611 tempest-VolumesAdminNegativeTest-1298578476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4fffbd5-7baf-41c6-8f39-f99cea7d201a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:24:09 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f4cf0e9e-175d-4fac-960e-958fb73ac611 tempest-VolumesAdminNegativeTest-1298578476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb1f0593-f8a9-4502-87a9-d0d6c4605357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:24:09 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f4cf0e9e-175d-4fac-960e-958fb73ac611 tempest-VolumesAdminNegativeTest-1298578476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb1f0593-f8a9-4502-87a9-d0d6c4605357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5a19a8a-63fd-4c64-aa11-2d53f39f157e', 'volume_name': 'volume-d5a19a8a-63fd-4c64-aa11-2d53f39f157e', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:24:09 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f4cf0e9e-175d-4fac-960e-958fb73ac611 tempest-VolumesAdminNegativeTest-1298578476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bf5842c-16ca-4acf-b8d6-f900faae2d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:24:09 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f4cf0e9e-175d-4fac-960e-958fb73ac611 tempest-VolumesAdminNegativeTest-1298578476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bf5842c-16ca-4acf-b8d6-f900faae2d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:24:09 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f4cf0e9e-175d-4fac-960e-958fb73ac611 tempest-VolumesAdminNegativeTest-1298578476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e96bce6e-a592-4c22-909a-11572b6e5825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:24:09 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-f4cf0e9e-175d-4fac-960e-958fb73ac611 tempest-VolumesAdminNegativeTest-1298578476 None] Volume d5a19a8a-63fd-4c64-aa11-2d53f39f157e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5a19a8a-63fd-4c64-aa11-2d53f39f157e', 'volume_size': 1} Jul 11 04:24:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f4cf0e9e-175d-4fac-960e-958fb73ac611 tempest-VolumesAdminNegativeTest-1298578476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:24:10 devstack cinder-volume[86964]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 11 04:24:10 devstack cinder-volume[86964]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 11 04:24:10 devstack cinder-volume[86964]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 11 04:24:10 devstack cinder-volume[86964]: WARNING oslo.privsep.daemon [-] privsep log: Jul 11 04:24:10 devstack cinder-volume[86964]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 11 04:24:10 devstack cinder-volume[86964]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 11 04:24:10 devstack cinder-volume[86964]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 11 04:24:10 devstack cinder-volume[86964]: WARNING oslo.privsep.daemon [-] privsep log: Jul 11 04:24:10 devstack cinder-volume[86964]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 11 04:24:11 devstack sudo[87708]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:11 devstack cinder-volume[86964]: INFO oslo.privsep.daemon [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Spawned new privsep daemon via rootwrap Jul 11 04:24:11 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Accepted privsep connection to /tmp/tmpvb5tok2l/privsep.sock {{(pid=86964) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 11 04:24:11 devstack cinder-volume[86964]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 11 04:24:11 devstack cinder-volume[86964]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 11 04:24:11 devstack cinder-volume[86964]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 11 04:24:11 devstack cinder-volume[86964]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87713 Jul 11 04:24:11 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[8936d400-6320-486c-b733-dfc6a036e612]: (2,) {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:24:11 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a284311-a135-4546-885f-a170549bd116]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:24:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:12 devstack sudo[87716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7 Jul 11 04:24:12 devstack sudo[87716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:13 devstack sudo[87716]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7" returned: 0 in 1.969s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7.dbb78282-89c1-488e-b313-f8ad6572f4dd 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:13 devstack sudo[87752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7.dbb78282-89c1-488e-b313-f8ad6572f4dd 1G Jul 11 04:24:13 devstack sudo[87752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:15 devstack sudo[87752]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7.dbb78282-89c1-488e-b313-f8ad6572f4dd 1G" returned: 0 in 1.288s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7.dbb78282-89c1-488e-b313-f8ad6572f4dd {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:15 devstack sudo[87764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7.dbb78282-89c1-488e-b313-f8ad6572f4dd Jul 11 04:24:15 devstack sudo[87764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:16 devstack sudo[87764]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7.dbb78282-89c1-488e-b313-f8ad6572f4dd" returned: 0 in 0.906s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:16 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7.dbb78282-89c1-488e-b313-f8ad6572f4dd is being set with open permissions: ugo+rw: NotImplementedError Jul 11 04:24:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7.dbb78282-89c1-488e-b313-f8ad6572f4dd {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:16 devstack sudo[87794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7.dbb78282-89c1-488e-b313-f8ad6572f4dd Jul 11 04:24:16 devstack sudo[87794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:17 devstack sudo[87794]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7.dbb78282-89c1-488e-b313-f8ad6572f4dd" returned: 0 in 1.227s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:17 devstack sudo[87821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7.info Jul 11 04:24:17 devstack sudo[87821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:18 devstack sudo[87821]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7.info" returned: 0 in 1.281s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:18 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7.info is being set with open permissions: ugo+rw: NotImplementedError Jul 11 04:24:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:18 devstack sudo[87824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7.info Jul 11 04:24:18 devstack sudo[87824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:19 devstack sudo[87824]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7.info" returned: 0 in 0.852s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:19 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Acquiring lock "cinder-quobyte-f5cff5d0-cfec-48b2-aebd-ccdb5aa8a8ba" by "_copy_volume_from_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:24:19 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Lock "cinder-quobyte-f5cff5d0-cfec-48b2-aebd-ccdb5aa8a8ba" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:24:19 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] snapshot: dbb78282-89c1-488e-b313-f8ad6572f4dd, volume: f5cff5d0-cfec-48b2-aebd-ccdb5aa8a8ba, {{(pid=86964) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 04:24:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:24:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:24:19 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:24:19 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:24:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:24:19 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[974f3f56-f39f-459f-9a82-aaedc808aec8]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:24:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7.dbb78282-89c1-488e-b313-f8ad6572f4dd {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:19 devstack sudo[87827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7.dbb78282-89c1-488e-b313-f8ad6572f4dd Jul 11 04:24:19 devstack sudo[87827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:20 devstack sudo[87827]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7.dbb78282-89c1-488e-b313-f8ad6572f4dd" returned: 0 in 1.458s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:20 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:24:20 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7 {{(pid=86964) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 04:24:20 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Creating direct copy from snapshot {{(pid=86964) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 04:24:21 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c9d00c-2302-4a1d-b04e-624ccb4cabf6]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:24:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:21 devstack sudo[87833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7 Jul 11 04:24:21 devstack sudo[87833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:22 devstack sudo[87833]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7" returned: 0 in 1.243s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:22 devstack cinder-volume[86964]: DEBUG cinder.utils [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Path /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f5cff5d0-cfec-48b2-aebd-ccdb5aa8a8ba not found in is_blk_device check {{(pid=86964) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 04:24:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f5cff5d0-cfec-48b2-aebd-ccdb5aa8a8ba {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:22 devstack sudo[87912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f5cff5d0-cfec-48b2-aebd-ccdb5aa8a8ba Jul 11 04:24:22 devstack sudo[87912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:27 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=12,cinder:INSERT=2,cinder:UPDATE=2 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:24:27 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:UPDATE=8,cinder:SELECT=8,cinder:DELETE=1,cinder:INSERT=1 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:24:28 devstack sudo[87912]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f5cff5d0-cfec-48b2-aebd-ccdb5aa8a8ba" returned: 0 in 6.363s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:28 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[c977fcee-bc45-43bc-a51d-d80cf8c69663]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:24:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:28 devstack sudo[87946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7 Jul 11 04:24:28 devstack sudo[87946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:29 devstack sudo[87946]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7" returned: 0 in 1.193s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:29 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Image conversion details: src /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7, size 1024.00 MB, duration 6.37 sec, destination /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f5cff5d0-cfec-48b2-aebd-ccdb5aa8a8ba {{(pid=86964) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 04:24:29 devstack cinder-volume[86964]: INFO cinder.image.image_utils [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Converted 1024.00 MB image at 160.87 MB/s Jul 11 04:24:29 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f5cff5d0-cfec-48b2-aebd-ccdb5aa8a8ba is being set with open permissions: ugo+rw: NotImplementedError Jul 11 04:24:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f5cff5d0-cfec-48b2-aebd-ccdb5aa8a8ba {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:29 devstack sudo[87952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f5cff5d0-cfec-48b2-aebd-ccdb5aa8a8ba Jul 11 04:24:29 devstack sudo[87952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:30 devstack sudo[87952]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f5cff5d0-cfec-48b2-aebd-ccdb5aa8a8ba" returned: 0 in 0.882s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:30 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Lock "cinder-quobyte-f5cff5d0-cfec-48b2-aebd-ccdb5aa8a8ba" released by "_copy_volume_from_snapshot" :: held 11.258s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:24:30 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Acquiring lock "cinder-quobyte-dbb78282-89c1-488e-b313-f8ad6572f4dd" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:24:30 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Lock "cinder-quobyte-dbb78282-89c1-488e-b313-f8ad6572f4dd" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:24:30 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Deleting offline snapshot dbb78282-89c1-488e-b313-f8ad6572f4dd of volume c766a756-38a4-40a0-9f2d-90d0ec2354d7 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:24:30 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] snapshot_file for this snap is: volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7.dbb78282-89c1-488e-b313-f8ad6572f4dd {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:24:30 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b7cdc4-515f-41aa-8319-80dd3718723c]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:24:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7.dbb78282-89c1-488e-b313-f8ad6572f4dd {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:31 devstack sudo[87955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7.dbb78282-89c1-488e-b313-f8ad6572f4dd Jul 11 04:24:31 devstack sudo[87955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:31 devstack sudo[87955]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7.dbb78282-89c1-488e-b313-f8ad6572f4dd" returned: 0 in 1.010s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:31 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:24:31 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[665d57a1-0071-48db-a23c-6ddeebb68e01]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:24:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:32 devstack sudo[87961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7 Jul 11 04:24:32 devstack sudo[87961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:32 devstack sudo[87961]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7" returned: 0 in 0.921s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7.dbb78282-89c1-488e-b313-f8ad6572f4dd {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:32 devstack sudo[87966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7.dbb78282-89c1-488e-b313-f8ad6572f4dd Jul 11 04:24:32 devstack sudo[87966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:33 devstack sudo[87966]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7.dbb78282-89c1-488e-b313-f8ad6572f4dd" returned: 0 in 0.757s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7.dbb78282-89c1-488e-b313-f8ad6572f4dd {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:33 devstack sudo[87973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7.dbb78282-89c1-488e-b313-f8ad6572f4dd Jul 11 04:24:33 devstack sudo[87973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:34 devstack sudo[87973]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7.dbb78282-89c1-488e-b313-f8ad6572f4dd" returned: 0 in 0.706s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Lock "cinder-quobyte-dbb78282-89c1-488e-b313-f8ad6572f4dd" released by "_delete_snapshot" :: held 3.527s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:24:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 27.195s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:24:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f4cf0e9e-175d-4fac-960e-958fb73ac611 tempest-VolumesAdminNegativeTest-1298578476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.868s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:24:34 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-f4cf0e9e-175d-4fac-960e-958fb73ac611 tempest-VolumesAdminNegativeTest-1298578476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1284890611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5a19a8a-63fd-4c64-aa11-2d53f39f157e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aabe400d06b84d63ad1729775533d94c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:24:09Z,use_quota=True,user_id='f762ded4790b4cd19ad3dc6c80947c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:24:34 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-f4cf0e9e-175d-4fac-960e-958fb73ac611 tempest-VolumesAdminNegativeTest-1298578476 None] Creating volume d5a19a8a-63fd-4c64-aa11-2d53f39f157e {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:24:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f4cf0e9e-175d-4fac-960e-958fb73ac611 tempest-VolumesAdminNegativeTest-1298578476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:24:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f4cf0e9e-175d-4fac-960e-958fb73ac611 tempest-VolumesAdminNegativeTest-1298578476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:24:34 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-f4cf0e9e-175d-4fac-960e-958fb73ac611 tempest-VolumesAdminNegativeTest-1298578476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:24:34 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-f4cf0e9e-175d-4fac-960e-958fb73ac611 tempest-VolumesAdminNegativeTest-1298578476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:24:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f4cf0e9e-175d-4fac-960e-958fb73ac611 tempest-VolumesAdminNegativeTest-1298578476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:24:34 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-f4cf0e9e-175d-4fac-960e-958fb73ac611 tempest-VolumesAdminNegativeTest-1298578476 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:24:34 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-f4cf0e9e-175d-4fac-960e-958fb73ac611 tempest-VolumesAdminNegativeTest-1298578476 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:24:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f4cf0e9e-175d-4fac-960e-958fb73ac611 tempest-VolumesAdminNegativeTest-1298578476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d5a19a8a-63fd-4c64-aa11-2d53f39f157e 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:34 devstack sudo[87980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d5a19a8a-63fd-4c64-aa11-2d53f39f157e 1073741824 Jul 11 04:24:34 devstack sudo[87980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:34 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-1916bd97-afd3-4f26-8faf-edb8fa1427c9 tempest-GroupsV314Test-925762657 None] Create group from source-group-dc672427-6ee1-4539-bb6c-3b096dcba052 completed successfully. Jul 11 04:24:35 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-90783819-cfb3-475d-8bee-e155c2ddb306 tempest-AttachVolumeTestJSON-642925562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:24:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-90783819-cfb3-475d-8bee-e155c2ddb306 tempest-AttachVolumeTestJSON-642925562 None] Flow 'volume_create_manager' (b079e184-1b89-4b25-a62a-6d41f32ce54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:24:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-90783819-cfb3-475d-8bee-e155c2ddb306 tempest-AttachVolumeTestJSON-642925562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b36568f2-a644-4ce5-8639-55a4a16fdf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:24:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-90783819-cfb3-475d-8bee-e155c2ddb306 tempest-AttachVolumeTestJSON-642925562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b36568f2-a644-4ce5-8639-55a4a16fdf7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2138140734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06344831-93ed-4bd3-b4ac-fc84ffd54667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='787c2506ea44497f90b3e3422d10ee91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:24:35Z,use_quota=True,user_id='3d062da2352a402b8232c21e8f122552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:24:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-90783819-cfb3-475d-8bee-e155c2ddb306 tempest-AttachVolumeTestJSON-642925562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07b15c71-f3e3-4fc8-8f29-7215e2e520d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:24:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-90783819-cfb3-475d-8bee-e155c2ddb306 tempest-AttachVolumeTestJSON-642925562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07b15c71-f3e3-4fc8-8f29-7215e2e520d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:24:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-90783819-cfb3-475d-8bee-e155c2ddb306 tempest-AttachVolumeTestJSON-642925562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abe84543-f23e-4b4a-9531-a734d807ae64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:24:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-90783819-cfb3-475d-8bee-e155c2ddb306 tempest-AttachVolumeTestJSON-642925562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abe84543-f23e-4b4a-9531-a734d807ae64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06344831-93ed-4bd3-b4ac-fc84ffd54667', 'volume_name': 'volume-06344831-93ed-4bd3-b4ac-fc84ffd54667', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:24:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-90783819-cfb3-475d-8bee-e155c2ddb306 tempest-AttachVolumeTestJSON-642925562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b014549-7e27-414c-8d45-1088c86a10f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:24:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-90783819-cfb3-475d-8bee-e155c2ddb306 tempest-AttachVolumeTestJSON-642925562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b014549-7e27-414c-8d45-1088c86a10f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:24:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-90783819-cfb3-475d-8bee-e155c2ddb306 tempest-AttachVolumeTestJSON-642925562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe3dad17-8086-461a-8d60-697edddf569e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:24:35 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-90783819-cfb3-475d-8bee-e155c2ddb306 tempest-AttachVolumeTestJSON-642925562 None] Volume 06344831-93ed-4bd3-b4ac-fc84ffd54667: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06344831-93ed-4bd3-b4ac-fc84ffd54667', 'volume_size': 1} Jul 11 04:24:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-90783819-cfb3-475d-8bee-e155c2ddb306 tempest-AttachVolumeTestJSON-642925562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:24:35 devstack sudo[87980]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f4cf0e9e-175d-4fac-960e-958fb73ac611 tempest-VolumesAdminNegativeTest-1298578476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d5a19a8a-63fd-4c64-aa11-2d53f39f157e 1073741824" returned: 0 in 1.139s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f4cf0e9e-175d-4fac-960e-958fb73ac611 tempest-VolumesAdminNegativeTest-1298578476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d5a19a8a-63fd-4c64-aa11-2d53f39f157e {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:35 devstack sudo[87988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d5a19a8a-63fd-4c64-aa11-2d53f39f157e Jul 11 04:24:35 devstack sudo[87988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:36 devstack sudo[87988]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f4cf0e9e-175d-4fac-960e-958fb73ac611 tempest-VolumesAdminNegativeTest-1298578476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d5a19a8a-63fd-4c64-aa11-2d53f39f157e" returned: 0 in 0.971s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-f4cf0e9e-175d-4fac-960e-958fb73ac611 tempest-VolumesAdminNegativeTest-1298578476 None] <== create_volume: return (2153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:24:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f4cf0e9e-175d-4fac-960e-958fb73ac611 tempest-VolumesAdminNegativeTest-1298578476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.157s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:24:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-90783819-cfb3-475d-8bee-e155c2ddb306 tempest-AttachVolumeTestJSON-642925562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.132s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:24:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-90783819-cfb3-475d-8bee-e155c2ddb306 tempest-AttachVolumeTestJSON-642925562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2138140734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06344831-93ed-4bd3-b4ac-fc84ffd54667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='787c2506ea44497f90b3e3422d10ee91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:24:35Z,use_quota=True,user_id='3d062da2352a402b8232c21e8f122552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:24:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-90783819-cfb3-475d-8bee-e155c2ddb306 tempest-AttachVolumeTestJSON-642925562 None] Creating volume 06344831-93ed-4bd3-b4ac-fc84ffd54667 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:24:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-90783819-cfb3-475d-8bee-e155c2ddb306 tempest-AttachVolumeTestJSON-642925562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:24:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-90783819-cfb3-475d-8bee-e155c2ddb306 tempest-AttachVolumeTestJSON-642925562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:24:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-90783819-cfb3-475d-8bee-e155c2ddb306 tempest-AttachVolumeTestJSON-642925562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:24:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-90783819-cfb3-475d-8bee-e155c2ddb306 tempest-AttachVolumeTestJSON-642925562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:24:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-90783819-cfb3-475d-8bee-e155c2ddb306 tempest-AttachVolumeTestJSON-642925562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:24:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-90783819-cfb3-475d-8bee-e155c2ddb306 tempest-AttachVolumeTestJSON-642925562 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:24:36 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-90783819-cfb3-475d-8bee-e155c2ddb306 tempest-AttachVolumeTestJSON-642925562 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:24:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-90783819-cfb3-475d-8bee-e155c2ddb306 tempest-AttachVolumeTestJSON-642925562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-06344831-93ed-4bd3-b4ac-fc84ffd54667 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:36 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a2fb725e-886a-462e-b843-9cc089872153 tempest-GroupsV314Test-925762657 None] Acquiring lock "cinder-quobyte-f5cff5d0-cfec-48b2-aebd-ccdb5aa8a8ba" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:24:36 devstack sudo[87993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-06344831-93ed-4bd3-b4ac-fc84ffd54667 1073741824 Jul 11 04:24:36 devstack sudo[87993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:36 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a2fb725e-886a-462e-b843-9cc089872153 tempest-GroupsV314Test-925762657 None] Lock "cinder-quobyte-f5cff5d0-cfec-48b2-aebd-ccdb5aa8a8ba" acquired by "delete_volume" :: waited 0.044s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:24:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f4cf0e9e-175d-4fac-960e-958fb73ac611 tempest-VolumesAdminNegativeTest-1298578476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e96bce6e-a592-4c22-909a-11572b6e5825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5a19a8a-63fd-4c64-aa11-2d53f39f157e', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:24:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f4cf0e9e-175d-4fac-960e-958fb73ac611 tempest-VolumesAdminNegativeTest-1298578476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (575a40be-c95a-4827-8e71-137e9d16a112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:24:36 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[589182d9-879a-4a26-93bd-4da8d07dc7a5]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:24:36 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-f4cf0e9e-175d-4fac-960e-958fb73ac611 tempest-VolumesAdminNegativeTest-1298578476 None] Volume volume-d5a19a8a-63fd-4c64-aa11-2d53f39f157e (d5a19a8a-63fd-4c64-aa11-2d53f39f157e): created successfully Jul 11 04:24:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f4cf0e9e-175d-4fac-960e-958fb73ac611 tempest-VolumesAdminNegativeTest-1298578476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (575a40be-c95a-4827-8e71-137e9d16a112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:24:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f4cf0e9e-175d-4fac-960e-958fb73ac611 tempest-VolumesAdminNegativeTest-1298578476 None] Flow 'volume_create_manager' (a8f7d973-e164-4994-868d-455594cecfce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:24:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a2fb725e-886a-462e-b843-9cc089872153 tempest-GroupsV314Test-925762657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f5cff5d0-cfec-48b2-aebd-ccdb5aa8a8ba {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:36 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-f4cf0e9e-175d-4fac-960e-958fb73ac611 tempest-VolumesAdminNegativeTest-1298578476 None] Created volume successfully. Jul 11 04:24:36 devstack sudo[87996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f5cff5d0-cfec-48b2-aebd-ccdb5aa8a8ba Jul 11 04:24:36 devstack sudo[87996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:37 devstack sudo[87996]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a2fb725e-886a-462e-b843-9cc089872153 tempest-GroupsV314Test-925762657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f5cff5d0-cfec-48b2-aebd-ccdb5aa8a8ba" returned: 0 in 1.045s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a2fb725e-886a-462e-b843-9cc089872153 tempest-GroupsV314Test-925762657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f5cff5d0-cfec-48b2-aebd-ccdb5aa8a8ba {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:37 devstack sudo[88005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f5cff5d0-cfec-48b2-aebd-ccdb5aa8a8ba Jul 11 04:24:37 devstack sudo[88005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:37 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ab7e7459-89c1-4ca9-aea1-419b4bb6a0b9 tempest-VolumesAdminNegativeTest-1298578476 None] Acquiring lock "cinder-d5a19a8a-63fd-4c64-aa11-2d53f39f157e-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:24:37 devstack sudo[87993]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-90783819-cfb3-475d-8bee-e155c2ddb306 tempest-AttachVolumeTestJSON-642925562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-06344831-93ed-4bd3-b4ac-fc84ffd54667 1073741824" returned: 0 in 1.387s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:38 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ab7e7459-89c1-4ca9-aea1-419b4bb6a0b9 tempest-VolumesAdminNegativeTest-1298578476 None] Lock "cinder-d5a19a8a-63fd-4c64-aa11-2d53f39f157e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:24:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-90783819-cfb3-475d-8bee-e155c2ddb306 tempest-AttachVolumeTestJSON-642925562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-06344831-93ed-4bd3-b4ac-fc84ffd54667 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:38 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ab7e7459-89c1-4ca9-aea1-419b4bb6a0b9 tempest-VolumesAdminNegativeTest-1298578476 None] Acquiring lock "cinder-quobyte-d5a19a8a-63fd-4c64-aa11-2d53f39f157e" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:24:38 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ab7e7459-89c1-4ca9-aea1-419b4bb6a0b9 tempest-VolumesAdminNegativeTest-1298578476 None] Lock "cinder-quobyte-d5a19a8a-63fd-4c64-aa11-2d53f39f157e" acquired by "delete_volume" :: waited 0.019s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:24:38 devstack sudo[88007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-06344831-93ed-4bd3-b4ac-fc84ffd54667 Jul 11 04:24:38 devstack sudo[88007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:38 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fedc98b-9f17-4911-bcb3-7ee1d43d75cc]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:24:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ab7e7459-89c1-4ca9-aea1-419b4bb6a0b9 tempest-VolumesAdminNegativeTest-1298578476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d5a19a8a-63fd-4c64-aa11-2d53f39f157e {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:38 devstack sudo[88009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d5a19a8a-63fd-4c64-aa11-2d53f39f157e Jul 11 04:24:38 devstack sudo[88009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:38 devstack sudo[88005]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a2fb725e-886a-462e-b843-9cc089872153 tempest-GroupsV314Test-925762657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f5cff5d0-cfec-48b2-aebd-ccdb5aa8a8ba" returned: 0 in 0.958s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:38 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a2fb725e-886a-462e-b843-9cc089872153 tempest-GroupsV314Test-925762657 None] Lock "cinder-quobyte-f5cff5d0-cfec-48b2-aebd-ccdb5aa8a8ba" released by "delete_volume" :: held 2.129s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:24:38 devstack sudo[88007]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-90783819-cfb3-475d-8bee-e155c2ddb306 tempest-AttachVolumeTestJSON-642925562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-06344831-93ed-4bd3-b4ac-fc84ffd54667" returned: 0 in 0.829s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:38 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-90783819-cfb3-475d-8bee-e155c2ddb306 tempest-AttachVolumeTestJSON-642925562 None] <== create_volume: return (2317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:24:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-90783819-cfb3-475d-8bee-e155c2ddb306 tempest-AttachVolumeTestJSON-642925562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.322s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:24:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-90783819-cfb3-475d-8bee-e155c2ddb306 tempest-AttachVolumeTestJSON-642925562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe3dad17-8086-461a-8d60-697edddf569e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06344831-93ed-4bd3-b4ac-fc84ffd54667', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:24:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-90783819-cfb3-475d-8bee-e155c2ddb306 tempest-AttachVolumeTestJSON-642925562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07d0d620-220c-4f83-b479-bc3e5185b36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:24:38 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-90783819-cfb3-475d-8bee-e155c2ddb306 tempest-AttachVolumeTestJSON-642925562 None] Volume volume-06344831-93ed-4bd3-b4ac-fc84ffd54667 (06344831-93ed-4bd3-b4ac-fc84ffd54667): created successfully Jul 11 04:24:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-90783819-cfb3-475d-8bee-e155c2ddb306 tempest-AttachVolumeTestJSON-642925562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07d0d620-220c-4f83-b479-bc3e5185b36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:24:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-90783819-cfb3-475d-8bee-e155c2ddb306 tempest-AttachVolumeTestJSON-642925562 None] Flow 'volume_create_manager' (b079e184-1b89-4b25-a62a-6d41f32ce54f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:24:39 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-90783819-cfb3-475d-8bee-e155c2ddb306 tempest-AttachVolumeTestJSON-642925562 None] Created volume successfully. Jul 11 04:24:39 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-a2fb725e-886a-462e-b843-9cc089872153 tempest-GroupsV314Test-925762657 None] Created reservations ['2190eb3f-bca1-4083-845d-10bcbfcd5ef3'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:24:39 devstack cinder-volume[86964]: WARNING cinder.quota [None req-a2fb725e-886a-462e-b843-9cc089872153 tempest-GroupsV314Test-925762657 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-871443297 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-871443297, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:24:39 devstack cinder-volume[86964]: WARNING cinder.quota [None req-a2fb725e-886a-462e-b843-9cc089872153 tempest-GroupsV314Test-925762657 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-871443297 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-871443297, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:24:39 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-a2fb725e-886a-462e-b843-9cc089872153 tempest-GroupsV314Test-925762657 None] Created reservations ['e8af073b-ccfa-415f-a46e-83e0727beae0', '3ec7f389-bbdc-4f3c-a5b3-f0a2bd0e542a', 'd8dc5749-9b1d-469a-9bcf-eec00d2a1bb3', '74bad08f-8e73-460c-99c2-52570b6f678b'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:24:39 devstack sudo[88009]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ab7e7459-89c1-4ca9-aea1-419b4bb6a0b9 tempest-VolumesAdminNegativeTest-1298578476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d5a19a8a-63fd-4c64-aa11-2d53f39f157e" returned: 0 in 1.106s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ab7e7459-89c1-4ca9-aea1-419b4bb6a0b9 tempest-VolumesAdminNegativeTest-1298578476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d5a19a8a-63fd-4c64-aa11-2d53f39f157e {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:39 devstack sudo[88016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d5a19a8a-63fd-4c64-aa11-2d53f39f157e Jul 11 04:24:39 devstack sudo[88016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a2fb725e-886a-462e-b843-9cc089872153 tempest-GroupsV314Test-925762657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:24:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a2fb725e-886a-462e-b843-9cc089872153 tempest-GroupsV314Test-925762657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:24:39 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-a2fb725e-886a-462e-b843-9cc089872153 tempest-GroupsV314Test-925762657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:24:39 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-a2fb725e-886a-462e-b843-9cc089872153 tempest-GroupsV314Test-925762657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:24:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a2fb725e-886a-462e-b843-9cc089872153 tempest-GroupsV314Test-925762657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:24:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a2fb725e-886a-462e-b843-9cc089872153 tempest-GroupsV314Test-925762657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:39 devstack sudo[88018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:24:39 devstack sudo[88018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:40 devstack sudo[88016]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ab7e7459-89c1-4ca9-aea1-419b4bb6a0b9 tempest-VolumesAdminNegativeTest-1298578476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d5a19a8a-63fd-4c64-aa11-2d53f39f157e" returned: 0 in 0.774s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:40 devstack sudo[88018]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a2fb725e-886a-462e-b843-9cc089872153 tempest-GroupsV314Test-925762657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.731s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:40 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-a2fb725e-886a-462e-b843-9cc089872153 tempest-GroupsV314Test-925762657 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:24:40 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ab7e7459-89c1-4ca9-aea1-419b4bb6a0b9 tempest-VolumesAdminNegativeTest-1298578476 None] Lock "cinder-quobyte-d5a19a8a-63fd-4c64-aa11-2d53f39f157e" released by "delete_volume" :: held 1.943s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:24:40 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-a2fb725e-886a-462e-b843-9cc089872153 tempest-GroupsV314Test-925762657 None] Delete group completed successfully. Jul 11 04:24:40 devstack cinder-volume[86964]: WARNING cinder.quota [None req-ab7e7459-89c1-4ca9-aea1-419b4bb6a0b9 tempest-VolumesAdminNegativeTest-1298578476 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:24:40 devstack cinder-volume[86964]: WARNING cinder.quota [None req-ab7e7459-89c1-4ca9-aea1-419b4bb6a0b9 tempest-VolumesAdminNegativeTest-1298578476 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:24:40 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-ab7e7459-89c1-4ca9-aea1-419b4bb6a0b9 tempest-VolumesAdminNegativeTest-1298578476 None] Created reservations ['161f4cc4-dfa0-45d1-9ec5-f9c163105fce', 'e239ed94-71c9-4441-95b9-ec4bb84bc990', '7ed60048-3cc4-41a2-aea3-28d5a6f684ee', 'a5674ac7-03c1-4a3b-a2c0-c8fc6785c066'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:24:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ab7e7459-89c1-4ca9-aea1-419b4bb6a0b9 tempest-VolumesAdminNegativeTest-1298578476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:24:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ab7e7459-89c1-4ca9-aea1-419b4bb6a0b9 tempest-VolumesAdminNegativeTest-1298578476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:24:40 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ab7e7459-89c1-4ca9-aea1-419b4bb6a0b9 tempest-VolumesAdminNegativeTest-1298578476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:24:40 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ab7e7459-89c1-4ca9-aea1-419b4bb6a0b9 tempest-VolumesAdminNegativeTest-1298578476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:24:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ab7e7459-89c1-4ca9-aea1-419b4bb6a0b9 tempest-VolumesAdminNegativeTest-1298578476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:24:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ab7e7459-89c1-4ca9-aea1-419b4bb6a0b9 tempest-VolumesAdminNegativeTest-1298578476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:40 devstack sudo[88028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:24:40 devstack sudo[88028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:40 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1b2f3b5d-ea5c-41f9-a2bf-782bc16d806b tempest-GroupsV314Test-925762657 None] Acquiring lock "cinder-quobyte-c766a756-38a4-40a0-9f2d-90d0ec2354d7" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:24:40 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1b2f3b5d-ea5c-41f9-a2bf-782bc16d806b tempest-GroupsV314Test-925762657 None] Lock "cinder-quobyte-c766a756-38a4-40a0-9f2d-90d0ec2354d7" acquired by "delete_volume" :: waited 0.026s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:24:40 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[40026a2d-a041-489d-9625-9a14569af31d]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:24:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1b2f3b5d-ea5c-41f9-a2bf-782bc16d806b tempest-GroupsV314Test-925762657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:40 devstack sudo[88031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7 Jul 11 04:24:40 devstack sudo[88031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:41 devstack sudo[88028]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ab7e7459-89c1-4ca9-aea1-419b4bb6a0b9 tempest-VolumesAdminNegativeTest-1298578476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.862s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:41 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-ab7e7459-89c1-4ca9-aea1-419b4bb6a0b9 tempest-VolumesAdminNegativeTest-1298578476 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:24:41 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-ab7e7459-89c1-4ca9-aea1-419b4bb6a0b9 tempest-VolumesAdminNegativeTest-1298578476 None] Deleted volume successfully. Jul 11 04:24:41 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ab7e7459-89c1-4ca9-aea1-419b4bb6a0b9 tempest-VolumesAdminNegativeTest-1298578476 None] Lock "cinder-d5a19a8a-63fd-4c64-aa11-2d53f39f157e-delete_volume" released by "delete_volume" :: held 3.046s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:24:41 devstack sudo[88031]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1b2f3b5d-ea5c-41f9-a2bf-782bc16d806b tempest-GroupsV314Test-925762657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7" returned: 0 in 0.783s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1b2f3b5d-ea5c-41f9-a2bf-782bc16d806b tempest-GroupsV314Test-925762657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:41 devstack sudo[88037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7 Jul 11 04:24:41 devstack sudo[88037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:42 devstack sudo[88037]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1b2f3b5d-ea5c-41f9-a2bf-782bc16d806b tempest-GroupsV314Test-925762657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c766a756-38a4-40a0-9f2d-90d0ec2354d7" returned: 0 in 0.743s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:42 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1b2f3b5d-ea5c-41f9-a2bf-782bc16d806b tempest-GroupsV314Test-925762657 None] Lock "cinder-quobyte-c766a756-38a4-40a0-9f2d-90d0ec2354d7" released by "delete_volume" :: held 1.657s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:24:42 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-1b2f3b5d-ea5c-41f9-a2bf-782bc16d806b tempest-GroupsV314Test-925762657 None] Created reservations ['4903325e-56ff-42e9-98f7-2ea103dff9de'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:24:42 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-1b2f3b5d-ea5c-41f9-a2bf-782bc16d806b tempest-GroupsV314Test-925762657 None] Created reservations ['25096911-cc8e-4154-b3ed-c9a61d810130', 'fc1e4423-9f4c-4873-aacb-f073858cfe0e', '600aee03-5ad1-47cb-83b6-c0de14c50bc6', 'c64125da-fb6e-4803-ae62-0c7a96e279a1'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:24:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1b2f3b5d-ea5c-41f9-a2bf-782bc16d806b tempest-GroupsV314Test-925762657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:24:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1b2f3b5d-ea5c-41f9-a2bf-782bc16d806b tempest-GroupsV314Test-925762657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:24:42 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-1b2f3b5d-ea5c-41f9-a2bf-782bc16d806b tempest-GroupsV314Test-925762657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:24:42 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-1b2f3b5d-ea5c-41f9-a2bf-782bc16d806b tempest-GroupsV314Test-925762657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:24:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1b2f3b5d-ea5c-41f9-a2bf-782bc16d806b tempest-GroupsV314Test-925762657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:24:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1b2f3b5d-ea5c-41f9-a2bf-782bc16d806b tempest-GroupsV314Test-925762657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:42 devstack sudo[88061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:24:42 devstack sudo[88061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:43 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-00c0f055-565d-4a54-9abc-cc1f789e3218 tempest-TaggedAttachmentsTest-480922109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:24:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-00c0f055-565d-4a54-9abc-cc1f789e3218 tempest-TaggedAttachmentsTest-480922109 None] Flow 'volume_create_manager' (1bfc2e2e-5f20-4ccf-a29f-f641995f8666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:24:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-00c0f055-565d-4a54-9abc-cc1f789e3218 tempest-TaggedAttachmentsTest-480922109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (381ce5e7-06fb-4c53-b107-05f754e4b5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:24:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-00c0f055-565d-4a54-9abc-cc1f789e3218 tempest-TaggedAttachmentsTest-480922109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (381ce5e7-06fb-4c53-b107-05f754e4b5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1958078705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=555a39df-7b1b-486b-8638-5b5d1c3e485a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9655f6e706a64a47933e8912475f7ecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:24:44Z,use_quota=True,user_id='502b9cce5ef847389b55641e5af0f4c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:24:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-00c0f055-565d-4a54-9abc-cc1f789e3218 tempest-TaggedAttachmentsTest-480922109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c1fc94-330e-4f37-8139-f8d7c650f590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:24:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-00c0f055-565d-4a54-9abc-cc1f789e3218 tempest-TaggedAttachmentsTest-480922109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c1fc94-330e-4f37-8139-f8d7c650f590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:24:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-00c0f055-565d-4a54-9abc-cc1f789e3218 tempest-TaggedAttachmentsTest-480922109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42ba55da-f64b-43b1-9b63-4a08d266b4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:24:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-00c0f055-565d-4a54-9abc-cc1f789e3218 tempest-TaggedAttachmentsTest-480922109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42ba55da-f64b-43b1-9b63-4a08d266b4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '555a39df-7b1b-486b-8638-5b5d1c3e485a', 'volume_name': 'volume-555a39df-7b1b-486b-8638-5b5d1c3e485a', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:24:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-00c0f055-565d-4a54-9abc-cc1f789e3218 tempest-TaggedAttachmentsTest-480922109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6462492-73d4-4a90-a42c-c3cef49c8ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:24:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-00c0f055-565d-4a54-9abc-cc1f789e3218 tempest-TaggedAttachmentsTest-480922109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6462492-73d4-4a90-a42c-c3cef49c8ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:24:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-00c0f055-565d-4a54-9abc-cc1f789e3218 tempest-TaggedAttachmentsTest-480922109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a71f5570-01fa-45f4-8114-2b3f710be28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:24:43 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-00c0f055-565d-4a54-9abc-cc1f789e3218 tempest-TaggedAttachmentsTest-480922109 None] Volume 555a39df-7b1b-486b-8638-5b5d1c3e485a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-555a39df-7b1b-486b-8638-5b5d1c3e485a', 'volume_size': 1} Jul 11 04:24:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-00c0f055-565d-4a54-9abc-cc1f789e3218 tempest-TaggedAttachmentsTest-480922109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:24:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-00c0f055-565d-4a54-9abc-cc1f789e3218 tempest-TaggedAttachmentsTest-480922109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:24:43 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-00c0f055-565d-4a54-9abc-cc1f789e3218 tempest-TaggedAttachmentsTest-480922109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1958078705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=555a39df-7b1b-486b-8638-5b5d1c3e485a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9655f6e706a64a47933e8912475f7ecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:24:44Z,use_quota=True,user_id='502b9cce5ef847389b55641e5af0f4c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:24:43 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-00c0f055-565d-4a54-9abc-cc1f789e3218 tempest-TaggedAttachmentsTest-480922109 None] Creating volume 555a39df-7b1b-486b-8638-5b5d1c3e485a {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:24:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-00c0f055-565d-4a54-9abc-cc1f789e3218 tempest-TaggedAttachmentsTest-480922109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:24:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-00c0f055-565d-4a54-9abc-cc1f789e3218 tempest-TaggedAttachmentsTest-480922109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:24:43 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-00c0f055-565d-4a54-9abc-cc1f789e3218 tempest-TaggedAttachmentsTest-480922109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:24:43 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-00c0f055-565d-4a54-9abc-cc1f789e3218 tempest-TaggedAttachmentsTest-480922109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:24:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-00c0f055-565d-4a54-9abc-cc1f789e3218 tempest-TaggedAttachmentsTest-480922109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:24:43 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-00c0f055-565d-4a54-9abc-cc1f789e3218 tempest-TaggedAttachmentsTest-480922109 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:24:43 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-00c0f055-565d-4a54-9abc-cc1f789e3218 tempest-TaggedAttachmentsTest-480922109 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:24:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-00c0f055-565d-4a54-9abc-cc1f789e3218 tempest-TaggedAttachmentsTest-480922109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-555a39df-7b1b-486b-8638-5b5d1c3e485a 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:43 devstack sudo[88070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-555a39df-7b1b-486b-8638-5b5d1c3e485a 1073741824 Jul 11 04:24:43 devstack sudo[88070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:43 devstack sudo[88061]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1b2f3b5d-ea5c-41f9-a2bf-782bc16d806b tempest-GroupsV314Test-925762657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 1.219s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:44 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-1b2f3b5d-ea5c-41f9-a2bf-782bc16d806b tempest-GroupsV314Test-925762657 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:24:44 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-1b2f3b5d-ea5c-41f9-a2bf-782bc16d806b tempest-GroupsV314Test-925762657 None] Delete group completed successfully. Jul 11 04:24:44 devstack sudo[88070]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-00c0f055-565d-4a54-9abc-cc1f789e3218 tempest-TaggedAttachmentsTest-480922109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-555a39df-7b1b-486b-8638-5b5d1c3e485a 1073741824" returned: 0 in 1.006s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-00c0f055-565d-4a54-9abc-cc1f789e3218 tempest-TaggedAttachmentsTest-480922109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-555a39df-7b1b-486b-8638-5b5d1c3e485a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:44 devstack sudo[88081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-555a39df-7b1b-486b-8638-5b5d1c3e485a Jul 11 04:24:44 devstack sudo[88081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-00c0f055-565d-4a54-9abc-cc1f789e3218 tempest-TaggedAttachmentsTest-480922109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-555a39df-7b1b-486b-8638-5b5d1c3e485a" returned: 0 in 0.839s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-00c0f055-565d-4a54-9abc-cc1f789e3218 tempest-TaggedAttachmentsTest-480922109 None] <== create_volume: return (1916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:24:45 devstack sudo[88081]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-00c0f055-565d-4a54-9abc-cc1f789e3218 tempest-TaggedAttachmentsTest-480922109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.918s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:24:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-00c0f055-565d-4a54-9abc-cc1f789e3218 tempest-TaggedAttachmentsTest-480922109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a71f5570-01fa-45f4-8114-2b3f710be28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-555a39df-7b1b-486b-8638-5b5d1c3e485a', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:24:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-00c0f055-565d-4a54-9abc-cc1f789e3218 tempest-TaggedAttachmentsTest-480922109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22cc6015-f6a3-41d8-8b59-925060a243e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:24:45 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-00c0f055-565d-4a54-9abc-cc1f789e3218 tempest-TaggedAttachmentsTest-480922109 None] Volume volume-555a39df-7b1b-486b-8638-5b5d1c3e485a (555a39df-7b1b-486b-8638-5b5d1c3e485a): created successfully Jul 11 04:24:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-00c0f055-565d-4a54-9abc-cc1f789e3218 tempest-TaggedAttachmentsTest-480922109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22cc6015-f6a3-41d8-8b59-925060a243e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:24:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-00c0f055-565d-4a54-9abc-cc1f789e3218 tempest-TaggedAttachmentsTest-480922109 None] Flow 'volume_create_manager' (1bfc2e2e-5f20-4ccf-a29f-f641995f8666) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:24:45 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-00c0f055-565d-4a54-9abc-cc1f789e3218 tempest-TaggedAttachmentsTest-480922109 None] Created volume successfully. Jul 11 04:24:45 devstack cinder-volume[86964]: WARNING py.warnings [req-e93e8545-49d0-4218-b851-be045dad6581 req-6a33f295-71c4-4db9-8f78-c3692a6b25d9 tempest-AttachVolumeTestJSON-642925562 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 11 04:24:45 devstack cinder-volume[86964]: .first() Jul 11 04:24:45 devstack cinder-volume[86964]: Jul 11 04:24:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-e93e8545-49d0-4218-b851-be045dad6581 req-6a33f295-71c4-4db9-8f78-c3692a6b25d9 tempest-AttachVolumeTestJSON-642925562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:24:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-e93e8545-49d0-4218-b851-be045dad6581 req-6a33f295-71c4-4db9-8f78-c3692a6b25d9 tempest-AttachVolumeTestJSON-642925562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:24:45 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3388da-cce4-4035-aebf-dfe7d6f63153]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:24:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-e93e8545-49d0-4218-b851-be045dad6581 req-6a33f295-71c4-4db9-8f78-c3692a6b25d9 tempest-AttachVolumeTestJSON-642925562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-06344831-93ed-4bd3-b4ac-fc84ffd54667 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:45 devstack sudo[88096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-06344831-93ed-4bd3-b4ac-fc84ffd54667 Jul 11 04:24:45 devstack sudo[88096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:46 devstack sudo[88096]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-e93e8545-49d0-4218-b851-be045dad6581 req-6a33f295-71c4-4db9-8f78-c3692a6b25d9 tempest-AttachVolumeTestJSON-642925562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-06344831-93ed-4bd3-b4ac-fc84ffd54667" returned: 0 in 0.808s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-e93e8545-49d0-4218-b851-be045dad6581 req-6a33f295-71c4-4db9-8f78-c3692a6b25d9 tempest-AttachVolumeTestJSON-642925562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.826s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:24:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-e93e8545-49d0-4218-b851-be045dad6581 req-6a33f295-71c4-4db9-8f78-c3692a6b25d9 tempest-AttachVolumeTestJSON-642925562 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95', 'name': 'volume-06344831-93ed-4bd3-b4ac-fc84ffd54667', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '052397f4-8af7-4c23-b2b4-79f8242523d0', 'enforce_multipath': True} {{(pid=86964) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 04:24:46 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-e93e8545-49d0-4218-b851-be045dad6581 req-6a33f295-71c4-4db9-8f78-c3692a6b25d9 tempest-AttachVolumeTestJSON-642925562 None] attachment_update completed successfully. Jul 11 04:24:49 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-797ae7bf-96ca-4fdb-9bd3-62f3296559d6 tempest-GroupsV320Test-1268786573 None] Group tempest-GroupsV320Test-Group-401253981: creating Jul 11 04:24:49 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-797ae7bf-96ca-4fdb-9bd3-62f3296559d6 tempest-GroupsV320Test-1268786573 None] Group tempest-GroupsV320Test-Group-401253981: created successfully Jul 11 04:24:49 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-797ae7bf-96ca-4fdb-9bd3-62f3296559d6 tempest-GroupsV320Test-1268786573 None] Create group completed successfully. Jul 11 04:24:50 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-76ae231e-aa41-4c84-9318-66fe1c2b721f tempest-GroupsV320Test-1268786573 None] Created reservations ['5c582c44-7db2-47f7-af7e-5e2c32c74124'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:24:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-76ae231e-aa41-4c84-9318-66fe1c2b721f tempest-GroupsV320Test-1268786573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:24:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-76ae231e-aa41-4c84-9318-66fe1c2b721f tempest-GroupsV320Test-1268786573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:24:50 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-76ae231e-aa41-4c84-9318-66fe1c2b721f tempest-GroupsV320Test-1268786573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:24:50 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-76ae231e-aa41-4c84-9318-66fe1c2b721f tempest-GroupsV320Test-1268786573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:24:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-76ae231e-aa41-4c84-9318-66fe1c2b721f tempest-GroupsV320Test-1268786573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:24:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-76ae231e-aa41-4c84-9318-66fe1c2b721f tempest-GroupsV320Test-1268786573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:50 devstack sudo[88494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:24:50 devstack sudo[88494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:51 devstack sudo[88494]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-76ae231e-aa41-4c84-9318-66fe1c2b721f tempest-GroupsV320Test-1268786573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.726s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:51 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-76ae231e-aa41-4c84-9318-66fe1c2b721f tempest-GroupsV320Test-1268786573 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:24:51 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-76ae231e-aa41-4c84-9318-66fe1c2b721f tempest-GroupsV320Test-1268786573 None] Delete group completed successfully. Jul 11 04:24:59 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:24:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:24:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:24:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:24:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:24:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:24:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:59 devstack sudo[88576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:24:59 devstack sudo[88576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:59 devstack sudo[88576]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.795s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:59 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:25:10 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:UPDATE=46,cinder:SELECT=42,cinder:INSERT=9,cinder:DELETE=3 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:25:10 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:UPDATE=47,cinder:SELECT=39,cinder:DELETE=1,cinder:INSERT=9 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:25:25 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-31f183a3-7bc7-45e6-a8f9-9535e923fdf8 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:25:26 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31f183a3-7bc7-45e6-a8f9-9535e923fdf8 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Flow 'volume_create_manager' (2a3d079a-bb77-4243-af1f-be6276fefeac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:25:26 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31f183a3-7bc7-45e6-a8f9-9535e923fdf8 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7976be3d-48db-4fb4-909d-11bc4297e1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:25:26 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31f183a3-7bc7-45e6-a8f9-9535e923fdf8 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7976be3d-48db-4fb4-909d-11bc4297e1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1649655441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da03e300-0168-4cc3-aa4f-b65c3a8a1cde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d9bd4f15a1f4e7783f5ca3bf97f71d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:25:26Z,use_quota=True,user_id='cd80bf4876834591a4d5003c7cfe9b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35b60902-441f-4e5d-89be-8f0dc044f558),volume_type_id=35b60902-441f-4e5d-89be-8f0dc044f558)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:25:26 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31f183a3-7bc7-45e6-a8f9-9535e923fdf8 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e864eb-17f6-4386-a0d6-bcaa008b7e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:25:26 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31f183a3-7bc7-45e6-a8f9-9535e923fdf8 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e864eb-17f6-4386-a0d6-bcaa008b7e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:25:26 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31f183a3-7bc7-45e6-a8f9-9535e923fdf8 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2953069-3c1e-4111-8c97-75685a166b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:25:26 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31f183a3-7bc7-45e6-a8f9-9535e923fdf8 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2953069-3c1e-4111-8c97-75685a166b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da03e300-0168-4cc3-aa4f-b65c3a8a1cde', 'volume_name': 'volume-da03e300-0168-4cc3-aa4f-b65c3a8a1cde', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:25:26 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31f183a3-7bc7-45e6-a8f9-9535e923fdf8 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76683051-be41-459c-b53c-dfb9a842e3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:25:26 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31f183a3-7bc7-45e6-a8f9-9535e923fdf8 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76683051-be41-459c-b53c-dfb9a842e3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:25:26 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31f183a3-7bc7-45e6-a8f9-9535e923fdf8 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d487a3a-9aeb-4449-bbbf-85f0f9df80fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:25:26 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-31f183a3-7bc7-45e6-a8f9-9535e923fdf8 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Volume da03e300-0168-4cc3-aa4f-b65c3a8a1cde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da03e300-0168-4cc3-aa4f-b65c3a8a1cde', 'volume_size': 1} Jul 11 04:25:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-31f183a3-7bc7-45e6-a8f9-9535e923fdf8 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:25:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-31f183a3-7bc7-45e6-a8f9-9535e923fdf8 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:25:26 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-31f183a3-7bc7-45e6-a8f9-9535e923fdf8 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1649655441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da03e300-0168-4cc3-aa4f-b65c3a8a1cde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d9bd4f15a1f4e7783f5ca3bf97f71d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:25:26Z,use_quota=True,user_id='cd80bf4876834591a4d5003c7cfe9b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35b60902-441f-4e5d-89be-8f0dc044f558),volume_type_id=35b60902-441f-4e5d-89be-8f0dc044f558)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:25:26 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-31f183a3-7bc7-45e6-a8f9-9535e923fdf8 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Creating volume da03e300-0168-4cc3-aa4f-b65c3a8a1cde {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:25:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-31f183a3-7bc7-45e6-a8f9-9535e923fdf8 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:25:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-31f183a3-7bc7-45e6-a8f9-9535e923fdf8 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:25:26 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-31f183a3-7bc7-45e6-a8f9-9535e923fdf8 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:25:26 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-31f183a3-7bc7-45e6-a8f9-9535e923fdf8 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:25:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-31f183a3-7bc7-45e6-a8f9-9535e923fdf8 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:25:26 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-31f183a3-7bc7-45e6-a8f9-9535e923fdf8 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:25:26 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-31f183a3-7bc7-45e6-a8f9-9535e923fdf8 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:25:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-31f183a3-7bc7-45e6-a8f9-9535e923fdf8 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-da03e300-0168-4cc3-aa4f-b65c3a8a1cde 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:25:26 devstack sudo[89576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-da03e300-0168-4cc3-aa4f-b65c3a8a1cde 1073741824 Jul 11 04:25:26 devstack sudo[89576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:25:26 devstack sudo[89576]: pam_unix(sudo:session): session closed for user root Jul 11 04:25:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-31f183a3-7bc7-45e6-a8f9-9535e923fdf8 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-da03e300-0168-4cc3-aa4f-b65c3a8a1cde 1073741824" returned: 0 in 0.788s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:25:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-31f183a3-7bc7-45e6-a8f9-9535e923fdf8 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-da03e300-0168-4cc3-aa4f-b65c3a8a1cde {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:25:26 devstack sudo[89582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-da03e300-0168-4cc3-aa4f-b65c3a8a1cde Jul 11 04:25:26 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:25:27 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root Jul 11 04:25:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-31f183a3-7bc7-45e6-a8f9-9535e923fdf8 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-da03e300-0168-4cc3-aa4f-b65c3a8a1cde" returned: 0 in 0.607s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:25:27 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-31f183a3-7bc7-45e6-a8f9-9535e923fdf8 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:25:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-31f183a3-7bc7-45e6-a8f9-9535e923fdf8 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.438s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:25:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31f183a3-7bc7-45e6-a8f9-9535e923fdf8 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d487a3a-9aeb-4449-bbbf-85f0f9df80fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da03e300-0168-4cc3-aa4f-b65c3a8a1cde', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:25:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31f183a3-7bc7-45e6-a8f9-9535e923fdf8 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60195f59-9475-44dd-8252-7b35fc8e94ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:25:27 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-31f183a3-7bc7-45e6-a8f9-9535e923fdf8 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Volume volume-da03e300-0168-4cc3-aa4f-b65c3a8a1cde (da03e300-0168-4cc3-aa4f-b65c3a8a1cde): created successfully Jul 11 04:25:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31f183a3-7bc7-45e6-a8f9-9535e923fdf8 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60195f59-9475-44dd-8252-7b35fc8e94ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:25:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31f183a3-7bc7-45e6-a8f9-9535e923fdf8 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Flow 'volume_create_manager' (2a3d079a-bb77-4243-af1f-be6276fefeac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:25:27 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-31f183a3-7bc7-45e6-a8f9-9535e923fdf8 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Created volume successfully. Jul 11 04:25:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-448868db-0c0c-44c5-aaac-9ae6eafbef05 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:25:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-448868db-0c0c-44c5-aaac-9ae6eafbef05 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:25:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-448868db-0c0c-44c5-aaac-9ae6eafbef05 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:25:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-448868db-0c0c-44c5-aaac-9ae6eafbef05 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:25:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-448868db-0c0c-44c5-aaac-9ae6eafbef05 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:25:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-448868db-0c0c-44c5-aaac-9ae6eafbef05 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:25:28 devstack sudo[89586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:25:28 devstack sudo[89586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:25:29 devstack sudo[89586]: pam_unix(sudo:session): session closed for user root Jul 11 04:25:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-448868db-0c0c-44c5-aaac-9ae6eafbef05 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.875s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:25:29 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-448868db-0c0c-44c5-aaac-9ae6eafbef05 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:25:29 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-448868db-0c0c-44c5-aaac-9ae6eafbef05 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Retype volume completed successfully. Jul 11 04:25:29 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-842732d9-788a-48f5-b14b-115eae45e390 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Acquiring lock "cinder-da03e300-0168-4cc3-aa4f-b65c3a8a1cde-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:25:29 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-842732d9-788a-48f5-b14b-115eae45e390 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Lock "cinder-da03e300-0168-4cc3-aa4f-b65c3a8a1cde-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:25:30 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-842732d9-788a-48f5-b14b-115eae45e390 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Acquiring lock "cinder-quobyte-da03e300-0168-4cc3-aa4f-b65c3a8a1cde" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:25:30 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-842732d9-788a-48f5-b14b-115eae45e390 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Lock "cinder-quobyte-da03e300-0168-4cc3-aa4f-b65c3a8a1cde" acquired by "delete_volume" :: waited 0.022s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:25:30 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[85672637-ec94-4f2b-bf79-b75c5bcb3003]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:25:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-842732d9-788a-48f5-b14b-115eae45e390 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-da03e300-0168-4cc3-aa4f-b65c3a8a1cde {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:25:30 devstack sudo[89592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-da03e300-0168-4cc3-aa4f-b65c3a8a1cde Jul 11 04:25:30 devstack sudo[89592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:25:30 devstack sudo[89592]: pam_unix(sudo:session): session closed for user root Jul 11 04:25:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-842732d9-788a-48f5-b14b-115eae45e390 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-da03e300-0168-4cc3-aa4f-b65c3a8a1cde" returned: 0 in 0.838s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:25:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-842732d9-788a-48f5-b14b-115eae45e390 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-da03e300-0168-4cc3-aa4f-b65c3a8a1cde {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:25:30 devstack sudo[89620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-da03e300-0168-4cc3-aa4f-b65c3a8a1cde Jul 11 04:25:30 devstack sudo[89620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:25:31 devstack sudo[89620]: pam_unix(sudo:session): session closed for user root Jul 11 04:25:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-842732d9-788a-48f5-b14b-115eae45e390 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-da03e300-0168-4cc3-aa4f-b65c3a8a1cde" returned: 0 in 0.618s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:25:31 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-842732d9-788a-48f5-b14b-115eae45e390 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Lock "cinder-quobyte-da03e300-0168-4cc3-aa4f-b65c3a8a1cde" released by "delete_volume" :: held 1.506s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:25:31 devstack cinder-volume[86964]: WARNING cinder.quota [None req-842732d9-788a-48f5-b14b-115eae45e390 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:25:31 devstack cinder-volume[86964]: WARNING cinder.quota [None req-842732d9-788a-48f5-b14b-115eae45e390 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:25:31 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-842732d9-788a-48f5-b14b-115eae45e390 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Created reservations ['2bf311fc-67cc-4377-8c7d-2f884fd6d206', 'f9dc6061-6be0-4463-ad94-19272aabda23', '84e9d57c-9a23-4534-a074-cd674d47e0b2', '779af2a8-13be-4691-a709-4c1f2fd05ebb'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:25:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-842732d9-788a-48f5-b14b-115eae45e390 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:25:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-842732d9-788a-48f5-b14b-115eae45e390 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:25:31 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-842732d9-788a-48f5-b14b-115eae45e390 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:25:31 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-842732d9-788a-48f5-b14b-115eae45e390 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:25:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-842732d9-788a-48f5-b14b-115eae45e390 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:25:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-842732d9-788a-48f5-b14b-115eae45e390 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:25:31 devstack sudo[89623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:25:31 devstack sudo[89623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:25:32 devstack sudo[89623]: pam_unix(sudo:session): session closed for user root Jul 11 04:25:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-842732d9-788a-48f5-b14b-115eae45e390 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.640s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:25:32 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-842732d9-788a-48f5-b14b-115eae45e390 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:25:32 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-842732d9-788a-48f5-b14b-115eae45e390 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Deleted volume successfully. Jul 11 04:25:32 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-842732d9-788a-48f5-b14b-115eae45e390 tempest-VolumeRetypeWithoutMigrationTest-2085712008 None] Lock "cinder-da03e300-0168-4cc3-aa4f-b65c3a8a1cde-delete_volume" released by "delete_volume" :: held 2.419s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:25:35 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-55a1dc32-4b76-4376-9e7e-304a4ce97480 req-fedc9206-757f-41c4-ba32-a618e6e78a94 tempest-AttachVolumeTestJSON-642925562 None] Terminate volume connection completed successfully. Jul 11 04:25:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-55a1dc32-4b76-4376-9e7e-304a4ce97480 req-fedc9206-757f-41c4-ba32-a618e6e78a94 tempest-AttachVolumeTestJSON-642925562 None] Deleting attachment 052397f4-8af7-4c23-b2b4-79f8242523d0. {{(pid=86964) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 04:25:39 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-097e1e20-ec94-45d5-9e30-0b6f4d46dbe4 tempest-DeleteServersTestJSON-744687230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:25:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-097e1e20-ec94-45d5-9e30-0b6f4d46dbe4 tempest-DeleteServersTestJSON-744687230 None] Flow 'volume_create_manager' (bf2b35b7-0ec0-43b5-aae0-71b76e42b1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:25:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-097e1e20-ec94-45d5-9e30-0b6f4d46dbe4 tempest-DeleteServersTestJSON-744687230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b84cad05-62ed-420f-911e-d83558f5e466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:25:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-097e1e20-ec94-45d5-9e30-0b6f4d46dbe4 tempest-DeleteServersTestJSON-744687230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b84cad05-62ed-420f-911e-d83558f5e466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1491753036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e0799a8-4a65-4fcf-a37e-72ca698a46ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3523b7af17fc46c8a10bb8cb1403af5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:25:40Z,use_quota=True,user_id='f28e03d5d3b54917a722572fa4674b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:25:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-097e1e20-ec94-45d5-9e30-0b6f4d46dbe4 tempest-DeleteServersTestJSON-744687230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fae5a8a-bd85-431f-9cf0-a287225c7734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:25:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-097e1e20-ec94-45d5-9e30-0b6f4d46dbe4 tempest-DeleteServersTestJSON-744687230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fae5a8a-bd85-431f-9cf0-a287225c7734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:25:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-097e1e20-ec94-45d5-9e30-0b6f4d46dbe4 tempest-DeleteServersTestJSON-744687230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd2e2121-9f71-4054-9f03-8964d57492ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:25:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-097e1e20-ec94-45d5-9e30-0b6f4d46dbe4 tempest-DeleteServersTestJSON-744687230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd2e2121-9f71-4054-9f03-8964d57492ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e0799a8-4a65-4fcf-a37e-72ca698a46ff', 'volume_name': 'volume-6e0799a8-4a65-4fcf-a37e-72ca698a46ff', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:25:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-097e1e20-ec94-45d5-9e30-0b6f4d46dbe4 tempest-DeleteServersTestJSON-744687230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e223a7e-942d-4419-8b3f-7d148ec0edd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:25:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-097e1e20-ec94-45d5-9e30-0b6f4d46dbe4 tempest-DeleteServersTestJSON-744687230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e223a7e-942d-4419-8b3f-7d148ec0edd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:25:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-097e1e20-ec94-45d5-9e30-0b6f4d46dbe4 tempest-DeleteServersTestJSON-744687230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1085aeac-395b-4814-bff1-3e1da240ef8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:25:39 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-097e1e20-ec94-45d5-9e30-0b6f4d46dbe4 tempest-DeleteServersTestJSON-744687230 None] Volume 6e0799a8-4a65-4fcf-a37e-72ca698a46ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e0799a8-4a65-4fcf-a37e-72ca698a46ff', 'volume_size': 1} Jul 11 04:25:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-097e1e20-ec94-45d5-9e30-0b6f4d46dbe4 tempest-DeleteServersTestJSON-744687230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:25:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-097e1e20-ec94-45d5-9e30-0b6f4d46dbe4 tempest-DeleteServersTestJSON-744687230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:25:39 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-097e1e20-ec94-45d5-9e30-0b6f4d46dbe4 tempest-DeleteServersTestJSON-744687230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1491753036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e0799a8-4a65-4fcf-a37e-72ca698a46ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3523b7af17fc46c8a10bb8cb1403af5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:25:40Z,use_quota=True,user_id='f28e03d5d3b54917a722572fa4674b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:25:39 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-097e1e20-ec94-45d5-9e30-0b6f4d46dbe4 tempest-DeleteServersTestJSON-744687230 None] Creating volume 6e0799a8-4a65-4fcf-a37e-72ca698a46ff {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:25:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-097e1e20-ec94-45d5-9e30-0b6f4d46dbe4 tempest-DeleteServersTestJSON-744687230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:25:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-097e1e20-ec94-45d5-9e30-0b6f4d46dbe4 tempest-DeleteServersTestJSON-744687230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:25:39 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-097e1e20-ec94-45d5-9e30-0b6f4d46dbe4 tempest-DeleteServersTestJSON-744687230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:25:39 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-097e1e20-ec94-45d5-9e30-0b6f4d46dbe4 tempest-DeleteServersTestJSON-744687230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:25:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-097e1e20-ec94-45d5-9e30-0b6f4d46dbe4 tempest-DeleteServersTestJSON-744687230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:25:39 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-097e1e20-ec94-45d5-9e30-0b6f4d46dbe4 tempest-DeleteServersTestJSON-744687230 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:25:39 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-097e1e20-ec94-45d5-9e30-0b6f4d46dbe4 tempest-DeleteServersTestJSON-744687230 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:25:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-097e1e20-ec94-45d5-9e30-0b6f4d46dbe4 tempest-DeleteServersTestJSON-744687230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e0799a8-4a65-4fcf-a37e-72ca698a46ff 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:25:39 devstack sudo[89840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e0799a8-4a65-4fcf-a37e-72ca698a46ff 1073741824 Jul 11 04:25:39 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:25:40 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7ccf071-1611-46fe-9e51-fdc3113b5ae9 tempest-VolumesServicesTestJSON-331515889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:25:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f7ccf071-1611-46fe-9e51-fdc3113b5ae9 tempest-VolumesServicesTestJSON-331515889 None] Flow 'volume_create_manager' (c37f6e74-4c9c-48c2-82f4-7fb9e63b31d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:25:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f7ccf071-1611-46fe-9e51-fdc3113b5ae9 tempest-VolumesServicesTestJSON-331515889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56719370-4fdf-43e8-a2f4-2b3926476d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:25:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f7ccf071-1611-46fe-9e51-fdc3113b5ae9 tempest-VolumesServicesTestJSON-331515889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56719370-4fdf-43e8-a2f4-2b3926476d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-575354488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea1cc8ec-410c-48a7-b25b-da2695055cd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40447ba7f9844de8af49f9947b30d17e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:25:41Z,use_quota=True,user_id='79e24387b0ae4361a1fbb17a4c41295c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:25:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f7ccf071-1611-46fe-9e51-fdc3113b5ae9 tempest-VolumesServicesTestJSON-331515889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be0e08e3-e749-422c-aeed-53d125c12301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:25:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f7ccf071-1611-46fe-9e51-fdc3113b5ae9 tempest-VolumesServicesTestJSON-331515889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be0e08e3-e749-422c-aeed-53d125c12301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:25:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f7ccf071-1611-46fe-9e51-fdc3113b5ae9 tempest-VolumesServicesTestJSON-331515889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61fca0d5-0444-45b1-a63d-61ce498c716c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:25:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f7ccf071-1611-46fe-9e51-fdc3113b5ae9 tempest-VolumesServicesTestJSON-331515889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61fca0d5-0444-45b1-a63d-61ce498c716c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea1cc8ec-410c-48a7-b25b-da2695055cd6', 'volume_name': 'volume-ea1cc8ec-410c-48a7-b25b-da2695055cd6', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:25:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f7ccf071-1611-46fe-9e51-fdc3113b5ae9 tempest-VolumesServicesTestJSON-331515889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df2a9be9-18b0-4f59-8ac9-306307b7c06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:25:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f7ccf071-1611-46fe-9e51-fdc3113b5ae9 tempest-VolumesServicesTestJSON-331515889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df2a9be9-18b0-4f59-8ac9-306307b7c06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:25:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f7ccf071-1611-46fe-9e51-fdc3113b5ae9 tempest-VolumesServicesTestJSON-331515889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4e529c9-aef1-45f3-8d53-ca3040c3eff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:25:40 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-f7ccf071-1611-46fe-9e51-fdc3113b5ae9 tempest-VolumesServicesTestJSON-331515889 None] Volume ea1cc8ec-410c-48a7-b25b-da2695055cd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea1cc8ec-410c-48a7-b25b-da2695055cd6', 'volume_size': 1} Jul 11 04:25:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f7ccf071-1611-46fe-9e51-fdc3113b5ae9 tempest-VolumesServicesTestJSON-331515889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:25:40 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root Jul 11 04:25:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-097e1e20-ec94-45d5-9e30-0b6f4d46dbe4 tempest-DeleteServersTestJSON-744687230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e0799a8-4a65-4fcf-a37e-72ca698a46ff 1073741824" returned: 0 in 0.939s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:25:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-097e1e20-ec94-45d5-9e30-0b6f4d46dbe4 tempest-DeleteServersTestJSON-744687230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e0799a8-4a65-4fcf-a37e-72ca698a46ff {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:25:40 devstack sudo[89846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e0799a8-4a65-4fcf-a37e-72ca698a46ff Jul 11 04:25:40 devstack sudo[89846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:25:41 devstack sudo[89846]: pam_unix(sudo:session): session closed for user root Jul 11 04:25:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-097e1e20-ec94-45d5-9e30-0b6f4d46dbe4 tempest-DeleteServersTestJSON-744687230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e0799a8-4a65-4fcf-a37e-72ca698a46ff" returned: 0 in 0.702s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:25:41 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-097e1e20-ec94-45d5-9e30-0b6f4d46dbe4 tempest-DeleteServersTestJSON-744687230 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:25:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-097e1e20-ec94-45d5-9e30-0b6f4d46dbe4 tempest-DeleteServersTestJSON-744687230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:25:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f7ccf071-1611-46fe-9e51-fdc3113b5ae9 tempest-VolumesServicesTestJSON-331515889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.773s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:25:41 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-f7ccf071-1611-46fe-9e51-fdc3113b5ae9 tempest-VolumesServicesTestJSON-331515889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-575354488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea1cc8ec-410c-48a7-b25b-da2695055cd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40447ba7f9844de8af49f9947b30d17e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:25:41Z,use_quota=True,user_id='79e24387b0ae4361a1fbb17a4c41295c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:25:41 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-f7ccf071-1611-46fe-9e51-fdc3113b5ae9 tempest-VolumesServicesTestJSON-331515889 None] Creating volume ea1cc8ec-410c-48a7-b25b-da2695055cd6 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:25:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f7ccf071-1611-46fe-9e51-fdc3113b5ae9 tempest-VolumesServicesTestJSON-331515889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:25:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f7ccf071-1611-46fe-9e51-fdc3113b5ae9 tempest-VolumesServicesTestJSON-331515889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:25:41 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-f7ccf071-1611-46fe-9e51-fdc3113b5ae9 tempest-VolumesServicesTestJSON-331515889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:25:41 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-f7ccf071-1611-46fe-9e51-fdc3113b5ae9 tempest-VolumesServicesTestJSON-331515889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:25:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f7ccf071-1611-46fe-9e51-fdc3113b5ae9 tempest-VolumesServicesTestJSON-331515889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:25:41 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-f7ccf071-1611-46fe-9e51-fdc3113b5ae9 tempest-VolumesServicesTestJSON-331515889 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:25:41 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-f7ccf071-1611-46fe-9e51-fdc3113b5ae9 tempest-VolumesServicesTestJSON-331515889 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:25:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f7ccf071-1611-46fe-9e51-fdc3113b5ae9 tempest-VolumesServicesTestJSON-331515889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ea1cc8ec-410c-48a7-b25b-da2695055cd6 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:25:41 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-097e1e20-ec94-45d5-9e30-0b6f4d46dbe4 tempest-DeleteServersTestJSON-744687230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1085aeac-395b-4814-bff1-3e1da240ef8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e0799a8-4a65-4fcf-a37e-72ca698a46ff', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:25:41 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-097e1e20-ec94-45d5-9e30-0b6f4d46dbe4 tempest-DeleteServersTestJSON-744687230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cde5f22-32a5-4111-9804-20d97e81b3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:25:41 devstack sudo[89855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ea1cc8ec-410c-48a7-b25b-da2695055cd6 1073741824 Jul 11 04:25:41 devstack sudo[89855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:25:41 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-097e1e20-ec94-45d5-9e30-0b6f4d46dbe4 tempest-DeleteServersTestJSON-744687230 None] Volume volume-6e0799a8-4a65-4fcf-a37e-72ca698a46ff (6e0799a8-4a65-4fcf-a37e-72ca698a46ff): created successfully Jul 11 04:25:41 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-097e1e20-ec94-45d5-9e30-0b6f4d46dbe4 tempest-DeleteServersTestJSON-744687230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cde5f22-32a5-4111-9804-20d97e81b3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:25:41 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-097e1e20-ec94-45d5-9e30-0b6f4d46dbe4 tempest-DeleteServersTestJSON-744687230 None] Flow 'volume_create_manager' (bf2b35b7-0ec0-43b5-aae0-71b76e42b1d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:25:41 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-097e1e20-ec94-45d5-9e30-0b6f4d46dbe4 tempest-DeleteServersTestJSON-744687230 None] Created volume successfully. Jul 11 04:25:42 devstack sudo[89855]: pam_unix(sudo:session): session closed for user root Jul 11 04:25:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f7ccf071-1611-46fe-9e51-fdc3113b5ae9 tempest-VolumesServicesTestJSON-331515889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ea1cc8ec-410c-48a7-b25b-da2695055cd6 1073741824" returned: 0 in 0.907s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:25:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f7ccf071-1611-46fe-9e51-fdc3113b5ae9 tempest-VolumesServicesTestJSON-331515889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ea1cc8ec-410c-48a7-b25b-da2695055cd6 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:25:42 devstack sudo[89865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ea1cc8ec-410c-48a7-b25b-da2695055cd6 Jul 11 04:25:42 devstack sudo[89865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:25:43 devstack sudo[89865]: pam_unix(sudo:session): session closed for user root Jul 11 04:25:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f7ccf071-1611-46fe-9e51-fdc3113b5ae9 tempest-VolumesServicesTestJSON-331515889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ea1cc8ec-410c-48a7-b25b-da2695055cd6" returned: 0 in 0.694s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:25:43 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-f7ccf071-1611-46fe-9e51-fdc3113b5ae9 tempest-VolumesServicesTestJSON-331515889 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:25:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f7ccf071-1611-46fe-9e51-fdc3113b5ae9 tempest-VolumesServicesTestJSON-331515889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:25:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f7ccf071-1611-46fe-9e51-fdc3113b5ae9 tempest-VolumesServicesTestJSON-331515889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4e529c9-aef1-45f3-8d53-ca3040c3eff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea1cc8ec-410c-48a7-b25b-da2695055cd6', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:25:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f7ccf071-1611-46fe-9e51-fdc3113b5ae9 tempest-VolumesServicesTestJSON-331515889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae79d480-6009-4c27-91d1-47e96426736a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:25:43 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-f7ccf071-1611-46fe-9e51-fdc3113b5ae9 tempest-VolumesServicesTestJSON-331515889 None] Volume volume-ea1cc8ec-410c-48a7-b25b-da2695055cd6 (ea1cc8ec-410c-48a7-b25b-da2695055cd6): created successfully Jul 11 04:25:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f7ccf071-1611-46fe-9e51-fdc3113b5ae9 tempest-VolumesServicesTestJSON-331515889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae79d480-6009-4c27-91d1-47e96426736a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:25:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f7ccf071-1611-46fe-9e51-fdc3113b5ae9 tempest-VolumesServicesTestJSON-331515889 None] Flow 'volume_create_manager' (c37f6e74-4c9c-48c2-82f4-7fb9e63b31d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:25:43 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-f7ccf071-1611-46fe-9e51-fdc3113b5ae9 tempest-VolumesServicesTestJSON-331515889 None] Created volume successfully. Jul 11 04:25:44 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-191730b2-afd7-4608-aafd-a75ebad01345 tempest-VolumesServicesTestJSON-331515889 None] Acquiring lock "cinder-ea1cc8ec-410c-48a7-b25b-da2695055cd6-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:25:44 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-191730b2-afd7-4608-aafd-a75ebad01345 tempest-VolumesServicesTestJSON-331515889 None] Lock "cinder-ea1cc8ec-410c-48a7-b25b-da2695055cd6-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:25:44 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-191730b2-afd7-4608-aafd-a75ebad01345 tempest-VolumesServicesTestJSON-331515889 None] Acquiring lock "cinder-quobyte-ea1cc8ec-410c-48a7-b25b-da2695055cd6" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:25:44 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-191730b2-afd7-4608-aafd-a75ebad01345 tempest-VolumesServicesTestJSON-331515889 None] Lock "cinder-quobyte-ea1cc8ec-410c-48a7-b25b-da2695055cd6" acquired by "delete_volume" :: waited 0.014s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:25:44 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[39951a19-7a4d-4b10-9faf-1eeb2bb4c311]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:25:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-191730b2-afd7-4608-aafd-a75ebad01345 tempest-VolumesServicesTestJSON-331515889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ea1cc8ec-410c-48a7-b25b-da2695055cd6 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:25:44 devstack sudo[89870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ea1cc8ec-410c-48a7-b25b-da2695055cd6 Jul 11 04:25:44 devstack sudo[89870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:25:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-da86f20f-74e4-491c-aee9-3a77579604c7 req-d49ac0ee-7f4f-4c38-83ed-a65f7e574fac tempest-TaggedAttachmentsTest-480922109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:25:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-da86f20f-74e4-491c-aee9-3a77579604c7 req-d49ac0ee-7f4f-4c38-83ed-a65f7e574fac tempest-TaggedAttachmentsTest-480922109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:25:45 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd737c72-7c56-44c3-958f-9f0dd2a21ff0]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:25:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-da86f20f-74e4-491c-aee9-3a77579604c7 req-d49ac0ee-7f4f-4c38-83ed-a65f7e574fac tempest-TaggedAttachmentsTest-480922109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-555a39df-7b1b-486b-8638-5b5d1c3e485a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:25:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-13f51dcc-11c7-493a-83f5-e0fdf7d0c5b5 req-714b2fa0-57d6-4d4f-b50f-1864f85da65c tempest-DeleteServersTestJSON-744687230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:25:45 devstack sudo[89891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-555a39df-7b1b-486b-8638-5b5d1c3e485a Jul 11 04:25:45 devstack sudo[89891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:25:45 devstack sudo[89870]: pam_unix(sudo:session): session closed for user root Jul 11 04:25:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-191730b2-afd7-4608-aafd-a75ebad01345 tempest-VolumesServicesTestJSON-331515889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ea1cc8ec-410c-48a7-b25b-da2695055cd6" returned: 0 in 1.104s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:25:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-191730b2-afd7-4608-aafd-a75ebad01345 tempest-VolumesServicesTestJSON-331515889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ea1cc8ec-410c-48a7-b25b-da2695055cd6 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:25:45 devstack sudo[89897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ea1cc8ec-410c-48a7-b25b-da2695055cd6 Jul 11 04:25:45 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:25:45 devstack sudo[89891]: pam_unix(sudo:session): session closed for user root Jul 11 04:25:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-da86f20f-74e4-491c-aee9-3a77579604c7 req-d49ac0ee-7f4f-4c38-83ed-a65f7e574fac tempest-TaggedAttachmentsTest-480922109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-555a39df-7b1b-486b-8638-5b5d1c3e485a" returned: 0 in 0.799s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:25:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-da86f20f-74e4-491c-aee9-3a77579604c7 req-d49ac0ee-7f4f-4c38-83ed-a65f7e574fac tempest-TaggedAttachmentsTest-480922109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.828s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:25:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-13f51dcc-11c7-493a-83f5-e0fdf7d0c5b5 req-714b2fa0-57d6-4d4f-b50f-1864f85da65c tempest-DeleteServersTestJSON-744687230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.794s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:25:45 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e5b430-9945-41a3-a7f3-0ed428c4d900]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:25:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-13f51dcc-11c7-493a-83f5-e0fdf7d0c5b5 req-714b2fa0-57d6-4d4f-b50f-1864f85da65c tempest-DeleteServersTestJSON-744687230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e0799a8-4a65-4fcf-a37e-72ca698a46ff {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:25:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-da86f20f-74e4-491c-aee9-3a77579604c7 req-d49ac0ee-7f4f-4c38-83ed-a65f7e574fac tempest-TaggedAttachmentsTest-480922109 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95', 'name': 'volume-555a39df-7b1b-486b-8638-5b5d1c3e485a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8d78f719-393b-448d-92ba-fa65a861f078', 'enforce_multipath': True} {{(pid=86964) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 04:25:46 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-da86f20f-74e4-491c-aee9-3a77579604c7 req-d49ac0ee-7f4f-4c38-83ed-a65f7e574fac tempest-TaggedAttachmentsTest-480922109 None] attachment_update completed successfully. Jul 11 04:25:46 devstack sudo[89903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e0799a8-4a65-4fcf-a37e-72ca698a46ff Jul 11 04:25:46 devstack sudo[89903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:25:46 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root Jul 11 04:25:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-191730b2-afd7-4608-aafd-a75ebad01345 tempest-VolumesServicesTestJSON-331515889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ea1cc8ec-410c-48a7-b25b-da2695055cd6" returned: 0 in 0.742s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:25:46 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-191730b2-afd7-4608-aafd-a75ebad01345 tempest-VolumesServicesTestJSON-331515889 None] Lock "cinder-quobyte-ea1cc8ec-410c-48a7-b25b-da2695055cd6" released by "delete_volume" :: held 1.984s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:25:46 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-191730b2-afd7-4608-aafd-a75ebad01345 tempest-VolumesServicesTestJSON-331515889 None] Created reservations ['4fbb4e50-1280-455d-a4c4-237caf6bcae6', '1dae6977-48a6-431e-85ed-a9ff8956e18f', '7f912954-bb36-4c75-8c3a-9f1bc961c30a', '4dbcc86b-4175-4f52-828e-061258bfa8d9'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:25:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-191730b2-afd7-4608-aafd-a75ebad01345 tempest-VolumesServicesTestJSON-331515889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:25:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-191730b2-afd7-4608-aafd-a75ebad01345 tempest-VolumesServicesTestJSON-331515889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:25:46 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-191730b2-afd7-4608-aafd-a75ebad01345 tempest-VolumesServicesTestJSON-331515889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:25:46 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-191730b2-afd7-4608-aafd-a75ebad01345 tempest-VolumesServicesTestJSON-331515889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:25:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-191730b2-afd7-4608-aafd-a75ebad01345 tempest-VolumesServicesTestJSON-331515889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:25:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-191730b2-afd7-4608-aafd-a75ebad01345 tempest-VolumesServicesTestJSON-331515889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:25:46 devstack sudo[89921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:25:46 devstack sudo[89921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:25:47 devstack sudo[89903]: pam_unix(sudo:session): session closed for user root Jul 11 04:25:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-13f51dcc-11c7-493a-83f5-e0fdf7d0c5b5 req-714b2fa0-57d6-4d4f-b50f-1864f85da65c tempest-DeleteServersTestJSON-744687230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e0799a8-4a65-4fcf-a37e-72ca698a46ff" returned: 0 in 1.592s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:25:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-13f51dcc-11c7-493a-83f5-e0fdf7d0c5b5 req-714b2fa0-57d6-4d4f-b50f-1864f85da65c tempest-DeleteServersTestJSON-744687230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.617s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:25:47 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-13f51dcc-11c7-493a-83f5-e0fdf7d0c5b5 req-714b2fa0-57d6-4d4f-b50f-1864f85da65c tempest-DeleteServersTestJSON-744687230 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95', 'name': 'volume-6e0799a8-4a65-4fcf-a37e-72ca698a46ff', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a9d79f40-dba9-4b9b-9b6a-67a7ba5e7347', 'enforce_multipath': True} {{(pid=86964) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 04:25:47 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-13f51dcc-11c7-493a-83f5-e0fdf7d0c5b5 req-714b2fa0-57d6-4d4f-b50f-1864f85da65c tempest-DeleteServersTestJSON-744687230 None] attachment_update completed successfully. Jul 11 04:25:47 devstack sudo[89921]: pam_unix(sudo:session): session closed for user root Jul 11 04:25:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-191730b2-afd7-4608-aafd-a75ebad01345 tempest-VolumesServicesTestJSON-331515889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 1.374s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:25:47 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-191730b2-afd7-4608-aafd-a75ebad01345 tempest-VolumesServicesTestJSON-331515889 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:25:47 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-191730b2-afd7-4608-aafd-a75ebad01345 tempest-VolumesServicesTestJSON-331515889 None] Deleted volume successfully. Jul 11 04:25:47 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-191730b2-afd7-4608-aafd-a75ebad01345 tempest-VolumesServicesTestJSON-331515889 None] Lock "cinder-ea1cc8ec-410c-48a7-b25b-da2695055cd6-delete_volume" released by "delete_volume" :: held 3.755s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:25:53 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-422c8033-b59a-4588-aaaf-09aff801132e req-8f9cda13-34ec-4e45-8b55-ac01be1baa16 tempest-TaggedAttachmentsTest-480922109 None] Terminate volume connection completed successfully. Jul 11 04:25:53 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-422c8033-b59a-4588-aaaf-09aff801132e req-8f9cda13-34ec-4e45-8b55-ac01be1baa16 tempest-TaggedAttachmentsTest-480922109 None] Deleting attachment 8d78f719-393b-448d-92ba-fa65a861f078. {{(pid=86964) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 04:25:55 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b0185a4-3e6f-446d-93fa-afefdcae494f tempest-VolumeTypesAccessTest-90164250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:25:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9b0185a4-3e6f-446d-93fa-afefdcae494f tempest-VolumeTypesAccessTest-90164250 None] Flow 'volume_create_manager' (b1fbc1ad-1481-43c1-a52d-c6cbde9a62e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:25:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9b0185a4-3e6f-446d-93fa-afefdcae494f tempest-VolumeTypesAccessTest-90164250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9071479b-fb24-4b0e-9918-639dd2f1afbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:25:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9b0185a4-3e6f-446d-93fa-afefdcae494f tempest-VolumeTypesAccessTest-90164250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9071479b-fb24-4b0e-9918-639dd2f1afbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1312348206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d251667-2053-47e8-952f-b4b6f5a2b924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ba126c38f5c4dee86e00083199f370f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:25:56Z,use_quota=True,user_id='87409d8b9f5445e2b80b21a813bc3d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b974211-fb1e-431b-8e4c-f636ea105acd),volume_type_id=5b974211-fb1e-431b-8e4c-f636ea105acd)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:25:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9b0185a4-3e6f-446d-93fa-afefdcae494f tempest-VolumeTypesAccessTest-90164250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1da64b3-6a89-4217-85d9-db6e15a67ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:25:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9b0185a4-3e6f-446d-93fa-afefdcae494f tempest-VolumeTypesAccessTest-90164250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1da64b3-6a89-4217-85d9-db6e15a67ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:25:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9b0185a4-3e6f-446d-93fa-afefdcae494f tempest-VolumeTypesAccessTest-90164250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1213bc7-dc7a-4fb0-b01f-935d96cb2f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:25:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9b0185a4-3e6f-446d-93fa-afefdcae494f tempest-VolumeTypesAccessTest-90164250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1213bc7-dc7a-4fb0-b01f-935d96cb2f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d251667-2053-47e8-952f-b4b6f5a2b924', 'volume_name': 'volume-9d251667-2053-47e8-952f-b4b6f5a2b924', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:25:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9b0185a4-3e6f-446d-93fa-afefdcae494f tempest-VolumeTypesAccessTest-90164250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a73f27-bae2-428e-9d20-3d4d021990f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:25:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9b0185a4-3e6f-446d-93fa-afefdcae494f tempest-VolumeTypesAccessTest-90164250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a73f27-bae2-428e-9d20-3d4d021990f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:25:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9b0185a4-3e6f-446d-93fa-afefdcae494f tempest-VolumeTypesAccessTest-90164250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (368ceb30-41e9-45e9-9ec7-46841300b51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:25:55 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-9b0185a4-3e6f-446d-93fa-afefdcae494f tempest-VolumeTypesAccessTest-90164250 None] Volume 9d251667-2053-47e8-952f-b4b6f5a2b924: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d251667-2053-47e8-952f-b4b6f5a2b924', 'volume_size': 1} Jul 11 04:25:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9b0185a4-3e6f-446d-93fa-afefdcae494f tempest-VolumeTypesAccessTest-90164250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:25:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9b0185a4-3e6f-446d-93fa-afefdcae494f tempest-VolumeTypesAccessTest-90164250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:25:55 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-9b0185a4-3e6f-446d-93fa-afefdcae494f tempest-VolumeTypesAccessTest-90164250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1312348206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d251667-2053-47e8-952f-b4b6f5a2b924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ba126c38f5c4dee86e00083199f370f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:25:56Z,use_quota=True,user_id='87409d8b9f5445e2b80b21a813bc3d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b974211-fb1e-431b-8e4c-f636ea105acd),volume_type_id=5b974211-fb1e-431b-8e4c-f636ea105acd)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:25:55 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-9b0185a4-3e6f-446d-93fa-afefdcae494f tempest-VolumeTypesAccessTest-90164250 None] Creating volume 9d251667-2053-47e8-952f-b4b6f5a2b924 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:25:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9b0185a4-3e6f-446d-93fa-afefdcae494f tempest-VolumeTypesAccessTest-90164250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:25:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9b0185a4-3e6f-446d-93fa-afefdcae494f tempest-VolumeTypesAccessTest-90164250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:25:55 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-9b0185a4-3e6f-446d-93fa-afefdcae494f tempest-VolumeTypesAccessTest-90164250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:25:55 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-9b0185a4-3e6f-446d-93fa-afefdcae494f tempest-VolumeTypesAccessTest-90164250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:25:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9b0185a4-3e6f-446d-93fa-afefdcae494f tempest-VolumeTypesAccessTest-90164250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:25:55 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-9b0185a4-3e6f-446d-93fa-afefdcae494f tempest-VolumeTypesAccessTest-90164250 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:25:55 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-9b0185a4-3e6f-446d-93fa-afefdcae494f tempest-VolumeTypesAccessTest-90164250 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:25:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9b0185a4-3e6f-446d-93fa-afefdcae494f tempest-VolumeTypesAccessTest-90164250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9d251667-2053-47e8-952f-b4b6f5a2b924 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:25:55 devstack sudo[90486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9d251667-2053-47e8-952f-b4b6f5a2b924 1073741824 Jul 11 04:25:55 devstack sudo[90486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:25:57 devstack sudo[90486]: pam_unix(sudo:session): session closed for user root Jul 11 04:25:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9b0185a4-3e6f-446d-93fa-afefdcae494f tempest-VolumeTypesAccessTest-90164250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9d251667-2053-47e8-952f-b4b6f5a2b924 1073741824" returned: 0 in 1.361s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:25:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9b0185a4-3e6f-446d-93fa-afefdcae494f tempest-VolumeTypesAccessTest-90164250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9d251667-2053-47e8-952f-b4b6f5a2b924 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:25:57 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-a63cdd4d-88bf-48e2-81ff-a489879f21eb req-a041d029-4279-42fe-8ba2-b80e407c2603 tempest-DeleteServersTestJSON-744687230 None] Terminate volume connection completed successfully. Jul 11 04:25:57 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-a63cdd4d-88bf-48e2-81ff-a489879f21eb req-a041d029-4279-42fe-8ba2-b80e407c2603 tempest-DeleteServersTestJSON-744687230 None] Deleting attachment a9d79f40-dba9-4b9b-9b6a-67a7ba5e7347. {{(pid=86964) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 04:25:57 devstack sudo[90510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9d251667-2053-47e8-952f-b4b6f5a2b924 Jul 11 04:25:57 devstack sudo[90510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:25:58 devstack sudo[90510]: pam_unix(sudo:session): session closed for user root Jul 11 04:25:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9b0185a4-3e6f-446d-93fa-afefdcae494f tempest-VolumeTypesAccessTest-90164250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9d251667-2053-47e8-952f-b4b6f5a2b924" returned: 0 in 0.892s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:25:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-9b0185a4-3e6f-446d-93fa-afefdcae494f tempest-VolumeTypesAccessTest-90164250 None] <== create_volume: return (2327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:25:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9b0185a4-3e6f-446d-93fa-afefdcae494f tempest-VolumeTypesAccessTest-90164250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.329s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:25:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9b0185a4-3e6f-446d-93fa-afefdcae494f tempest-VolumeTypesAccessTest-90164250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (368ceb30-41e9-45e9-9ec7-46841300b51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d251667-2053-47e8-952f-b4b6f5a2b924', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:25:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9b0185a4-3e6f-446d-93fa-afefdcae494f tempest-VolumeTypesAccessTest-90164250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ce5dea-7684-468c-af6b-310326ae5c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:25:58 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-9b0185a4-3e6f-446d-93fa-afefdcae494f tempest-VolumeTypesAccessTest-90164250 None] Volume volume-9d251667-2053-47e8-952f-b4b6f5a2b924 (9d251667-2053-47e8-952f-b4b6f5a2b924): created successfully Jul 11 04:25:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9b0185a4-3e6f-446d-93fa-afefdcae494f tempest-VolumeTypesAccessTest-90164250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ce5dea-7684-468c-af6b-310326ae5c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:25:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9b0185a4-3e6f-446d-93fa-afefdcae494f tempest-VolumeTypesAccessTest-90164250 None] Flow 'volume_create_manager' (b1fbc1ad-1481-43c1-a52d-c6cbde9a62e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:25:58 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-9b0185a4-3e6f-446d-93fa-afefdcae494f tempest-VolumeTypesAccessTest-90164250 None] Created volume successfully. Jul 11 04:25:58 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-96c26906-cca8-4e8b-93e2-def5bffc82ce tempest-VolumeTypesAccessTest-90164250 None] Acquiring lock "cinder-9d251667-2053-47e8-952f-b4b6f5a2b924-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:25:58 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-96c26906-cca8-4e8b-93e2-def5bffc82ce tempest-VolumeTypesAccessTest-90164250 None] Lock "cinder-9d251667-2053-47e8-952f-b4b6f5a2b924-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:25:58 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-96c26906-cca8-4e8b-93e2-def5bffc82ce tempest-VolumeTypesAccessTest-90164250 None] Acquiring lock "cinder-quobyte-9d251667-2053-47e8-952f-b4b6f5a2b924" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:25:58 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-96c26906-cca8-4e8b-93e2-def5bffc82ce tempest-VolumeTypesAccessTest-90164250 None] Lock "cinder-quobyte-9d251667-2053-47e8-952f-b4b6f5a2b924" acquired by "delete_volume" :: waited 0.019s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:25:58 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccf42f6-a64e-4366-8362-d3090ff8ede1]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:25:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-96c26906-cca8-4e8b-93e2-def5bffc82ce tempest-VolumeTypesAccessTest-90164250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9d251667-2053-47e8-952f-b4b6f5a2b924 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:25:58 devstack sudo[90552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9d251667-2053-47e8-952f-b4b6f5a2b924 Jul 11 04:25:58 devstack sudo[90552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:25:59 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager._thread_info {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:25:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread count: 8 {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:25:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread info: [<_MainThread(MainThread, started 124675027595392)>, , , , , , , ] {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:25:59 devstack sudo[90552]: pam_unix(sudo:session): session closed for user root Jul 11 04:25:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-96c26906-cca8-4e8b-93e2-def5bffc82ce tempest-VolumeTypesAccessTest-90164250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9d251667-2053-47e8-952f-b4b6f5a2b924" returned: 0 in 0.831s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:25:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-96c26906-cca8-4e8b-93e2-def5bffc82ce tempest-VolumeTypesAccessTest-90164250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9d251667-2053-47e8-952f-b4b6f5a2b924 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:25:59 devstack sudo[90558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9d251667-2053-47e8-952f-b4b6f5a2b924 Jul 11 04:25:59 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:26:00 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root Jul 11 04:26:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-96c26906-cca8-4e8b-93e2-def5bffc82ce tempest-VolumeTypesAccessTest-90164250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9d251667-2053-47e8-952f-b4b6f5a2b924" returned: 0 in 0.630s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:26:00 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-96c26906-cca8-4e8b-93e2-def5bffc82ce tempest-VolumeTypesAccessTest-90164250 None] Lock "cinder-quobyte-9d251667-2053-47e8-952f-b4b6f5a2b924" released by "delete_volume" :: held 1.504s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:26:00 devstack cinder-volume[86964]: WARNING cinder.quota [None req-96c26906-cca8-4e8b-93e2-def5bffc82ce tempest-VolumeTypesAccessTest-90164250 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1016988472 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1016988472, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:26:00 devstack cinder-volume[86964]: WARNING cinder.quota [None req-96c26906-cca8-4e8b-93e2-def5bffc82ce tempest-VolumeTypesAccessTest-90164250 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1016988472 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1016988472, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:26:00 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-96c26906-cca8-4e8b-93e2-def5bffc82ce tempest-VolumeTypesAccessTest-90164250 None] Created reservations ['e98408a3-4038-4799-8fa0-96d6bc2ea870', '587ddb98-b67c-4b06-acc1-cf8f434e6ec0', '644b0bc3-e7d1-4c03-8a77-0246b3b1113d', 'fff64b8d-8fd8-44e9-b6c9-9a393587de50'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:26:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-96c26906-cca8-4e8b-93e2-def5bffc82ce tempest-VolumeTypesAccessTest-90164250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:26:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-96c26906-cca8-4e8b-93e2-def5bffc82ce tempest-VolumeTypesAccessTest-90164250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:26:00 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-96c26906-cca8-4e8b-93e2-def5bffc82ce tempest-VolumeTypesAccessTest-90164250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:26:00 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-96c26906-cca8-4e8b-93e2-def5bffc82ce tempest-VolumeTypesAccessTest-90164250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:26:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-96c26906-cca8-4e8b-93e2-def5bffc82ce tempest-VolumeTypesAccessTest-90164250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:26:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-96c26906-cca8-4e8b-93e2-def5bffc82ce tempest-VolumeTypesAccessTest-90164250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:26:00 devstack sudo[90562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:26:00 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:26:00 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e99eaeea-a423-42d4-9b33-c8775c58bfce tempest-DeleteServersTestJSON-744687230 None] Acquiring lock "cinder-6e0799a8-4a65-4fcf-a37e-72ca698a46ff-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:26:00 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e99eaeea-a423-42d4-9b33-c8775c58bfce tempest-DeleteServersTestJSON-744687230 None] Lock "cinder-6e0799a8-4a65-4fcf-a37e-72ca698a46ff-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:26:00 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e99eaeea-a423-42d4-9b33-c8775c58bfce tempest-DeleteServersTestJSON-744687230 None] Acquiring lock "cinder-quobyte-6e0799a8-4a65-4fcf-a37e-72ca698a46ff" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:26:00 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e99eaeea-a423-42d4-9b33-c8775c58bfce tempest-DeleteServersTestJSON-744687230 None] Lock "cinder-quobyte-6e0799a8-4a65-4fcf-a37e-72ca698a46ff" acquired by "delete_volume" :: waited 0.019s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:26:00 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d45299a-db61-4ca6-9b85-e6e15404d654]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:26:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e99eaeea-a423-42d4-9b33-c8775c58bfce tempest-DeleteServersTestJSON-744687230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e0799a8-4a65-4fcf-a37e-72ca698a46ff {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:26:01 devstack sudo[90564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e0799a8-4a65-4fcf-a37e-72ca698a46ff Jul 11 04:26:01 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:26:01 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root Jul 11 04:26:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-96c26906-cca8-4e8b-93e2-def5bffc82ce tempest-VolumeTypesAccessTest-90164250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.805s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:26:01 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-96c26906-cca8-4e8b-93e2-def5bffc82ce tempest-VolumeTypesAccessTest-90164250 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:26:01 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-96c26906-cca8-4e8b-93e2-def5bffc82ce tempest-VolumeTypesAccessTest-90164250 None] Deleted volume successfully. Jul 11 04:26:01 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-96c26906-cca8-4e8b-93e2-def5bffc82ce tempest-VolumeTypesAccessTest-90164250 None] Lock "cinder-9d251667-2053-47e8-952f-b4b6f5a2b924-delete_volume" released by "delete_volume" :: held 2.554s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:26:01 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root Jul 11 04:26:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e99eaeea-a423-42d4-9b33-c8775c58bfce tempest-DeleteServersTestJSON-744687230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e0799a8-4a65-4fcf-a37e-72ca698a46ff" returned: 0 in 0.920s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:26:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e99eaeea-a423-42d4-9b33-c8775c58bfce tempest-DeleteServersTestJSON-744687230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e0799a8-4a65-4fcf-a37e-72ca698a46ff {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:26:01 devstack sudo[90574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e0799a8-4a65-4fcf-a37e-72ca698a46ff Jul 11 04:26:01 devstack sudo[90574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:26:02 devstack sudo[90574]: pam_unix(sudo:session): session closed for user root Jul 11 04:26:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e99eaeea-a423-42d4-9b33-c8775c58bfce tempest-DeleteServersTestJSON-744687230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e0799a8-4a65-4fcf-a37e-72ca698a46ff" returned: 0 in 0.849s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:26:02 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e99eaeea-a423-42d4-9b33-c8775c58bfce tempest-DeleteServersTestJSON-744687230 None] Lock "cinder-quobyte-6e0799a8-4a65-4fcf-a37e-72ca698a46ff" released by "delete_volume" :: held 1.814s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:26:02 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-e99eaeea-a423-42d4-9b33-c8775c58bfce tempest-DeleteServersTestJSON-744687230 None] Created reservations ['c4b9ff4d-83de-49b0-a31f-e998f9935416', '35e30328-515a-4e95-98c6-262c5648688d', 'b527532f-eac4-4c0e-b716-1cf2caedf920', 'ecc01610-34b9-44ff-a7a7-b5ad92859f28'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:26:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e99eaeea-a423-42d4-9b33-c8775c58bfce tempest-DeleteServersTestJSON-744687230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:26:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e99eaeea-a423-42d4-9b33-c8775c58bfce tempest-DeleteServersTestJSON-744687230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:26:02 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e99eaeea-a423-42d4-9b33-c8775c58bfce tempest-DeleteServersTestJSON-744687230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:26:02 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e99eaeea-a423-42d4-9b33-c8775c58bfce tempest-DeleteServersTestJSON-744687230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:26:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e99eaeea-a423-42d4-9b33-c8775c58bfce tempest-DeleteServersTestJSON-744687230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:26:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e99eaeea-a423-42d4-9b33-c8775c58bfce tempest-DeleteServersTestJSON-744687230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:26:02 devstack sudo[90590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:26:02 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:26:03 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root Jul 11 04:26:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e99eaeea-a423-42d4-9b33-c8775c58bfce tempest-DeleteServersTestJSON-744687230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 1.013s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:26:03 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-e99eaeea-a423-42d4-9b33-c8775c58bfce tempest-DeleteServersTestJSON-744687230 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:26:03 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-e99eaeea-a423-42d4-9b33-c8775c58bfce tempest-DeleteServersTestJSON-744687230 None] Deleted volume successfully. Jul 11 04:26:03 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e99eaeea-a423-42d4-9b33-c8775c58bfce tempest-DeleteServersTestJSON-744687230 None] Lock "cinder-6e0799a8-4a65-4fcf-a37e-72ca698a46ff-delete_volume" released by "delete_volume" :: held 3.131s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:26:12 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:UPDATE=45,cinder:SELECT=45,cinder:INSERT=9,cinder:DELETE=5 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:26:13 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-8927c43a-3ade-4fd9-8e9d-da621c50b57d tempest-TaggedAttachmentsTest-480922109 None] Acquiring lock "cinder-555a39df-7b1b-486b-8638-5b5d1c3e485a-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:26:13 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-8927c43a-3ade-4fd9-8e9d-da621c50b57d tempest-TaggedAttachmentsTest-480922109 None] Lock "cinder-555a39df-7b1b-486b-8638-5b5d1c3e485a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:26:13 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-8927c43a-3ade-4fd9-8e9d-da621c50b57d tempest-TaggedAttachmentsTest-480922109 None] Acquiring lock "cinder-quobyte-555a39df-7b1b-486b-8638-5b5d1c3e485a" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:26:13 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-8927c43a-3ade-4fd9-8e9d-da621c50b57d tempest-TaggedAttachmentsTest-480922109 None] Lock "cinder-quobyte-555a39df-7b1b-486b-8638-5b5d1c3e485a" acquired by "delete_volume" :: waited 0.034s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:26:13 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[f456f9b3-e8b8-40af-b31e-1df7cbdc3a29]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:26:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8927c43a-3ade-4fd9-8e9d-da621c50b57d tempest-TaggedAttachmentsTest-480922109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-555a39df-7b1b-486b-8638-5b5d1c3e485a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:26:14 devstack sudo[90641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-555a39df-7b1b-486b-8638-5b5d1c3e485a Jul 11 04:26:14 devstack sudo[90641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:26:14 devstack sudo[90641]: pam_unix(sudo:session): session closed for user root Jul 11 04:26:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8927c43a-3ade-4fd9-8e9d-da621c50b57d tempest-TaggedAttachmentsTest-480922109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-555a39df-7b1b-486b-8638-5b5d1c3e485a" returned: 0 in 1.019s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:26:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8927c43a-3ade-4fd9-8e9d-da621c50b57d tempest-TaggedAttachmentsTest-480922109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-555a39df-7b1b-486b-8638-5b5d1c3e485a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:26:15 devstack sudo[90652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-555a39df-7b1b-486b-8638-5b5d1c3e485a Jul 11 04:26:15 devstack sudo[90652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:26:16 devstack sudo[90652]: pam_unix(sudo:session): session closed for user root Jul 11 04:26:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8927c43a-3ade-4fd9-8e9d-da621c50b57d tempest-TaggedAttachmentsTest-480922109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-555a39df-7b1b-486b-8638-5b5d1c3e485a" returned: 0 in 1.152s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:26:16 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-8927c43a-3ade-4fd9-8e9d-da621c50b57d tempest-TaggedAttachmentsTest-480922109 None] Lock "cinder-quobyte-555a39df-7b1b-486b-8638-5b5d1c3e485a" released by "delete_volume" :: held 2.239s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:26:16 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-8927c43a-3ade-4fd9-8e9d-da621c50b57d tempest-TaggedAttachmentsTest-480922109 None] Created reservations ['ea940134-9635-4744-a52d-2bf0b6079f06', '0c46b6ec-3d06-4d16-9d80-a31f3fd9a3b1', '63c803b3-c7f4-4805-a7b2-5719012d5f4a', '3f180585-6e53-4a4f-90ff-1f28b068b134'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:26:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-8927c43a-3ade-4fd9-8e9d-da621c50b57d tempest-TaggedAttachmentsTest-480922109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:26:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-8927c43a-3ade-4fd9-8e9d-da621c50b57d tempest-TaggedAttachmentsTest-480922109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:26:16 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-8927c43a-3ade-4fd9-8e9d-da621c50b57d tempest-TaggedAttachmentsTest-480922109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:26:16 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-8927c43a-3ade-4fd9-8e9d-da621c50b57d tempest-TaggedAttachmentsTest-480922109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:26:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-8927c43a-3ade-4fd9-8e9d-da621c50b57d tempest-TaggedAttachmentsTest-480922109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:26:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8927c43a-3ade-4fd9-8e9d-da621c50b57d tempest-TaggedAttachmentsTest-480922109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:26:16 devstack sudo[90671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:26:16 devstack sudo[90671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:26:17 devstack sudo[90671]: pam_unix(sudo:session): session closed for user root Jul 11 04:26:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8927c43a-3ade-4fd9-8e9d-da621c50b57d tempest-TaggedAttachmentsTest-480922109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.815s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:26:17 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-8927c43a-3ade-4fd9-8e9d-da621c50b57d tempest-TaggedAttachmentsTest-480922109 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:26:17 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-8927c43a-3ade-4fd9-8e9d-da621c50b57d tempest-TaggedAttachmentsTest-480922109 None] Deleted volume successfully. Jul 11 04:26:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-8927c43a-3ade-4fd9-8e9d-da621c50b57d tempest-TaggedAttachmentsTest-480922109 None] Lock "cinder-555a39df-7b1b-486b-8638-5b5d1c3e485a-delete_volume" released by "delete_volume" :: held 3.369s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:26:26 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=4,cinder:UPDATE=7,cinder:INSERT=2 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:26:27 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=59,cinder:UPDATE=67,cinder:INSERT=13,cinder:DELETE=4 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:26:32 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e0ea431-048a-466f-a15c-c7cb424ec58f tempest-AbsoluteLimitsTests-1440509407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:26:32 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7e0ea431-048a-466f-a15c-c7cb424ec58f tempest-AbsoluteLimitsTests-1440509407 None] Flow 'volume_create_manager' (f7a3cb8b-09cd-4887-92eb-ff8bd72bbe3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:26:32 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7e0ea431-048a-466f-a15c-c7cb424ec58f tempest-AbsoluteLimitsTests-1440509407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9be8a097-99ce-498a-89b8-9f49113a8b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:26:32 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7e0ea431-048a-466f-a15c-c7cb424ec58f tempest-AbsoluteLimitsTests-1440509407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9be8a097-99ce-498a-89b8-9f49113a8b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-984283014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d3ccb65-8eec-4992-89bb-01e1ab3dc000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78ff96a71a59499a9ac5bb17f686fff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:26:32Z,use_quota=True,user_id='81d429d5d78a435b94b728292f6fd923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:26:32 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7e0ea431-048a-466f-a15c-c7cb424ec58f tempest-AbsoluteLimitsTests-1440509407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba5e25e-b2f1-4f5f-b8cb-c891c103b393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:26:32 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7e0ea431-048a-466f-a15c-c7cb424ec58f tempest-AbsoluteLimitsTests-1440509407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba5e25e-b2f1-4f5f-b8cb-c891c103b393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:26:32 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7e0ea431-048a-466f-a15c-c7cb424ec58f tempest-AbsoluteLimitsTests-1440509407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62d5e199-88e0-42fd-a4bd-37f1e0a134d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:26:32 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7e0ea431-048a-466f-a15c-c7cb424ec58f tempest-AbsoluteLimitsTests-1440509407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62d5e199-88e0-42fd-a4bd-37f1e0a134d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d3ccb65-8eec-4992-89bb-01e1ab3dc000', 'volume_name': 'volume-9d3ccb65-8eec-4992-89bb-01e1ab3dc000', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:26:32 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7e0ea431-048a-466f-a15c-c7cb424ec58f tempest-AbsoluteLimitsTests-1440509407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b30bc003-263e-41f1-9a13-11b453db3ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:26:32 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7e0ea431-048a-466f-a15c-c7cb424ec58f tempest-AbsoluteLimitsTests-1440509407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b30bc003-263e-41f1-9a13-11b453db3ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:26:32 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7e0ea431-048a-466f-a15c-c7cb424ec58f tempest-AbsoluteLimitsTests-1440509407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77b4acd4-7185-4b79-a769-3bfc5ad66f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:26:32 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-7e0ea431-048a-466f-a15c-c7cb424ec58f tempest-AbsoluteLimitsTests-1440509407 None] Volume 9d3ccb65-8eec-4992-89bb-01e1ab3dc000: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d3ccb65-8eec-4992-89bb-01e1ab3dc000', 'volume_size': 1} Jul 11 04:26:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7e0ea431-048a-466f-a15c-c7cb424ec58f tempest-AbsoluteLimitsTests-1440509407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:26:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7e0ea431-048a-466f-a15c-c7cb424ec58f tempest-AbsoluteLimitsTests-1440509407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:26:32 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7e0ea431-048a-466f-a15c-c7cb424ec58f tempest-AbsoluteLimitsTests-1440509407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-984283014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d3ccb65-8eec-4992-89bb-01e1ab3dc000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78ff96a71a59499a9ac5bb17f686fff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:26:32Z,use_quota=True,user_id='81d429d5d78a435b94b728292f6fd923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:26:32 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-7e0ea431-048a-466f-a15c-c7cb424ec58f tempest-AbsoluteLimitsTests-1440509407 None] Creating volume 9d3ccb65-8eec-4992-89bb-01e1ab3dc000 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:26:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7e0ea431-048a-466f-a15c-c7cb424ec58f tempest-AbsoluteLimitsTests-1440509407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:26:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7e0ea431-048a-466f-a15c-c7cb424ec58f tempest-AbsoluteLimitsTests-1440509407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:26:32 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7e0ea431-048a-466f-a15c-c7cb424ec58f tempest-AbsoluteLimitsTests-1440509407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:26:32 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7e0ea431-048a-466f-a15c-c7cb424ec58f tempest-AbsoluteLimitsTests-1440509407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:26:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7e0ea431-048a-466f-a15c-c7cb424ec58f tempest-AbsoluteLimitsTests-1440509407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:26:32 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7e0ea431-048a-466f-a15c-c7cb424ec58f tempest-AbsoluteLimitsTests-1440509407 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:26:32 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-7e0ea431-048a-466f-a15c-c7cb424ec58f tempest-AbsoluteLimitsTests-1440509407 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:26:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7e0ea431-048a-466f-a15c-c7cb424ec58f tempest-AbsoluteLimitsTests-1440509407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9d3ccb65-8eec-4992-89bb-01e1ab3dc000 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:26:32 devstack sudo[90704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9d3ccb65-8eec-4992-89bb-01e1ab3dc000 1073741824 Jul 11 04:26:32 devstack sudo[90704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:26:33 devstack sudo[90704]: pam_unix(sudo:session): session closed for user root Jul 11 04:26:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7e0ea431-048a-466f-a15c-c7cb424ec58f tempest-AbsoluteLimitsTests-1440509407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9d3ccb65-8eec-4992-89bb-01e1ab3dc000 1073741824" returned: 0 in 0.926s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:26:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7e0ea431-048a-466f-a15c-c7cb424ec58f tempest-AbsoluteLimitsTests-1440509407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9d3ccb65-8eec-4992-89bb-01e1ab3dc000 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:26:33 devstack sudo[90710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9d3ccb65-8eec-4992-89bb-01e1ab3dc000 Jul 11 04:26:33 devstack sudo[90710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:26:33 devstack sudo[90710]: pam_unix(sudo:session): session closed for user root Jul 11 04:26:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7e0ea431-048a-466f-a15c-c7cb424ec58f tempest-AbsoluteLimitsTests-1440509407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9d3ccb65-8eec-4992-89bb-01e1ab3dc000" returned: 0 in 0.724s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:26:33 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7e0ea431-048a-466f-a15c-c7cb424ec58f tempest-AbsoluteLimitsTests-1440509407 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:26:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7e0ea431-048a-466f-a15c-c7cb424ec58f tempest-AbsoluteLimitsTests-1440509407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:26:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7e0ea431-048a-466f-a15c-c7cb424ec58f tempest-AbsoluteLimitsTests-1440509407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77b4acd4-7185-4b79-a769-3bfc5ad66f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d3ccb65-8eec-4992-89bb-01e1ab3dc000', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:26:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7e0ea431-048a-466f-a15c-c7cb424ec58f tempest-AbsoluteLimitsTests-1440509407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32f63ef3-e1b9-4fe6-be32-1885d3a0229b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:26:33 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-7e0ea431-048a-466f-a15c-c7cb424ec58f tempest-AbsoluteLimitsTests-1440509407 None] Volume volume-9d3ccb65-8eec-4992-89bb-01e1ab3dc000 (9d3ccb65-8eec-4992-89bb-01e1ab3dc000): created successfully Jul 11 04:26:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7e0ea431-048a-466f-a15c-c7cb424ec58f tempest-AbsoluteLimitsTests-1440509407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32f63ef3-e1b9-4fe6-be32-1885d3a0229b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:26:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7e0ea431-048a-466f-a15c-c7cb424ec58f tempest-AbsoluteLimitsTests-1440509407 None] Flow 'volume_create_manager' (f7a3cb8b-09cd-4887-92eb-ff8bd72bbe3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:26:34 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-7e0ea431-048a-466f-a15c-c7cb424ec58f tempest-AbsoluteLimitsTests-1440509407 None] Created volume successfully. Jul 11 04:26:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d95d2f4c-e989-4825-b365-c4eaca2fd4c2 tempest-AbsoluteLimitsTests-1440509407 None] Acquiring lock "cinder-9d3ccb65-8eec-4992-89bb-01e1ab3dc000-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:26:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d95d2f4c-e989-4825-b365-c4eaca2fd4c2 tempest-AbsoluteLimitsTests-1440509407 None] Lock "cinder-9d3ccb65-8eec-4992-89bb-01e1ab3dc000-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:26:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d95d2f4c-e989-4825-b365-c4eaca2fd4c2 tempest-AbsoluteLimitsTests-1440509407 None] Acquiring lock "cinder-quobyte-9d3ccb65-8eec-4992-89bb-01e1ab3dc000" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:26:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d95d2f4c-e989-4825-b365-c4eaca2fd4c2 tempest-AbsoluteLimitsTests-1440509407 None] Lock "cinder-quobyte-9d3ccb65-8eec-4992-89bb-01e1ab3dc000" acquired by "delete_volume" :: waited 0.020s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:26:34 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc70f78-dff5-42db-8af3-d6258abc63f6]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:26:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d95d2f4c-e989-4825-b365-c4eaca2fd4c2 tempest-AbsoluteLimitsTests-1440509407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9d3ccb65-8eec-4992-89bb-01e1ab3dc000 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:26:34 devstack sudo[90714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9d3ccb65-8eec-4992-89bb-01e1ab3dc000 Jul 11 04:26:34 devstack sudo[90714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:26:35 devstack sudo[90714]: pam_unix(sudo:session): session closed for user root Jul 11 04:26:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d95d2f4c-e989-4825-b365-c4eaca2fd4c2 tempest-AbsoluteLimitsTests-1440509407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9d3ccb65-8eec-4992-89bb-01e1ab3dc000" returned: 0 in 1.029s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:26:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d95d2f4c-e989-4825-b365-c4eaca2fd4c2 tempest-AbsoluteLimitsTests-1440509407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9d3ccb65-8eec-4992-89bb-01e1ab3dc000 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:26:35 devstack sudo[90720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9d3ccb65-8eec-4992-89bb-01e1ab3dc000 Jul 11 04:26:35 devstack sudo[90720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:26:36 devstack sudo[90720]: pam_unix(sudo:session): session closed for user root Jul 11 04:26:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d95d2f4c-e989-4825-b365-c4eaca2fd4c2 tempest-AbsoluteLimitsTests-1440509407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9d3ccb65-8eec-4992-89bb-01e1ab3dc000" returned: 0 in 0.781s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:26:36 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d95d2f4c-e989-4825-b365-c4eaca2fd4c2 tempest-AbsoluteLimitsTests-1440509407 None] Lock "cinder-quobyte-9d3ccb65-8eec-4992-89bb-01e1ab3dc000" released by "delete_volume" :: held 1.884s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:26:36 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-d95d2f4c-e989-4825-b365-c4eaca2fd4c2 tempest-AbsoluteLimitsTests-1440509407 None] Created reservations ['cd2f1213-3d56-49c1-ba7e-1bc159181d3d', '77b42171-df66-46bb-bb61-37c085c400f4', '07a8e733-0bcb-4c48-ae62-dbb310795391', 'f8104001-490f-47b2-9fd4-74be1112c40f'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:26:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d95d2f4c-e989-4825-b365-c4eaca2fd4c2 tempest-AbsoluteLimitsTests-1440509407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:26:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d95d2f4c-e989-4825-b365-c4eaca2fd4c2 tempest-AbsoluteLimitsTests-1440509407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:26:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-d95d2f4c-e989-4825-b365-c4eaca2fd4c2 tempest-AbsoluteLimitsTests-1440509407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:26:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-d95d2f4c-e989-4825-b365-c4eaca2fd4c2 tempest-AbsoluteLimitsTests-1440509407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:26:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d95d2f4c-e989-4825-b365-c4eaca2fd4c2 tempest-AbsoluteLimitsTests-1440509407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:26:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d95d2f4c-e989-4825-b365-c4eaca2fd4c2 tempest-AbsoluteLimitsTests-1440509407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:26:36 devstack sudo[90736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:26:36 devstack sudo[90736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:26:37 devstack sudo[90736]: pam_unix(sudo:session): session closed for user root Jul 11 04:26:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d95d2f4c-e989-4825-b365-c4eaca2fd4c2 tempest-AbsoluteLimitsTests-1440509407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.911s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:26:37 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-d95d2f4c-e989-4825-b365-c4eaca2fd4c2 tempest-AbsoluteLimitsTests-1440509407 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:26:37 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-d95d2f4c-e989-4825-b365-c4eaca2fd4c2 tempest-AbsoluteLimitsTests-1440509407 None] Deleted volume successfully. Jul 11 04:26:37 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d95d2f4c-e989-4825-b365-c4eaca2fd4c2 tempest-AbsoluteLimitsTests-1440509407 None] Lock "cinder-9d3ccb65-8eec-4992-89bb-01e1ab3dc000-delete_volume" released by "delete_volume" :: held 3.115s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:26:44 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-02f30f0f-d4bb-492e-a529-fb7e97fc6c96 tempest-VolumesDeleteCascade-1995094936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:26:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-02f30f0f-d4bb-492e-a529-fb7e97fc6c96 tempest-VolumesDeleteCascade-1995094936 None] Flow 'volume_create_manager' (44b4626c-4a37-4e26-aeac-bbf7facbebbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:26:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-02f30f0f-d4bb-492e-a529-fb7e97fc6c96 tempest-VolumesDeleteCascade-1995094936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6fcfe20-2b49-44df-bc0c-da79f553a061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:26:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-02f30f0f-d4bb-492e-a529-fb7e97fc6c96 tempest-VolumesDeleteCascade-1995094936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6fcfe20-2b49-44df-bc0c-da79f553a061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1395656860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=395c4cfe-774d-47c5-85c0-ada5d438c0a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b60f6f148da14eacbec855c331e0c043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:26:44Z,use_quota=True,user_id='c00ac0b624b0469e921cb7e03839168c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:26:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-02f30f0f-d4bb-492e-a529-fb7e97fc6c96 tempest-VolumesDeleteCascade-1995094936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c94f0078-d35f-4eec-a1a2-b602955bef4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:26:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-02f30f0f-d4bb-492e-a529-fb7e97fc6c96 tempest-VolumesDeleteCascade-1995094936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c94f0078-d35f-4eec-a1a2-b602955bef4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:26:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-02f30f0f-d4bb-492e-a529-fb7e97fc6c96 tempest-VolumesDeleteCascade-1995094936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61abc35a-92e8-41f7-b46c-946207b4eb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:26:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-02f30f0f-d4bb-492e-a529-fb7e97fc6c96 tempest-VolumesDeleteCascade-1995094936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61abc35a-92e8-41f7-b46c-946207b4eb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '395c4cfe-774d-47c5-85c0-ada5d438c0a4', 'volume_name': 'volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:26:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-02f30f0f-d4bb-492e-a529-fb7e97fc6c96 tempest-VolumesDeleteCascade-1995094936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7629a61e-ab6c-4583-9798-670d70ecaede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:26:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-02f30f0f-d4bb-492e-a529-fb7e97fc6c96 tempest-VolumesDeleteCascade-1995094936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7629a61e-ab6c-4583-9798-670d70ecaede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:26:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-02f30f0f-d4bb-492e-a529-fb7e97fc6c96 tempest-VolumesDeleteCascade-1995094936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d182e4f-a1e4-4447-97a2-79ba5f8c3e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:26:44 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-02f30f0f-d4bb-492e-a529-fb7e97fc6c96 tempest-VolumesDeleteCascade-1995094936 None] Volume 395c4cfe-774d-47c5-85c0-ada5d438c0a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4', 'volume_size': 1} Jul 11 04:26:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-02f30f0f-d4bb-492e-a529-fb7e97fc6c96 tempest-VolumesDeleteCascade-1995094936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:26:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-02f30f0f-d4bb-492e-a529-fb7e97fc6c96 tempest-VolumesDeleteCascade-1995094936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:26:44 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-02f30f0f-d4bb-492e-a529-fb7e97fc6c96 tempest-VolumesDeleteCascade-1995094936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1395656860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=395c4cfe-774d-47c5-85c0-ada5d438c0a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b60f6f148da14eacbec855c331e0c043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:26:44Z,use_quota=True,user_id='c00ac0b624b0469e921cb7e03839168c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:26:44 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-02f30f0f-d4bb-492e-a529-fb7e97fc6c96 tempest-VolumesDeleteCascade-1995094936 None] Creating volume 395c4cfe-774d-47c5-85c0-ada5d438c0a4 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:26:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-02f30f0f-d4bb-492e-a529-fb7e97fc6c96 tempest-VolumesDeleteCascade-1995094936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:26:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-02f30f0f-d4bb-492e-a529-fb7e97fc6c96 tempest-VolumesDeleteCascade-1995094936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:26:44 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-02f30f0f-d4bb-492e-a529-fb7e97fc6c96 tempest-VolumesDeleteCascade-1995094936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:26:44 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-02f30f0f-d4bb-492e-a529-fb7e97fc6c96 tempest-VolumesDeleteCascade-1995094936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:26:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-02f30f0f-d4bb-492e-a529-fb7e97fc6c96 tempest-VolumesDeleteCascade-1995094936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:26:44 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-02f30f0f-d4bb-492e-a529-fb7e97fc6c96 tempest-VolumesDeleteCascade-1995094936 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:26:44 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-02f30f0f-d4bb-492e-a529-fb7e97fc6c96 tempest-VolumesDeleteCascade-1995094936 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:26:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-02f30f0f-d4bb-492e-a529-fb7e97fc6c96 tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:26:44 devstack sudo[90798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4 1073741824 Jul 11 04:26:44 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:26:45 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root Jul 11 04:26:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-02f30f0f-d4bb-492e-a529-fb7e97fc6c96 tempest-VolumesDeleteCascade-1995094936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4 1073741824" returned: 0 in 1.080s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:26:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-02f30f0f-d4bb-492e-a529-fb7e97fc6c96 tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:26:45 devstack sudo[90819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4 Jul 11 04:26:45 devstack sudo[90819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:26:46 devstack sudo[90819]: pam_unix(sudo:session): session closed for user root Jul 11 04:26:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-02f30f0f-d4bb-492e-a529-fb7e97fc6c96 tempest-VolumesDeleteCascade-1995094936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4" returned: 0 in 0.955s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:26:46 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-02f30f0f-d4bb-492e-a529-fb7e97fc6c96 tempest-VolumesDeleteCascade-1995094936 None] <== create_volume: return (2082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:26:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-02f30f0f-d4bb-492e-a529-fb7e97fc6c96 tempest-VolumesDeleteCascade-1995094936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.088s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:26:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-02f30f0f-d4bb-492e-a529-fb7e97fc6c96 tempest-VolumesDeleteCascade-1995094936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d182e4f-a1e4-4447-97a2-79ba5f8c3e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:26:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-02f30f0f-d4bb-492e-a529-fb7e97fc6c96 tempest-VolumesDeleteCascade-1995094936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9629446-0534-41bc-b913-597d254a95bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:26:46 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-02f30f0f-d4bb-492e-a529-fb7e97fc6c96 tempest-VolumesDeleteCascade-1995094936 None] Volume volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4 (395c4cfe-774d-47c5-85c0-ada5d438c0a4): created successfully Jul 11 04:26:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-02f30f0f-d4bb-492e-a529-fb7e97fc6c96 tempest-VolumesDeleteCascade-1995094936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9629446-0534-41bc-b913-597d254a95bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:26:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-02f30f0f-d4bb-492e-a529-fb7e97fc6c96 tempest-VolumesDeleteCascade-1995094936 None] Flow 'volume_create_manager' (44b4626c-4a37-4e26-aeac-bbf7facbebbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:26:46 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-02f30f0f-d4bb-492e-a529-fb7e97fc6c96 tempest-VolumesDeleteCascade-1995094936 None] Created volume successfully. Jul 11 04:26:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-12ebbabe-7aa3-4606-94cb-4d191a6b74cb tempest-VolumesDeleteCascade-1995094936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:26:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-12ebbabe-7aa3-4606-94cb-4d191a6b74cb tempest-VolumesDeleteCascade-1995094936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:26:47 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-12ebbabe-7aa3-4606-94cb-4d191a6b74cb tempest-VolumesDeleteCascade-1995094936 None] Creating offline snapshot f26014a5-d92e-4d17-86ab-e0c5c4942367 of volume 395c4cfe-774d-47c5-85c0-ada5d438c0a4 {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:26:47 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[306378eb-ae74-4899-b4ac-4fdcc978e9b4]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:26:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-12ebbabe-7aa3-4606-94cb-4d191a6b74cb tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:26:47 devstack sudo[90911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4 Jul 11 04:26:47 devstack sudo[90911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:26:49 devstack sudo[90911]: pam_unix(sudo:session): session closed for user root Jul 11 04:26:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-12ebbabe-7aa3-4606-94cb-4d191a6b74cb tempest-VolumesDeleteCascade-1995094936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4" returned: 0 in 1.301s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:26:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-12ebbabe-7aa3-4606-94cb-4d191a6b74cb tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.f26014a5-d92e-4d17-86ab-e0c5c4942367 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:26:49 devstack sudo[90921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.f26014a5-d92e-4d17-86ab-e0c5c4942367 1G Jul 11 04:26:49 devstack sudo[90921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:26:50 devstack sudo[90921]: pam_unix(sudo:session): session closed for user root Jul 11 04:26:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-12ebbabe-7aa3-4606-94cb-4d191a6b74cb tempest-VolumesDeleteCascade-1995094936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.f26014a5-d92e-4d17-86ab-e0c5c4942367 1G" returned: 0 in 1.409s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:26:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-12ebbabe-7aa3-4606-94cb-4d191a6b74cb tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.f26014a5-d92e-4d17-86ab-e0c5c4942367 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:26:50 devstack sudo[90929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.f26014a5-d92e-4d17-86ab-e0c5c4942367 Jul 11 04:26:50 devstack sudo[90929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:26:51 devstack sudo[90929]: pam_unix(sudo:session): session closed for user root Jul 11 04:26:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-12ebbabe-7aa3-4606-94cb-4d191a6b74cb tempest-VolumesDeleteCascade-1995094936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.f26014a5-d92e-4d17-86ab-e0c5c4942367" returned: 0 in 1.007s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:26:51 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-12ebbabe-7aa3-4606-94cb-4d191a6b74cb tempest-VolumesDeleteCascade-1995094936 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.f26014a5-d92e-4d17-86ab-e0c5c4942367 is being set with open permissions: ugo+rw Jul 11 04:26:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-12ebbabe-7aa3-4606-94cb-4d191a6b74cb tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.f26014a5-d92e-4d17-86ab-e0c5c4942367 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:26:51 devstack sudo[90936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.f26014a5-d92e-4d17-86ab-e0c5c4942367 Jul 11 04:26:51 devstack sudo[90936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:26:52 devstack sudo[90936]: pam_unix(sudo:session): session closed for user root Jul 11 04:26:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-12ebbabe-7aa3-4606-94cb-4d191a6b74cb tempest-VolumesDeleteCascade-1995094936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.f26014a5-d92e-4d17-86ab-e0c5c4942367" returned: 0 in 0.976s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:26:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-12ebbabe-7aa3-4606-94cb-4d191a6b74cb tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:26:52 devstack sudo[90941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.info Jul 11 04:26:52 devstack sudo[90941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:26:53 devstack sudo[90941]: pam_unix(sudo:session): session closed for user root Jul 11 04:26:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-12ebbabe-7aa3-4606-94cb-4d191a6b74cb tempest-VolumesDeleteCascade-1995094936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.info" returned: 0 in 1.329s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:26:53 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-12ebbabe-7aa3-4606-94cb-4d191a6b74cb tempest-VolumesDeleteCascade-1995094936 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.info is being set with open permissions: ugo+rw Jul 11 04:26:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-12ebbabe-7aa3-4606-94cb-4d191a6b74cb tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:26:53 devstack sudo[90945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.info Jul 11 04:26:53 devstack sudo[90945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:26:55 devstack sudo[90945]: pam_unix(sudo:session): session closed for user root Jul 11 04:26:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-12ebbabe-7aa3-4606-94cb-4d191a6b74cb tempest-VolumesDeleteCascade-1995094936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.info" returned: 0 in 1.321s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:26:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-12ebbabe-7aa3-4606-94cb-4d191a6b74cb tempest-VolumesDeleteCascade-1995094936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.625s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:26:55 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-12ebbabe-7aa3-4606-94cb-4d191a6b74cb tempest-VolumesDeleteCascade-1995094936 None] Create snapshot completed successfully Jul 11 04:26:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a9b02cc6-a3e5-4d64-bbf9-22814a797716 tempest-VolumesDeleteCascade-1995094936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:26:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a9b02cc6-a3e5-4d64-bbf9-22814a797716 tempest-VolumesDeleteCascade-1995094936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:26:56 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-a9b02cc6-a3e5-4d64-bbf9-22814a797716 tempest-VolumesDeleteCascade-1995094936 None] Creating offline snapshot 4f7adca8-d97c-4cc5-81ee-09154d827aea of volume 395c4cfe-774d-47c5-85c0-ada5d438c0a4 {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:26:56 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea302337-ebcc-4e8b-9558-87816d69863e]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:26:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a9b02cc6-a3e5-4d64-bbf9-22814a797716 tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.f26014a5-d92e-4d17-86ab-e0c5c4942367 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:26:56 devstack sudo[90972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.f26014a5-d92e-4d17-86ab-e0c5c4942367 Jul 11 04:26:56 devstack sudo[90972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:26:57 devstack sudo[90972]: pam_unix(sudo:session): session closed for user root Jul 11 04:26:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a9b02cc6-a3e5-4d64-bbf9-22814a797716 tempest-VolumesDeleteCascade-1995094936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.f26014a5-d92e-4d17-86ab-e0c5c4942367" returned: 0 in 0.932s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:26:57 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-a9b02cc6-a3e5-4d64-bbf9-22814a797716 tempest-VolumesDeleteCascade-1995094936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:26:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a9b02cc6-a3e5-4d64-bbf9-22814a797716 tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.f26014a5-d92e-4d17-86ab-e0c5c4942367,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.4f7adca8-d97c-4cc5-81ee-09154d827aea 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:26:57 devstack sudo[90978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.f26014a5-d92e-4d17-86ab-e0c5c4942367,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.4f7adca8-d97c-4cc5-81ee-09154d827aea 1G Jul 11 04:26:57 devstack sudo[90978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:26:58 devstack sudo[90978]: pam_unix(sudo:session): session closed for user root Jul 11 04:26:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a9b02cc6-a3e5-4d64-bbf9-22814a797716 tempest-VolumesDeleteCascade-1995094936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.f26014a5-d92e-4d17-86ab-e0c5c4942367,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.4f7adca8-d97c-4cc5-81ee-09154d827aea 1G" returned: 0 in 0.957s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:26:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a9b02cc6-a3e5-4d64-bbf9-22814a797716 tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.f26014a5-d92e-4d17-86ab-e0c5c4942367 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.4f7adca8-d97c-4cc5-81ee-09154d827aea {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:26:58 devstack sudo[91018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.f26014a5-d92e-4d17-86ab-e0c5c4942367 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.4f7adca8-d97c-4cc5-81ee-09154d827aea Jul 11 04:26:58 devstack sudo[91018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:26:59 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:26:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:26:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:26:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:26:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:26:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:26:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:26:59 devstack sudo[91022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:26:59 devstack sudo[91022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:26:59 devstack sudo[91018]: pam_unix(sudo:session): session closed for user root Jul 11 04:26:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a9b02cc6-a3e5-4d64-bbf9-22814a797716 tempest-VolumesDeleteCascade-1995094936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.f26014a5-d92e-4d17-86ab-e0c5c4942367 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.4f7adca8-d97c-4cc5-81ee-09154d827aea" returned: 0 in 0.994s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:26:59 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-a9b02cc6-a3e5-4d64-bbf9-22814a797716 tempest-VolumesDeleteCascade-1995094936 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.4f7adca8-d97c-4cc5-81ee-09154d827aea is being set with open permissions: ugo+rw Jul 11 04:26:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a9b02cc6-a3e5-4d64-bbf9-22814a797716 tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.4f7adca8-d97c-4cc5-81ee-09154d827aea {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:26:59 devstack sudo[91027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.4f7adca8-d97c-4cc5-81ee-09154d827aea Jul 11 04:26:59 devstack sudo[91027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:00 devstack sudo[91022]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 1.573s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:00 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:27:00 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager._thread_info {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:27:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread count: 8 {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:27:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread info: [<_MainThread(MainThread, started 124675027595392)>, , , , , , , ] {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:27:01 devstack sudo[91027]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a9b02cc6-a3e5-4d64-bbf9-22814a797716 tempest-VolumesDeleteCascade-1995094936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.4f7adca8-d97c-4cc5-81ee-09154d827aea" returned: 0 in 1.689s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a9b02cc6-a3e5-4d64-bbf9-22814a797716 tempest-VolumesDeleteCascade-1995094936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.699s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:27:01 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-a9b02cc6-a3e5-4d64-bbf9-22814a797716 tempest-VolumesDeleteCascade-1995094936 None] Create snapshot completed successfully Jul 11 04:27:02 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Acquiring lock "cinder-395c4cfe-774d-47c5-85c0-ada5d438c0a4-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:27:02 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Lock "cinder-395c4cfe-774d-47c5-85c0-ada5d438c0a4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:27:02 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Performing cascade delete. {{(pid=86964) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 11 04:27:02 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Acquiring lock "cinder-4f7adca8-d97c-4cc5-81ee-09154d827aea-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:27:02 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Lock "cinder-4f7adca8-d97c-4cc5-81ee-09154d827aea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:27:02 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Acquiring lock "cinder-quobyte-395c4cfe-774d-47c5-85c0-ada5d438c0a4" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:27:02 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Lock "cinder-quobyte-395c4cfe-774d-47c5-85c0-ada5d438c0a4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:27:02 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Acquiring lock "cinder-quobyte-4f7adca8-d97c-4cc5-81ee-09154d827aea" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:27:02 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Lock "cinder-quobyte-4f7adca8-d97c-4cc5-81ee-09154d827aea" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:27:02 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Deleting offline snapshot 4f7adca8-d97c-4cc5-81ee-09154d827aea of volume 395c4cfe-774d-47c5-85c0-ada5d438c0a4 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:27:02 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] snapshot_file for this snap is: volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.4f7adca8-d97c-4cc5-81ee-09154d827aea {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:27:02 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f023d1-9283-45e9-a3a7-835434138259]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:27:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.4f7adca8-d97c-4cc5-81ee-09154d827aea {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:02 devstack sudo[91119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.4f7adca8-d97c-4cc5-81ee-09154d827aea Jul 11 04:27:02 devstack sudo[91119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:03 devstack sudo[91119]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.4f7adca8-d97c-4cc5-81ee-09154d827aea" returned: 0 in 0.959s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:03 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:27:03 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6e5064-9a2d-4fe4-a41e-b9dc1b93c82b]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:27:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.f26014a5-d92e-4d17-86ab-e0c5c4942367 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:03 devstack sudo[91129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.f26014a5-d92e-4d17-86ab-e0c5c4942367 Jul 11 04:27:03 devstack sudo[91129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:04 devstack sudo[91129]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.f26014a5-d92e-4d17-86ab-e0c5c4942367" returned: 0 in 0.808s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:04 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:27:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.4f7adca8-d97c-4cc5-81ee-09154d827aea {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:04 devstack sudo[91163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.4f7adca8-d97c-4cc5-81ee-09154d827aea Jul 11 04:27:04 devstack sudo[91163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:05 devstack sudo[91163]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.4f7adca8-d97c-4cc5-81ee-09154d827aea" returned: 0 in 0.956s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.4f7adca8-d97c-4cc5-81ee-09154d827aea {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:05 devstack sudo[91194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.4f7adca8-d97c-4cc5-81ee-09154d827aea Jul 11 04:27:05 devstack sudo[91194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:05 devstack sudo[91194]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.4f7adca8-d97c-4cc5-81ee-09154d827aea" returned: 0 in 0.728s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:05 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Lock "cinder-quobyte-4f7adca8-d97c-4cc5-81ee-09154d827aea" released by "_delete_snapshot" :: held 3.602s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:27:06 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Lock "cinder-quobyte-395c4cfe-774d-47c5-85c0-ada5d438c0a4" released by "delete_snapshot" :: held 3.637s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:27:06 devstack cinder-volume[86964]: WARNING cinder.quota [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:27:06 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Created reservations ['25f004ff-5165-4526-881e-d298e1624d66', '0c4753a4-5d3d-4536-92c2-008b45057361', '3cd64546-9797-449f-a302-b567bb26ff9b', '1d2ed320-6d60-4480-be38-53ee9c37a40a'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:27:06 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Delete snapshot completed successfully. Jul 11 04:27:06 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Lock "cinder-4f7adca8-d97c-4cc5-81ee-09154d827aea-delete_snapshot" released by "delete_snapshot" :: held 3.793s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:27:06 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Acquiring lock "cinder-f26014a5-d92e-4d17-86ab-e0c5c4942367-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:27:06 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Lock "cinder-f26014a5-d92e-4d17-86ab-e0c5c4942367-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:27:06 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Acquiring lock "cinder-quobyte-395c4cfe-774d-47c5-85c0-ada5d438c0a4" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:27:06 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Lock "cinder-quobyte-395c4cfe-774d-47c5-85c0-ada5d438c0a4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:27:06 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Acquiring lock "cinder-quobyte-f26014a5-d92e-4d17-86ab-e0c5c4942367" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:27:06 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Lock "cinder-quobyte-f26014a5-d92e-4d17-86ab-e0c5c4942367" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:27:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Deleting offline snapshot f26014a5-d92e-4d17-86ab-e0c5c4942367 of volume 395c4cfe-774d-47c5-85c0-ada5d438c0a4 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:27:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] snapshot_file for this snap is: volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.f26014a5-d92e-4d17-86ab-e0c5c4942367 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:27:06 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ba95fb-2fc3-4011-b78d-3e22aaa73943]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:27:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.f26014a5-d92e-4d17-86ab-e0c5c4942367 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:06 devstack sudo[91204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.f26014a5-d92e-4d17-86ab-e0c5c4942367 Jul 11 04:27:06 devstack sudo[91204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:07 devstack sudo[91204]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.f26014a5-d92e-4d17-86ab-e0c5c4942367" returned: 0 in 0.897s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:07 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:27:07 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cb3605-0b5d-4193-95f5-f94565d37861]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:27:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:07 devstack sudo[91211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4 Jul 11 04:27:07 devstack sudo[91211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:07 devstack sudo[91211]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4" returned: 0 in 0.795s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.f26014a5-d92e-4d17-86ab-e0c5c4942367 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:07 devstack sudo[91216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.f26014a5-d92e-4d17-86ab-e0c5c4942367 Jul 11 04:27:07 devstack sudo[91216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:08 devstack sudo[91216]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.f26014a5-d92e-4d17-86ab-e0c5c4942367" returned: 0 in 0.920s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.f26014a5-d92e-4d17-86ab-e0c5c4942367 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:08 devstack sudo[91226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.f26014a5-d92e-4d17-86ab-e0c5c4942367 Jul 11 04:27:08 devstack sudo[91226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:09 devstack sudo[91226]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4.f26014a5-d92e-4d17-86ab-e0c5c4942367" returned: 0 in 0.739s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:09 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Lock "cinder-quobyte-f26014a5-d92e-4d17-86ab-e0c5c4942367" released by "_delete_snapshot" :: held 3.474s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:27:09 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Lock "cinder-quobyte-395c4cfe-774d-47c5-85c0-ada5d438c0a4" released by "delete_snapshot" :: held 3.502s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:27:09 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Created reservations ['c38b800a-604e-4b84-8316-52e9d2b67b25', '0fe93d52-39eb-4282-ada3-44b50622a7d0', '7d7fe564-6df4-4c15-a349-c9dc3c3242f9', 'f5f7797e-be3d-4c8f-b062-894b4bd91ae1'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:27:09 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Delete snapshot completed successfully. Jul 11 04:27:09 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Lock "cinder-f26014a5-d92e-4d17-86ab-e0c5c4942367-delete_snapshot" released by "delete_snapshot" :: held 3.700s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:27:09 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Snapshots deleted, issuing volume delete {{(pid=86964) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 11 04:27:09 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Acquiring lock "cinder-quobyte-395c4cfe-774d-47c5-85c0-ada5d438c0a4" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:27:09 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Lock "cinder-quobyte-395c4cfe-774d-47c5-85c0-ada5d438c0a4" acquired by "delete_volume" :: waited 0.029s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:27:09 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f8fb9b-49d8-44de-97bf-d9fc81daf0cc]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:27:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:10 devstack sudo[91229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4 Jul 11 04:27:10 devstack sudo[91229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:10 devstack sudo[91229]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4" returned: 0 in 0.884s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:10 devstack sudo[91236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4 Jul 11 04:27:10 devstack sudo[91236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:12 devstack sudo[91236]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-395c4cfe-774d-47c5-85c0-ada5d438c0a4" returned: 0 in 1.172s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:12 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Lock "cinder-quobyte-395c4cfe-774d-47c5-85c0-ada5d438c0a4" released by "delete_volume" :: held 2.175s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:27:12 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Created reservations ['e33477c6-1047-423f-9c37-ada01ff8ade2', '5f9a099a-257b-41c3-9c14-3b80ad3a61f7', 'df533511-40d7-4db6-82ad-f2863625ba7d', '1881e4e6-aa17-42e1-acb4-74cc1fba2d15'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:27:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:27:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:27:12 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:27:12 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:27:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:27:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:12 devstack sudo[91241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:27:12 devstack sudo[91241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:13 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6a2307b-72f6-4e8d-ab78-6559932048b2 tempest-ServerActionsTestOtherA-1035839598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:27:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f6a2307b-72f6-4e8d-ab78-6559932048b2 tempest-ServerActionsTestOtherA-1035839598 None] Flow 'volume_create_manager' (c7b4b194-c6aa-444f-a3ee-7a1e612d9a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:27:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f6a2307b-72f6-4e8d-ab78-6559932048b2 tempest-ServerActionsTestOtherA-1035839598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caec453e-bc47-4943-b539-01bf2da63df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f6a2307b-72f6-4e8d-ab78-6559932048b2 tempest-ServerActionsTestOtherA-1035839598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caec453e-bc47-4943-b539-01bf2da63df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-38360601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db52474-5f6d-4c6d-93be-ef4e54a2a54b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1708b6409da4b8caf72201e0f755526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:27:13Z,use_quota=True,user_id='9d3d9688a5b34ea8aae11a75b53ee329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f6a2307b-72f6-4e8d-ab78-6559932048b2 tempest-ServerActionsTestOtherA-1035839598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a262165-2c0c-4f65-a4fe-32ea5a64ee26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f6a2307b-72f6-4e8d-ab78-6559932048b2 tempest-ServerActionsTestOtherA-1035839598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a262165-2c0c-4f65-a4fe-32ea5a64ee26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f6a2307b-72f6-4e8d-ab78-6559932048b2 tempest-ServerActionsTestOtherA-1035839598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8182d92e-a76c-41e2-9f0b-a2629956cf91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f6a2307b-72f6-4e8d-ab78-6559932048b2 tempest-ServerActionsTestOtherA-1035839598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8182d92e-a76c-41e2-9f0b-a2629956cf91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0db52474-5f6d-4c6d-93be-ef4e54a2a54b', 'volume_name': 'volume-0db52474-5f6d-4c6d-93be-ef4e54a2a54b', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f6a2307b-72f6-4e8d-ab78-6559932048b2 tempest-ServerActionsTestOtherA-1035839598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c3cac8c-af9a-4343-8b5d-4b7efe252a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f6a2307b-72f6-4e8d-ab78-6559932048b2 tempest-ServerActionsTestOtherA-1035839598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c3cac8c-af9a-4343-8b5d-4b7efe252a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f6a2307b-72f6-4e8d-ab78-6559932048b2 tempest-ServerActionsTestOtherA-1035839598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb8df743-2875-456a-a1a8-a65937100d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:13 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-f6a2307b-72f6-4e8d-ab78-6559932048b2 tempest-ServerActionsTestOtherA-1035839598 None] Volume 0db52474-5f6d-4c6d-93be-ef4e54a2a54b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0db52474-5f6d-4c6d-93be-ef4e54a2a54b', 'volume_size': 1} Jul 11 04:27:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f6a2307b-72f6-4e8d-ab78-6559932048b2 tempest-ServerActionsTestOtherA-1035839598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:27:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f6a2307b-72f6-4e8d-ab78-6559932048b2 tempest-ServerActionsTestOtherA-1035839598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:27:13 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-f6a2307b-72f6-4e8d-ab78-6559932048b2 tempest-ServerActionsTestOtherA-1035839598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-38360601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db52474-5f6d-4c6d-93be-ef4e54a2a54b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1708b6409da4b8caf72201e0f755526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:27:13Z,use_quota=True,user_id='9d3d9688a5b34ea8aae11a75b53ee329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:27:13 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-f6a2307b-72f6-4e8d-ab78-6559932048b2 tempest-ServerActionsTestOtherA-1035839598 None] Creating volume 0db52474-5f6d-4c6d-93be-ef4e54a2a54b {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:27:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f6a2307b-72f6-4e8d-ab78-6559932048b2 tempest-ServerActionsTestOtherA-1035839598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:27:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f6a2307b-72f6-4e8d-ab78-6559932048b2 tempest-ServerActionsTestOtherA-1035839598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:27:13 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-f6a2307b-72f6-4e8d-ab78-6559932048b2 tempest-ServerActionsTestOtherA-1035839598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:27:13 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-f6a2307b-72f6-4e8d-ab78-6559932048b2 tempest-ServerActionsTestOtherA-1035839598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:27:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f6a2307b-72f6-4e8d-ab78-6559932048b2 tempest-ServerActionsTestOtherA-1035839598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:27:13 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-f6a2307b-72f6-4e8d-ab78-6559932048b2 tempest-ServerActionsTestOtherA-1035839598 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:27:13 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-f6a2307b-72f6-4e8d-ab78-6559932048b2 tempest-ServerActionsTestOtherA-1035839598 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:27:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f6a2307b-72f6-4e8d-ab78-6559932048b2 tempest-ServerActionsTestOtherA-1035839598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0db52474-5f6d-4c6d-93be-ef4e54a2a54b 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:13 devstack sudo[91244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0db52474-5f6d-4c6d-93be-ef4e54a2a54b 1073741824 Jul 11 04:27:13 devstack sudo[91244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:14 devstack sudo[91241]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 1.690s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:14 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:27:14 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Deleted volume successfully. Jul 11 04:27:14 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ad6767a7-4567-4c79-adc1-dbaa06a635b2 tempest-VolumesDeleteCascade-1995094936 None] Lock "cinder-395c4cfe-774d-47c5-85c0-ada5d438c0a4-delete_volume" released by "delete_volume" :: held 11.991s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:27:15 devstack sudo[91244]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f6a2307b-72f6-4e8d-ab78-6559932048b2 tempest-ServerActionsTestOtherA-1035839598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0db52474-5f6d-4c6d-93be-ef4e54a2a54b 1073741824" returned: 0 in 2.167s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f6a2307b-72f6-4e8d-ab78-6559932048b2 tempest-ServerActionsTestOtherA-1035839598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0db52474-5f6d-4c6d-93be-ef4e54a2a54b {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:15 devstack sudo[91285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0db52474-5f6d-4c6d-93be-ef4e54a2a54b Jul 11 04:27:15 devstack sudo[91285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:15 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aecaf4c-fa15-44e9-9e04-5688f1a1f0a3 tempest-VolumesDeleteCascade-1995094936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:27:15 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1aecaf4c-fa15-44e9-9e04-5688f1a1f0a3 tempest-VolumesDeleteCascade-1995094936 None] Flow 'volume_create_manager' (38a519eb-ec05-4c3a-a744-99db8db86332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:27:15 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1aecaf4c-fa15-44e9-9e04-5688f1a1f0a3 tempest-VolumesDeleteCascade-1995094936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec44a183-d459-473c-aed9-e7910e2acdba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:15 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1aecaf4c-fa15-44e9-9e04-5688f1a1f0a3 tempest-VolumesDeleteCascade-1995094936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec44a183-d459-473c-aed9-e7910e2acdba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-259659832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c287a8e-320d-4fc9-96c9-903bc407bb09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b60f6f148da14eacbec855c331e0c043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:27:16Z,use_quota=True,user_id='c00ac0b624b0469e921cb7e03839168c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:15 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1aecaf4c-fa15-44e9-9e04-5688f1a1f0a3 tempest-VolumesDeleteCascade-1995094936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ae54abc-5882-4f44-b5da-1acbf939637a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:15 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1aecaf4c-fa15-44e9-9e04-5688f1a1f0a3 tempest-VolumesDeleteCascade-1995094936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ae54abc-5882-4f44-b5da-1acbf939637a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:15 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1aecaf4c-fa15-44e9-9e04-5688f1a1f0a3 tempest-VolumesDeleteCascade-1995094936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2d8f81f-d0be-4a96-9d18-5ddc385324c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:15 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1aecaf4c-fa15-44e9-9e04-5688f1a1f0a3 tempest-VolumesDeleteCascade-1995094936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2d8f81f-d0be-4a96-9d18-5ddc385324c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c287a8e-320d-4fc9-96c9-903bc407bb09', 'volume_name': 'volume-1c287a8e-320d-4fc9-96c9-903bc407bb09', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:15 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1aecaf4c-fa15-44e9-9e04-5688f1a1f0a3 tempest-VolumesDeleteCascade-1995094936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03d72ff1-20b4-466d-964a-c463071b2298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:15 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1aecaf4c-fa15-44e9-9e04-5688f1a1f0a3 tempest-VolumesDeleteCascade-1995094936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03d72ff1-20b4-466d-964a-c463071b2298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:15 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1aecaf4c-fa15-44e9-9e04-5688f1a1f0a3 tempest-VolumesDeleteCascade-1995094936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40036810-2c7d-47bf-be72-7d6fb020bd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:15 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-1aecaf4c-fa15-44e9-9e04-5688f1a1f0a3 tempest-VolumesDeleteCascade-1995094936 None] Volume 1c287a8e-320d-4fc9-96c9-903bc407bb09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c287a8e-320d-4fc9-96c9-903bc407bb09', 'volume_size': 1} Jul 11 04:27:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1aecaf4c-fa15-44e9-9e04-5688f1a1f0a3 tempest-VolumesDeleteCascade-1995094936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:27:16 devstack sudo[91285]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f6a2307b-72f6-4e8d-ab78-6559932048b2 tempest-ServerActionsTestOtherA-1035839598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0db52474-5f6d-4c6d-93be-ef4e54a2a54b" returned: 0 in 0.984s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:16 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-f6a2307b-72f6-4e8d-ab78-6559932048b2 tempest-ServerActionsTestOtherA-1035839598 None] <== create_volume: return (3270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:27:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f6a2307b-72f6-4e8d-ab78-6559932048b2 tempest-ServerActionsTestOtherA-1035839598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.273s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:27:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1aecaf4c-fa15-44e9-9e04-5688f1a1f0a3 tempest-VolumesDeleteCascade-1995094936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.683s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:27:16 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-1aecaf4c-fa15-44e9-9e04-5688f1a1f0a3 tempest-VolumesDeleteCascade-1995094936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-259659832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c287a8e-320d-4fc9-96c9-903bc407bb09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b60f6f148da14eacbec855c331e0c043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:27:16Z,use_quota=True,user_id='c00ac0b624b0469e921cb7e03839168c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:27:16 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-1aecaf4c-fa15-44e9-9e04-5688f1a1f0a3 tempest-VolumesDeleteCascade-1995094936 None] Creating volume 1c287a8e-320d-4fc9-96c9-903bc407bb09 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:27:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1aecaf4c-fa15-44e9-9e04-5688f1a1f0a3 tempest-VolumesDeleteCascade-1995094936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:27:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1aecaf4c-fa15-44e9-9e04-5688f1a1f0a3 tempest-VolumesDeleteCascade-1995094936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:27:16 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-1aecaf4c-fa15-44e9-9e04-5688f1a1f0a3 tempest-VolumesDeleteCascade-1995094936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:27:16 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-1aecaf4c-fa15-44e9-9e04-5688f1a1f0a3 tempest-VolumesDeleteCascade-1995094936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:27:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1aecaf4c-fa15-44e9-9e04-5688f1a1f0a3 tempest-VolumesDeleteCascade-1995094936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:27:16 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-1aecaf4c-fa15-44e9-9e04-5688f1a1f0a3 tempest-VolumesDeleteCascade-1995094936 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:27:16 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-1aecaf4c-fa15-44e9-9e04-5688f1a1f0a3 tempest-VolumesDeleteCascade-1995094936 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:27:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1aecaf4c-fa15-44e9-9e04-5688f1a1f0a3 tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:16 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f6a2307b-72f6-4e8d-ab78-6559932048b2 tempest-ServerActionsTestOtherA-1035839598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb8df743-2875-456a-a1a8-a65937100d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0db52474-5f6d-4c6d-93be-ef4e54a2a54b', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:16 devstack sudo[91292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09 1073741824 Jul 11 04:27:16 devstack sudo[91292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:16 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f6a2307b-72f6-4e8d-ab78-6559932048b2 tempest-ServerActionsTestOtherA-1035839598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (912c74b4-49a8-4428-96f8-a307acdc4f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:16 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-f6a2307b-72f6-4e8d-ab78-6559932048b2 tempest-ServerActionsTestOtherA-1035839598 None] Volume volume-0db52474-5f6d-4c6d-93be-ef4e54a2a54b (0db52474-5f6d-4c6d-93be-ef4e54a2a54b): created successfully Jul 11 04:27:16 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f6a2307b-72f6-4e8d-ab78-6559932048b2 tempest-ServerActionsTestOtherA-1035839598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (912c74b4-49a8-4428-96f8-a307acdc4f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:16 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f6a2307b-72f6-4e8d-ab78-6559932048b2 tempest-ServerActionsTestOtherA-1035839598 None] Flow 'volume_create_manager' (c7b4b194-c6aa-444f-a3ee-7a1e612d9a86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:27:16 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-f6a2307b-72f6-4e8d-ab78-6559932048b2 tempest-ServerActionsTestOtherA-1035839598 None] Created volume successfully. Jul 11 04:27:16 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-2de6f4a4-a398-47ae-9589-2aff5d6cfc0a tempest-AttachVolumeTestJSON-642925562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:27:16 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2de6f4a4-a398-47ae-9589-2aff5d6cfc0a tempest-AttachVolumeTestJSON-642925562 None] Flow 'volume_create_manager' (cf934efd-0a7f-4a6d-99a2-139234abb598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:27:16 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2de6f4a4-a398-47ae-9589-2aff5d6cfc0a tempest-AttachVolumeTestJSON-642925562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b00b0fbf-6766-4317-b576-c92636362eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:16 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2de6f4a4-a398-47ae-9589-2aff5d6cfc0a tempest-AttachVolumeTestJSON-642925562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b00b0fbf-6766-4317-b576-c92636362eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-355725208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fff40e2d-137a-4b57-8ebc-6aedaaa6af34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='787c2506ea44497f90b3e3422d10ee91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:27:17Z,use_quota=True,user_id='3d062da2352a402b8232c21e8f122552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:16 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2de6f4a4-a398-47ae-9589-2aff5d6cfc0a tempest-AttachVolumeTestJSON-642925562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aedbf6c1-2d8a-4412-b989-0b4158446d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:16 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2de6f4a4-a398-47ae-9589-2aff5d6cfc0a tempest-AttachVolumeTestJSON-642925562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aedbf6c1-2d8a-4412-b989-0b4158446d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:16 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2de6f4a4-a398-47ae-9589-2aff5d6cfc0a tempest-AttachVolumeTestJSON-642925562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f452fa0-a4aa-4e72-a9eb-1a981739594b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:16 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2de6f4a4-a398-47ae-9589-2aff5d6cfc0a tempest-AttachVolumeTestJSON-642925562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f452fa0-a4aa-4e72-a9eb-1a981739594b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fff40e2d-137a-4b57-8ebc-6aedaaa6af34', 'volume_name': 'volume-fff40e2d-137a-4b57-8ebc-6aedaaa6af34', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:16 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2de6f4a4-a398-47ae-9589-2aff5d6cfc0a tempest-AttachVolumeTestJSON-642925562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd0f7ebe-7cc1-4128-890b-c8803222fb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:16 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2de6f4a4-a398-47ae-9589-2aff5d6cfc0a tempest-AttachVolumeTestJSON-642925562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd0f7ebe-7cc1-4128-890b-c8803222fb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:16 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2de6f4a4-a398-47ae-9589-2aff5d6cfc0a tempest-AttachVolumeTestJSON-642925562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56042e6f-cd14-440b-b1a4-9f97cc0d3ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:16 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-2de6f4a4-a398-47ae-9589-2aff5d6cfc0a tempest-AttachVolumeTestJSON-642925562 None] Volume fff40e2d-137a-4b57-8ebc-6aedaaa6af34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fff40e2d-137a-4b57-8ebc-6aedaaa6af34', 'volume_size': 1} Jul 11 04:27:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2de6f4a4-a398-47ae-9589-2aff5d6cfc0a tempest-AttachVolumeTestJSON-642925562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:27:17 devstack sudo[91292]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1aecaf4c-fa15-44e9-9e04-5688f1a1f0a3 tempest-VolumesDeleteCascade-1995094936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09 1073741824" returned: 0 in 0.995s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1aecaf4c-fa15-44e9-9e04-5688f1a1f0a3 tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:17 devstack sudo[91305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09 Jul 11 04:27:17 devstack sudo[91305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:18 devstack sudo[91305]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1aecaf4c-fa15-44e9-9e04-5688f1a1f0a3 tempest-VolumesDeleteCascade-1995094936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09" returned: 0 in 0.726s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:18 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-1aecaf4c-fa15-44e9-9e04-5688f1a1f0a3 tempest-VolumesDeleteCascade-1995094936 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:27:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1aecaf4c-fa15-44e9-9e04-5688f1a1f0a3 tempest-VolumesDeleteCascade-1995094936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.775s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:27:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2de6f4a4-a398-47ae-9589-2aff5d6cfc0a tempest-AttachVolumeTestJSON-642925562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.534s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:27:18 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2de6f4a4-a398-47ae-9589-2aff5d6cfc0a tempest-AttachVolumeTestJSON-642925562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-355725208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fff40e2d-137a-4b57-8ebc-6aedaaa6af34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='787c2506ea44497f90b3e3422d10ee91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:27:17Z,use_quota=True,user_id='3d062da2352a402b8232c21e8f122552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:27:18 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-2de6f4a4-a398-47ae-9589-2aff5d6cfc0a tempest-AttachVolumeTestJSON-642925562 None] Creating volume fff40e2d-137a-4b57-8ebc-6aedaaa6af34 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:27:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2de6f4a4-a398-47ae-9589-2aff5d6cfc0a tempest-AttachVolumeTestJSON-642925562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:27:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2de6f4a4-a398-47ae-9589-2aff5d6cfc0a tempest-AttachVolumeTestJSON-642925562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:27:18 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2de6f4a4-a398-47ae-9589-2aff5d6cfc0a tempest-AttachVolumeTestJSON-642925562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:27:18 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2de6f4a4-a398-47ae-9589-2aff5d6cfc0a tempest-AttachVolumeTestJSON-642925562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:27:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2de6f4a4-a398-47ae-9589-2aff5d6cfc0a tempest-AttachVolumeTestJSON-642925562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:27:18 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2de6f4a4-a398-47ae-9589-2aff5d6cfc0a tempest-AttachVolumeTestJSON-642925562 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:27:18 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-2de6f4a4-a398-47ae-9589-2aff5d6cfc0a tempest-AttachVolumeTestJSON-642925562 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:27:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2de6f4a4-a398-47ae-9589-2aff5d6cfc0a tempest-AttachVolumeTestJSON-642925562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fff40e2d-137a-4b57-8ebc-6aedaaa6af34 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:18 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1aecaf4c-fa15-44e9-9e04-5688f1a1f0a3 tempest-VolumesDeleteCascade-1995094936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40036810-2c7d-47bf-be72-7d6fb020bd3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c287a8e-320d-4fc9-96c9-903bc407bb09', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:18 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1aecaf4c-fa15-44e9-9e04-5688f1a1f0a3 tempest-VolumesDeleteCascade-1995094936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (169ad11f-0a85-4bb7-a0fd-b9ff221cb38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:18 devstack sudo[91312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fff40e2d-137a-4b57-8ebc-6aedaaa6af34 1073741824 Jul 11 04:27:18 devstack sudo[91312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:18 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-1aecaf4c-fa15-44e9-9e04-5688f1a1f0a3 tempest-VolumesDeleteCascade-1995094936 None] Volume volume-1c287a8e-320d-4fc9-96c9-903bc407bb09 (1c287a8e-320d-4fc9-96c9-903bc407bb09): created successfully Jul 11 04:27:18 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1aecaf4c-fa15-44e9-9e04-5688f1a1f0a3 tempest-VolumesDeleteCascade-1995094936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (169ad11f-0a85-4bb7-a0fd-b9ff221cb38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:18 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1aecaf4c-fa15-44e9-9e04-5688f1a1f0a3 tempest-VolumesDeleteCascade-1995094936 None] Flow 'volume_create_manager' (38a519eb-ec05-4c3a-a744-99db8db86332) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:27:18 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-1aecaf4c-fa15-44e9-9e04-5688f1a1f0a3 tempest-VolumesDeleteCascade-1995094936 None] Created volume successfully. Jul 11 04:27:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c77aa14a-751e-4030-91f7-c0286c833b7c tempest-VolumesDeleteCascade-1995094936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:27:19 devstack sudo[91312]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2de6f4a4-a398-47ae-9589-2aff5d6cfc0a tempest-AttachVolumeTestJSON-642925562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fff40e2d-137a-4b57-8ebc-6aedaaa6af34 1073741824" returned: 0 in 0.946s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2de6f4a4-a398-47ae-9589-2aff5d6cfc0a tempest-AttachVolumeTestJSON-642925562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fff40e2d-137a-4b57-8ebc-6aedaaa6af34 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:19 devstack sudo[91320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fff40e2d-137a-4b57-8ebc-6aedaaa6af34 Jul 11 04:27:19 devstack sudo[91320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:20 devstack sudo[91320]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2de6f4a4-a398-47ae-9589-2aff5d6cfc0a tempest-AttachVolumeTestJSON-642925562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fff40e2d-137a-4b57-8ebc-6aedaaa6af34" returned: 0 in 0.776s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:20 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2de6f4a4-a398-47ae-9589-2aff5d6cfc0a tempest-AttachVolumeTestJSON-642925562 None] <== create_volume: return (1768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:27:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2de6f4a4-a398-47ae-9589-2aff5d6cfc0a tempest-AttachVolumeTestJSON-642925562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.770s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:27:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c77aa14a-751e-4030-91f7-c0286c833b7c tempest-VolumesDeleteCascade-1995094936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.234s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:27:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2de6f4a4-a398-47ae-9589-2aff5d6cfc0a tempest-AttachVolumeTestJSON-642925562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56042e6f-cd14-440b-b1a4-9f97cc0d3ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fff40e2d-137a-4b57-8ebc-6aedaaa6af34', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2de6f4a4-a398-47ae-9589-2aff5d6cfc0a tempest-AttachVolumeTestJSON-642925562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca66b61-5de5-4126-a81c-73d7429167b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:20 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-c77aa14a-751e-4030-91f7-c0286c833b7c tempest-VolumesDeleteCascade-1995094936 None] Creating offline snapshot 9c5ca84a-6394-407b-9466-678c7c2d17fa of volume 1c287a8e-320d-4fc9-96c9-903bc407bb09 {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:27:20 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-2de6f4a4-a398-47ae-9589-2aff5d6cfc0a tempest-AttachVolumeTestJSON-642925562 None] Volume volume-fff40e2d-137a-4b57-8ebc-6aedaaa6af34 (fff40e2d-137a-4b57-8ebc-6aedaaa6af34): created successfully Jul 11 04:27:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2de6f4a4-a398-47ae-9589-2aff5d6cfc0a tempest-AttachVolumeTestJSON-642925562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca66b61-5de5-4126-a81c-73d7429167b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2de6f4a4-a398-47ae-9589-2aff5d6cfc0a tempest-AttachVolumeTestJSON-642925562 None] Flow 'volume_create_manager' (cf934efd-0a7f-4a6d-99a2-139234abb598) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:27:20 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32a0878-fd2d-4acb-b79e-226bcbde04a2]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:27:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c77aa14a-751e-4030-91f7-c0286c833b7c tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:20 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-2de6f4a4-a398-47ae-9589-2aff5d6cfc0a tempest-AttachVolumeTestJSON-642925562 None] Created volume successfully. Jul 11 04:27:20 devstack sudo[91344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09 Jul 11 04:27:20 devstack sudo[91344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:21 devstack sudo[91344]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c77aa14a-751e-4030-91f7-c0286c833b7c tempest-VolumesDeleteCascade-1995094936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09" returned: 0 in 0.893s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c77aa14a-751e-4030-91f7-c0286c833b7c tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09.9c5ca84a-6394-407b-9466-678c7c2d17fa 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:21 devstack sudo[91363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09.9c5ca84a-6394-407b-9466-678c7c2d17fa 1G Jul 11 04:27:21 devstack sudo[91363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:22 devstack sudo[91363]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c77aa14a-751e-4030-91f7-c0286c833b7c tempest-VolumesDeleteCascade-1995094936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09.9c5ca84a-6394-407b-9466-678c7c2d17fa 1G" returned: 0 in 0.925s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c77aa14a-751e-4030-91f7-c0286c833b7c tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c287a8e-320d-4fc9-96c9-903bc407bb09 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09.9c5ca84a-6394-407b-9466-678c7c2d17fa {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:22 devstack sudo[91380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c287a8e-320d-4fc9-96c9-903bc407bb09 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09.9c5ca84a-6394-407b-9466-678c7c2d17fa Jul 11 04:27:22 devstack sudo[91380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:22 devstack sudo[91380]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c77aa14a-751e-4030-91f7-c0286c833b7c tempest-VolumesDeleteCascade-1995094936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c287a8e-320d-4fc9-96c9-903bc407bb09 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09.9c5ca84a-6394-407b-9466-678c7c2d17fa" returned: 0 in 0.836s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:22 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-c77aa14a-751e-4030-91f7-c0286c833b7c tempest-VolumesDeleteCascade-1995094936 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09.9c5ca84a-6394-407b-9466-678c7c2d17fa is being set with open permissions: ugo+rw Jul 11 04:27:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c77aa14a-751e-4030-91f7-c0286c833b7c tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09.9c5ca84a-6394-407b-9466-678c7c2d17fa {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:22 devstack sudo[91387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09.9c5ca84a-6394-407b-9466-678c7c2d17fa Jul 11 04:27:22 devstack sudo[91387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:23 devstack sudo[91387]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c77aa14a-751e-4030-91f7-c0286c833b7c tempest-VolumesDeleteCascade-1995094936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09.9c5ca84a-6394-407b-9466-678c7c2d17fa" returned: 0 in 1.026s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c77aa14a-751e-4030-91f7-c0286c833b7c tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:24 devstack sudo[91391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09.info Jul 11 04:27:24 devstack sudo[91391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-7184dc15-155b-4e37-b0d1-179d6a05cc0a req-efce137c-81d6-4023-a06b-aca83bf1f3fa tempest-AttachVolumeTestJSON-642925562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:27:25 devstack sudo[91391]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c77aa14a-751e-4030-91f7-c0286c833b7c tempest-VolumesDeleteCascade-1995094936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09.info" returned: 0 in 1.397s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:25 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-c77aa14a-751e-4030-91f7-c0286c833b7c tempest-VolumesDeleteCascade-1995094936 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09.info is being set with open permissions: ugo+rw Jul 11 04:27:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c77aa14a-751e-4030-91f7-c0286c833b7c tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:25 devstack sudo[91414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09.info Jul 11 04:27:25 devstack sudo[91414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:26 devstack sudo[91414]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c77aa14a-751e-4030-91f7-c0286c833b7c tempest-VolumesDeleteCascade-1995094936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09.info" returned: 0 in 0.813s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c77aa14a-751e-4030-91f7-c0286c833b7c tempest-VolumesDeleteCascade-1995094936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.074s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:27:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-7184dc15-155b-4e37-b0d1-179d6a05cc0a req-efce137c-81d6-4023-a06b-aca83bf1f3fa tempest-AttachVolumeTestJSON-642925562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.603s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:27:26 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[3388ddf4-039c-443a-b225-8d3d0634fd73]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:27:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-7184dc15-155b-4e37-b0d1-179d6a05cc0a req-efce137c-81d6-4023-a06b-aca83bf1f3fa tempest-AttachVolumeTestJSON-642925562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fff40e2d-137a-4b57-8ebc-6aedaaa6af34 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:26 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-c77aa14a-751e-4030-91f7-c0286c833b7c tempest-VolumesDeleteCascade-1995094936 None] Create snapshot completed successfully Jul 11 04:27:26 devstack sudo[91428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fff40e2d-137a-4b57-8ebc-6aedaaa6af34 Jul 11 04:27:26 devstack sudo[91428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:27 devstack sudo[91428]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-7184dc15-155b-4e37-b0d1-179d6a05cc0a req-efce137c-81d6-4023-a06b-aca83bf1f3fa tempest-AttachVolumeTestJSON-642925562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fff40e2d-137a-4b57-8ebc-6aedaaa6af34" returned: 0 in 0.919s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-7184dc15-155b-4e37-b0d1-179d6a05cc0a req-efce137c-81d6-4023-a06b-aca83bf1f3fa tempest-AttachVolumeTestJSON-642925562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.952s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:27:27 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=42,cinder:UPDATE=50,cinder:INSERT=14,cinder:DELETE=2 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:27:27 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=44,cinder:UPDATE=44,cinder:DELETE=8,cinder:INSERT=9 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:27:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-7184dc15-155b-4e37-b0d1-179d6a05cc0a req-efce137c-81d6-4023-a06b-aca83bf1f3fa tempest-AttachVolumeTestJSON-642925562 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95', 'name': 'volume-fff40e2d-137a-4b57-8ebc-6aedaaa6af34', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '282a2d37-74a3-41a9-9cf4-09787bdb5296', 'enforce_multipath': True} {{(pid=86964) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 04:27:27 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-7184dc15-155b-4e37-b0d1-179d6a05cc0a req-efce137c-81d6-4023-a06b-aca83bf1f3fa tempest-AttachVolumeTestJSON-642925562 None] attachment_update completed successfully. Jul 11 04:27:28 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:27:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Flow 'volume_create_manager' (9a892c54-2d4e-41df-9839-261187dec3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:27:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b2615c3-d6c2-43da-8797-bf89d9ef9638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b2615c3-d6c2-43da-8797-bf89d9ef9638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-983664582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=714ba826-9874-4f9c-8a5a-4c020f5a6449,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b60f6f148da14eacbec855c331e0c043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9c5ca84a-6394-407b-9466-678c7c2d17fa,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:27:28Z,use_quota=True,user_id='c00ac0b624b0469e921cb7e03839168c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf652b23-6a33-4ca6-af22-e8dba29fc708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf652b23-6a33-4ca6-af22-e8dba29fc708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b90440-ade3-47a5-a16e-efce94efeea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b90440-ade3-47a5-a16e-efce94efeea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '714ba826-9874-4f9c-8a5a-4c020f5a6449', 'volume_name': 'volume-714ba826-9874-4f9c-8a5a-4c020f5a6449', 'volume_size': 1, 'snapshot_id': '9c5ca84a-6394-407b-9466-678c7c2d17fa'}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acd1925d-a3ee-4bf4-9ab3-d4a2ba7248da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acd1925d-a3ee-4bf4-9ab3-d4a2ba7248da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea59238-d652-488d-891d-7d58f44ffe44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:28 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Volume 714ba826-9874-4f9c-8a5a-4c020f5a6449: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-714ba826-9874-4f9c-8a5a-4c020f5a6449', 'volume_size': 1, 'snapshot_id': '9c5ca84a-6394-407b-9466-678c7c2d17fa'} Jul 11 04:27:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:27:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:27:28 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Acquiring lock "cinder-quobyte-9c5ca84a-6394-407b-9466-678c7c2d17fa-714ba826-9874-4f9c-8a5a-4c020f5a6449" by "_create_volume_from_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:27:28 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Lock "cinder-quobyte-9c5ca84a-6394-407b-9466-678c7c2d17fa-714ba826-9874-4f9c-8a5a-4c020f5a6449" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:27:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Creating volume 714ba826-9874-4f9c-8a5a-4c020f5a6449 from snapshot 9c5ca84a-6394-407b-9466-678c7c2d17fa {{(pid=86964) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 04:27:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:27:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:27:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:27:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:27:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:27:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:27:28 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Acquiring lock "cinder-quobyte-714ba826-9874-4f9c-8a5a-4c020f5a6449" by "_copy_volume_from_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:27:28 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Lock "cinder-quobyte-714ba826-9874-4f9c-8a5a-4c020f5a6449" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:27:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] snapshot: 9c5ca84a-6394-407b-9466-678c7c2d17fa, volume: 714ba826-9874-4f9c-8a5a-4c020f5a6449, {{(pid=86964) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 04:27:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:27:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:27:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:27:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:27:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:27:28 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be32ba8-02cf-4845-820a-705a9ac0239a]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:27:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09.9c5ca84a-6394-407b-9466-678c7c2d17fa {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:28 devstack sudo[91523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09.9c5ca84a-6394-407b-9466-678c7c2d17fa Jul 11 04:27:28 devstack sudo[91523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:29 devstack sudo[91523]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09.9c5ca84a-6394-407b-9466-678c7c2d17fa" returned: 0 in 0.844s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:29 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c287a8e-320d-4fc9-96c9-903bc407bb09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:27:29 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09 {{(pid=86964) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 04:27:29 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Creating direct copy from snapshot {{(pid=86964) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 04:27:29 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42b7e1c-ae29-4cc3-b734-030daf506e29]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:27:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:29 devstack sudo[91845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09 Jul 11 04:27:29 devstack sudo[91845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:29 devstack sudo[91845]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09" returned: 0 in 0.742s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:29 devstack cinder-volume[86964]: DEBUG cinder.utils [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Path /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-714ba826-9874-4f9c-8a5a-4c020f5a6449 not found in is_blk_device check {{(pid=86964) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 04:27:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-714ba826-9874-4f9c-8a5a-4c020f5a6449 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:29 devstack sudo[91850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-714ba826-9874-4f9c-8a5a-4c020f5a6449 Jul 11 04:27:29 devstack sudo[91850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:34 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-955a2099-a98e-4f32-9d05-8abec1c11c24 tempest-AttachVolumeTestJSON-642925562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:27:34 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-955a2099-a98e-4f32-9d05-8abec1c11c24 tempest-AttachVolumeTestJSON-642925562 None] Flow 'volume_create_manager' (164817c7-8676-42e5-8cc5-d59759cb31b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:27:34 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-955a2099-a98e-4f32-9d05-8abec1c11c24 tempest-AttachVolumeTestJSON-642925562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ebed6b5-b1e9-4a36-8b91-3024bb68ab71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:34 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-955a2099-a98e-4f32-9d05-8abec1c11c24 tempest-AttachVolumeTestJSON-642925562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ebed6b5-b1e9-4a36-8b91-3024bb68ab71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1845092786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3afd5cbd-6afb-4e23-a0d9-9231f067c087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='787c2506ea44497f90b3e3422d10ee91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:27:34Z,use_quota=True,user_id='3d062da2352a402b8232c21e8f122552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:34 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-955a2099-a98e-4f32-9d05-8abec1c11c24 tempest-AttachVolumeTestJSON-642925562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2269636-3859-4535-b304-4d619bb71546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:34 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-955a2099-a98e-4f32-9d05-8abec1c11c24 tempest-AttachVolumeTestJSON-642925562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2269636-3859-4535-b304-4d619bb71546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:34 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-955a2099-a98e-4f32-9d05-8abec1c11c24 tempest-AttachVolumeTestJSON-642925562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2ee272c-b2d1-43d4-8e2f-f407698ca3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:34 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-955a2099-a98e-4f32-9d05-8abec1c11c24 tempest-AttachVolumeTestJSON-642925562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2ee272c-b2d1-43d4-8e2f-f407698ca3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3afd5cbd-6afb-4e23-a0d9-9231f067c087', 'volume_name': 'volume-3afd5cbd-6afb-4e23-a0d9-9231f067c087', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:34 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-955a2099-a98e-4f32-9d05-8abec1c11c24 tempest-AttachVolumeTestJSON-642925562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89c4b967-d546-4685-bb9a-dcd4c517c7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:34 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-955a2099-a98e-4f32-9d05-8abec1c11c24 tempest-AttachVolumeTestJSON-642925562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89c4b967-d546-4685-bb9a-dcd4c517c7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:34 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-955a2099-a98e-4f32-9d05-8abec1c11c24 tempest-AttachVolumeTestJSON-642925562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (959b1210-494f-4600-8af9-636b5ca1d279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:34 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-955a2099-a98e-4f32-9d05-8abec1c11c24 tempest-AttachVolumeTestJSON-642925562 None] Volume 3afd5cbd-6afb-4e23-a0d9-9231f067c087: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3afd5cbd-6afb-4e23-a0d9-9231f067c087', 'volume_size': 1} Jul 11 04:27:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-955a2099-a98e-4f32-9d05-8abec1c11c24 tempest-AttachVolumeTestJSON-642925562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:27:36 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-24558881-b6fe-4c01-9d52-51b53d82dceb tempest-ServersNegativeTestJSON-325727619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:27:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-24558881-b6fe-4c01-9d52-51b53d82dceb tempest-ServersNegativeTestJSON-325727619 None] Flow 'volume_create_manager' (572b5c82-d444-4b96-942b-98b63c363507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:27:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-24558881-b6fe-4c01-9d52-51b53d82dceb tempest-ServersNegativeTestJSON-325727619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59266b37-c483-425d-ba1f-53665123d8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-24558881-b6fe-4c01-9d52-51b53d82dceb tempest-ServersNegativeTestJSON-325727619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59266b37-c483-425d-ba1f-53665123d8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1237901503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4c2d617-ec1b-47ca-a24c-53c895a1acc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d290499c2d94d12bb20fd20241a6bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:27:36Z,use_quota=True,user_id='e94b0c473abd4750978f139f2545c2f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-24558881-b6fe-4c01-9d52-51b53d82dceb tempest-ServersNegativeTestJSON-325727619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (371b3e3a-f02c-41a8-8a39-c46e8516ed15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-24558881-b6fe-4c01-9d52-51b53d82dceb tempest-ServersNegativeTestJSON-325727619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (371b3e3a-f02c-41a8-8a39-c46e8516ed15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-24558881-b6fe-4c01-9d52-51b53d82dceb tempest-ServersNegativeTestJSON-325727619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10b3d0d8-6021-4e57-a92d-91832e3050d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-24558881-b6fe-4c01-9d52-51b53d82dceb tempest-ServersNegativeTestJSON-325727619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10b3d0d8-6021-4e57-a92d-91832e3050d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4c2d617-ec1b-47ca-a24c-53c895a1acc9', 'volume_name': 'volume-d4c2d617-ec1b-47ca-a24c-53c895a1acc9', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-24558881-b6fe-4c01-9d52-51b53d82dceb tempest-ServersNegativeTestJSON-325727619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54abaf80-a040-4b2f-a0e1-ade2e65b8fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-24558881-b6fe-4c01-9d52-51b53d82dceb tempest-ServersNegativeTestJSON-325727619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54abaf80-a040-4b2f-a0e1-ade2e65b8fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-24558881-b6fe-4c01-9d52-51b53d82dceb tempest-ServersNegativeTestJSON-325727619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2701cbf-81fb-4ea9-8c8c-b2b488221c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:36 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-24558881-b6fe-4c01-9d52-51b53d82dceb tempest-ServersNegativeTestJSON-325727619 None] Volume d4c2d617-ec1b-47ca-a24c-53c895a1acc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4c2d617-ec1b-47ca-a24c-53c895a1acc9', 'volume_size': 1} Jul 11 04:27:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-24558881-b6fe-4c01-9d52-51b53d82dceb tempest-ServersNegativeTestJSON-325727619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:27:37 devstack sudo[91850]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-714ba826-9874-4f9c-8a5a-4c020f5a6449" returned: 0 in 7.306s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:37 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[16edef9e-9c5e-44e7-a82e-4e9d614b9873]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:27:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:37 devstack sudo[91910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09 Jul 11 04:27:37 devstack sudo[91910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:38 devstack sudo[91910]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09" returned: 0 in 1.024s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:38 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Image conversion details: src /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09, size 1024.00 MB, duration 7.31 sec, destination /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-714ba826-9874-4f9c-8a5a-4c020f5a6449 {{(pid=86964) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 04:27:38 devstack cinder-volume[86964]: INFO cinder.image.image_utils [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Converted 1024.00 MB image at 140.13 MB/s Jul 11 04:27:38 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-714ba826-9874-4f9c-8a5a-4c020f5a6449 is being set with open permissions: ugo+rw Jul 11 04:27:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-714ba826-9874-4f9c-8a5a-4c020f5a6449 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:38 devstack sudo[91916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-714ba826-9874-4f9c-8a5a-4c020f5a6449 Jul 11 04:27:38 devstack sudo[91916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:38 devstack sudo[91916]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-714ba826-9874-4f9c-8a5a-4c020f5a6449" returned: 0 in 0.665s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:38 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Lock "cinder-quobyte-714ba826-9874-4f9c-8a5a-4c020f5a6449" released by "_copy_volume_from_snapshot" :: held 10.675s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:27:38 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Lock "cinder-quobyte-9c5ca84a-6394-407b-9466-678c7c2d17fa-714ba826-9874-4f9c-8a5a-4c020f5a6449" released by "_create_volume_from_snapshot" :: held 10.710s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:27:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.724s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:27:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-955a2099-a98e-4f32-9d05-8abec1c11c24 tempest-AttachVolumeTestJSON-642925562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.482s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:27:38 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-955a2099-a98e-4f32-9d05-8abec1c11c24 tempest-AttachVolumeTestJSON-642925562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1845092786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3afd5cbd-6afb-4e23-a0d9-9231f067c087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='787c2506ea44497f90b3e3422d10ee91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:27:34Z,use_quota=True,user_id='3d062da2352a402b8232c21e8f122552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:27:38 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-955a2099-a98e-4f32-9d05-8abec1c11c24 tempest-AttachVolumeTestJSON-642925562 None] Creating volume 3afd5cbd-6afb-4e23-a0d9-9231f067c087 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:27:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-955a2099-a98e-4f32-9d05-8abec1c11c24 tempest-AttachVolumeTestJSON-642925562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:27:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-955a2099-a98e-4f32-9d05-8abec1c11c24 tempest-AttachVolumeTestJSON-642925562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:27:38 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-955a2099-a98e-4f32-9d05-8abec1c11c24 tempest-AttachVolumeTestJSON-642925562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:27:38 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-955a2099-a98e-4f32-9d05-8abec1c11c24 tempest-AttachVolumeTestJSON-642925562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:27:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-955a2099-a98e-4f32-9d05-8abec1c11c24 tempest-AttachVolumeTestJSON-642925562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:27:38 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-955a2099-a98e-4f32-9d05-8abec1c11c24 tempest-AttachVolumeTestJSON-642925562 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:27:38 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-955a2099-a98e-4f32-9d05-8abec1c11c24 tempest-AttachVolumeTestJSON-642925562 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:27:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-955a2099-a98e-4f32-9d05-8abec1c11c24 tempest-AttachVolumeTestJSON-642925562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3afd5cbd-6afb-4e23-a0d9-9231f067c087 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:39 devstack sudo[91921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3afd5cbd-6afb-4e23-a0d9-9231f067c087 1073741824 Jul 11 04:27:39 devstack sudo[91921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea59238-d652-488d-891d-7d58f44ffe44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-714ba826-9874-4f9c-8a5a-4c020f5a6449', 'volume_size': 1, 'snapshot_id': '9c5ca84a-6394-407b-9466-678c7c2d17fa'}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (392eb672-cb6c-4e51-8c46-24613367a3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:39 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Volume volume-714ba826-9874-4f9c-8a5a-4c020f5a6449 (714ba826-9874-4f9c-8a5a-4c020f5a6449): created successfully Jul 11 04:27:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (392eb672-cb6c-4e51-8c46-24613367a3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Flow 'volume_create_manager' (9a892c54-2d4e-41df-9839-261187dec3b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:27:39 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-02d13540-696f-4749-bdfb-561f0549d8f9 tempest-VolumesDeleteCascade-1995094936 None] Created volume successfully. Jul 11 04:27:39 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] Acquiring lock "cinder-1c287a8e-320d-4fc9-96c9-903bc407bb09-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:27:39 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] Lock "cinder-1c287a8e-320d-4fc9-96c9-903bc407bb09-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:27:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] Performing cascade delete. {{(pid=86964) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 11 04:27:39 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] Acquiring lock "cinder-9c5ca84a-6394-407b-9466-678c7c2d17fa-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:27:39 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] Lock "cinder-9c5ca84a-6394-407b-9466-678c7c2d17fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:27:39 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] Acquiring lock "cinder-quobyte-1c287a8e-320d-4fc9-96c9-903bc407bb09" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:27:39 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] Lock "cinder-quobyte-1c287a8e-320d-4fc9-96c9-903bc407bb09" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:27:39 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] Acquiring lock "cinder-quobyte-9c5ca84a-6394-407b-9466-678c7c2d17fa" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:27:39 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] Lock "cinder-quobyte-9c5ca84a-6394-407b-9466-678c7c2d17fa" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:27:39 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] Deleting offline snapshot 9c5ca84a-6394-407b-9466-678c7c2d17fa of volume 1c287a8e-320d-4fc9-96c9-903bc407bb09 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:27:39 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] snapshot_file for this snap is: volume-1c287a8e-320d-4fc9-96c9-903bc407bb09.9c5ca84a-6394-407b-9466-678c7c2d17fa {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:27:39 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[2182aaa1-4c0e-4c52-9f86-3c7d36a0e8f2]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:27:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09.9c5ca84a-6394-407b-9466-678c7c2d17fa {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:39 devstack sudo[91926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09.9c5ca84a-6394-407b-9466-678c7c2d17fa Jul 11 04:27:39 devstack sudo[91926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:40 devstack sudo[91921]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-955a2099-a98e-4f32-9d05-8abec1c11c24 tempest-AttachVolumeTestJSON-642925562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3afd5cbd-6afb-4e23-a0d9-9231f067c087 1073741824" returned: 0 in 1.023s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-955a2099-a98e-4f32-9d05-8abec1c11c24 tempest-AttachVolumeTestJSON-642925562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3afd5cbd-6afb-4e23-a0d9-9231f067c087 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:40 devstack sudo[91929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3afd5cbd-6afb-4e23-a0d9-9231f067c087 Jul 11 04:27:40 devstack sudo[91929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:40 devstack sudo[91926]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09.9c5ca84a-6394-407b-9466-678c7c2d17fa" returned: 0 in 0.830s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:40 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c287a8e-320d-4fc9-96c9-903bc407bb09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:27:40 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68ace48-9935-4f05-b360-95c3bbf70c11]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:27:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:40 devstack sudo[91929]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-955a2099-a98e-4f32-9d05-8abec1c11c24 tempest-AttachVolumeTestJSON-642925562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3afd5cbd-6afb-4e23-a0d9-9231f067c087" returned: 0 in 0.712s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:40 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-955a2099-a98e-4f32-9d05-8abec1c11c24 tempest-AttachVolumeTestJSON-642925562 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:27:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-955a2099-a98e-4f32-9d05-8abec1c11c24 tempest-AttachVolumeTestJSON-642925562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.786s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:27:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-24558881-b6fe-4c01-9d52-51b53d82dceb tempest-ServersNegativeTestJSON-325727619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.350s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:27:40 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-24558881-b6fe-4c01-9d52-51b53d82dceb tempest-ServersNegativeTestJSON-325727619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1237901503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4c2d617-ec1b-47ca-a24c-53c895a1acc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d290499c2d94d12bb20fd20241a6bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:27:36Z,use_quota=True,user_id='e94b0c473abd4750978f139f2545c2f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:27:40 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-24558881-b6fe-4c01-9d52-51b53d82dceb tempest-ServersNegativeTestJSON-325727619 None] Creating volume d4c2d617-ec1b-47ca-a24c-53c895a1acc9 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:27:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-24558881-b6fe-4c01-9d52-51b53d82dceb tempest-ServersNegativeTestJSON-325727619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:27:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-24558881-b6fe-4c01-9d52-51b53d82dceb tempest-ServersNegativeTestJSON-325727619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:27:40 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-24558881-b6fe-4c01-9d52-51b53d82dceb tempest-ServersNegativeTestJSON-325727619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:27:40 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-24558881-b6fe-4c01-9d52-51b53d82dceb tempest-ServersNegativeTestJSON-325727619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:27:40 devstack sudo[91940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09 Jul 11 04:27:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-24558881-b6fe-4c01-9d52-51b53d82dceb tempest-ServersNegativeTestJSON-325727619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:27:40 devstack sudo[91940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:40 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-24558881-b6fe-4c01-9d52-51b53d82dceb tempest-ServersNegativeTestJSON-325727619 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:27:40 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-24558881-b6fe-4c01-9d52-51b53d82dceb tempest-ServersNegativeTestJSON-325727619 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:27:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-24558881-b6fe-4c01-9d52-51b53d82dceb tempest-ServersNegativeTestJSON-325727619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4c2d617-ec1b-47ca-a24c-53c895a1acc9 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-955a2099-a98e-4f32-9d05-8abec1c11c24 tempest-AttachVolumeTestJSON-642925562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (959b1210-494f-4600-8af9-636b5ca1d279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3afd5cbd-6afb-4e23-a0d9-9231f067c087', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:40 devstack sudo[91942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4c2d617-ec1b-47ca-a24c-53c895a1acc9 1073741824 Jul 11 04:27:40 devstack sudo[91942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-955a2099-a98e-4f32-9d05-8abec1c11c24 tempest-AttachVolumeTestJSON-642925562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97c880e5-7992-4583-a70c-ea06f8b76620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:40 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-955a2099-a98e-4f32-9d05-8abec1c11c24 tempest-AttachVolumeTestJSON-642925562 None] Volume volume-3afd5cbd-6afb-4e23-a0d9-9231f067c087 (3afd5cbd-6afb-4e23-a0d9-9231f067c087): created successfully Jul 11 04:27:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-955a2099-a98e-4f32-9d05-8abec1c11c24 tempest-AttachVolumeTestJSON-642925562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97c880e5-7992-4583-a70c-ea06f8b76620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-955a2099-a98e-4f32-9d05-8abec1c11c24 tempest-AttachVolumeTestJSON-642925562 None] Flow 'volume_create_manager' (164817c7-8676-42e5-8cc5-d59759cb31b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:27:40 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-955a2099-a98e-4f32-9d05-8abec1c11c24 tempest-AttachVolumeTestJSON-642925562 None] Created volume successfully. Jul 11 04:27:41 devstack sudo[91940]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09" returned: 0 in 0.823s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09.9c5ca84a-6394-407b-9466-678c7c2d17fa {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:41 devstack sudo[91950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09.9c5ca84a-6394-407b-9466-678c7c2d17fa Jul 11 04:27:41 devstack sudo[91950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:41 devstack sudo[91942]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-24558881-b6fe-4c01-9d52-51b53d82dceb tempest-ServersNegativeTestJSON-325727619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4c2d617-ec1b-47ca-a24c-53c895a1acc9 1073741824" returned: 0 in 1.024s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-24558881-b6fe-4c01-9d52-51b53d82dceb tempest-ServersNegativeTestJSON-325727619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4c2d617-ec1b-47ca-a24c-53c895a1acc9 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:41 devstack sudo[91963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4c2d617-ec1b-47ca-a24c-53c895a1acc9 Jul 11 04:27:41 devstack sudo[91963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:42 devstack sudo[91950]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09.9c5ca84a-6394-407b-9466-678c7c2d17fa" returned: 0 in 0.841s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09.9c5ca84a-6394-407b-9466-678c7c2d17fa {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:42 devstack sudo[91969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09.9c5ca84a-6394-407b-9466-678c7c2d17fa Jul 11 04:27:42 devstack sudo[91969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:42 devstack sudo[91963]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-24558881-b6fe-4c01-9d52-51b53d82dceb tempest-ServersNegativeTestJSON-325727619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4c2d617-ec1b-47ca-a24c-53c895a1acc9" returned: 0 in 0.728s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:42 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-24558881-b6fe-4c01-9d52-51b53d82dceb tempest-ServersNegativeTestJSON-325727619 None] <== create_volume: return (1827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:27:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-24558881-b6fe-4c01-9d52-51b53d82dceb tempest-ServersNegativeTestJSON-325727619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.832s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:27:42 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-24558881-b6fe-4c01-9d52-51b53d82dceb tempest-ServersNegativeTestJSON-325727619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2701cbf-81fb-4ea9-8c8c-b2b488221c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4c2d617-ec1b-47ca-a24c-53c895a1acc9', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:42 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-24558881-b6fe-4c01-9d52-51b53d82dceb tempest-ServersNegativeTestJSON-325727619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26027ffd-9881-4d8c-a23e-96ed088bae8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:42 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-24558881-b6fe-4c01-9d52-51b53d82dceb tempest-ServersNegativeTestJSON-325727619 None] Volume volume-d4c2d617-ec1b-47ca-a24c-53c895a1acc9 (d4c2d617-ec1b-47ca-a24c-53c895a1acc9): created successfully Jul 11 04:27:42 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-24558881-b6fe-4c01-9d52-51b53d82dceb tempest-ServersNegativeTestJSON-325727619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26027ffd-9881-4d8c-a23e-96ed088bae8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:42 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-24558881-b6fe-4c01-9d52-51b53d82dceb tempest-ServersNegativeTestJSON-325727619 None] Flow 'volume_create_manager' (572b5c82-d444-4b96-942b-98b63c363507) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:27:42 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-24558881-b6fe-4c01-9d52-51b53d82dceb tempest-ServersNegativeTestJSON-325727619 None] Created volume successfully. Jul 11 04:27:42 devstack sudo[91969]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09.9c5ca84a-6394-407b-9466-678c7c2d17fa" returned: 0 in 0.637s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:43 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] Lock "cinder-quobyte-9c5ca84a-6394-407b-9466-678c7c2d17fa" released by "_delete_snapshot" :: held 3.230s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:27:43 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] Lock "cinder-quobyte-1c287a8e-320d-4fc9-96c9-903bc407bb09" released by "delete_snapshot" :: held 3.256s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:27:43 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] Created reservations ['b2709375-c542-437d-9e81-1d0d39c46394', 'ddcc2c64-ac0c-467f-9a58-debe4d647d8c', '98c51021-089a-4096-8589-394fceeb35cc', '06d0e30f-94dd-4d87-a3c4-164cc928db9e'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:27:43 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] Delete snapshot completed successfully. Jul 11 04:27:43 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] Lock "cinder-9c5ca84a-6394-407b-9466-678c7c2d17fa-delete_snapshot" released by "delete_snapshot" :: held 3.447s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:27:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] Snapshots deleted, issuing volume delete {{(pid=86964) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 11 04:27:43 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] Acquiring lock "cinder-quobyte-1c287a8e-320d-4fc9-96c9-903bc407bb09" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:27:43 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] Lock "cinder-quobyte-1c287a8e-320d-4fc9-96c9-903bc407bb09" acquired by "delete_volume" :: waited 0.020s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:27:43 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb57e99-6bd3-4794-9966-53a328cce199]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:27:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:43 devstack sudo[91973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09 Jul 11 04:27:43 devstack sudo[91973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:44 devstack sudo[91973]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09" returned: 0 in 0.905s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:44 devstack sudo[91979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09 Jul 11 04:27:44 devstack sudo[91979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:44 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe0e1f84-56d8-4acd-afb6-f6cb6cf5d0ea tempest-ServersNegativeTestJSON-325727619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:27:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fe0e1f84-56d8-4acd-afb6-f6cb6cf5d0ea tempest-ServersNegativeTestJSON-325727619 None] Flow 'volume_create_manager' (ffd1b0b4-a6ea-4e20-9adb-2deaf670eef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:27:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fe0e1f84-56d8-4acd-afb6-f6cb6cf5d0ea tempest-ServersNegativeTestJSON-325727619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (998ade95-66e2-4b23-b36b-03b7bd46ba12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fe0e1f84-56d8-4acd-afb6-f6cb6cf5d0ea tempest-ServersNegativeTestJSON-325727619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (998ade95-66e2-4b23-b36b-03b7bd46ba12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-141574400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c2aec00-fe07-4e19-8fb1-a27a035fae5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d290499c2d94d12bb20fd20241a6bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:27:44Z,use_quota=True,user_id='e94b0c473abd4750978f139f2545c2f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fe0e1f84-56d8-4acd-afb6-f6cb6cf5d0ea tempest-ServersNegativeTestJSON-325727619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daf8c7ed-da4d-42e7-968a-6e8f38fe8916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fe0e1f84-56d8-4acd-afb6-f6cb6cf5d0ea tempest-ServersNegativeTestJSON-325727619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daf8c7ed-da4d-42e7-968a-6e8f38fe8916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fe0e1f84-56d8-4acd-afb6-f6cb6cf5d0ea tempest-ServersNegativeTestJSON-325727619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d3b1ef3-b05f-4ac1-8661-5dea387492be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fe0e1f84-56d8-4acd-afb6-f6cb6cf5d0ea tempest-ServersNegativeTestJSON-325727619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d3b1ef3-b05f-4ac1-8661-5dea387492be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c2aec00-fe07-4e19-8fb1-a27a035fae5f', 'volume_name': 'volume-0c2aec00-fe07-4e19-8fb1-a27a035fae5f', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fe0e1f84-56d8-4acd-afb6-f6cb6cf5d0ea tempest-ServersNegativeTestJSON-325727619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10c85783-36f4-4ec4-9ba3-53884fbd6ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fe0e1f84-56d8-4acd-afb6-f6cb6cf5d0ea tempest-ServersNegativeTestJSON-325727619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10c85783-36f4-4ec4-9ba3-53884fbd6ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fe0e1f84-56d8-4acd-afb6-f6cb6cf5d0ea tempest-ServersNegativeTestJSON-325727619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e997074-42b2-49a5-bb3b-b76687b03876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:44 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-fe0e1f84-56d8-4acd-afb6-f6cb6cf5d0ea tempest-ServersNegativeTestJSON-325727619 None] Volume 0c2aec00-fe07-4e19-8fb1-a27a035fae5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c2aec00-fe07-4e19-8fb1-a27a035fae5f', 'volume_size': 1} Jul 11 04:27:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fe0e1f84-56d8-4acd-afb6-f6cb6cf5d0ea tempest-ServersNegativeTestJSON-325727619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:27:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fe0e1f84-56d8-4acd-afb6-f6cb6cf5d0ea tempest-ServersNegativeTestJSON-325727619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:27:44 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-fe0e1f84-56d8-4acd-afb6-f6cb6cf5d0ea tempest-ServersNegativeTestJSON-325727619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-141574400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c2aec00-fe07-4e19-8fb1-a27a035fae5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d290499c2d94d12bb20fd20241a6bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:27:44Z,use_quota=True,user_id='e94b0c473abd4750978f139f2545c2f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:27:44 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-fe0e1f84-56d8-4acd-afb6-f6cb6cf5d0ea tempest-ServersNegativeTestJSON-325727619 None] Creating volume 0c2aec00-fe07-4e19-8fb1-a27a035fae5f {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:27:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fe0e1f84-56d8-4acd-afb6-f6cb6cf5d0ea tempest-ServersNegativeTestJSON-325727619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:27:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fe0e1f84-56d8-4acd-afb6-f6cb6cf5d0ea tempest-ServersNegativeTestJSON-325727619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:27:44 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-fe0e1f84-56d8-4acd-afb6-f6cb6cf5d0ea tempest-ServersNegativeTestJSON-325727619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:27:44 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-fe0e1f84-56d8-4acd-afb6-f6cb6cf5d0ea tempest-ServersNegativeTestJSON-325727619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:27:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fe0e1f84-56d8-4acd-afb6-f6cb6cf5d0ea tempest-ServersNegativeTestJSON-325727619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:27:44 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-fe0e1f84-56d8-4acd-afb6-f6cb6cf5d0ea tempest-ServersNegativeTestJSON-325727619 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:27:44 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-fe0e1f84-56d8-4acd-afb6-f6cb6cf5d0ea tempest-ServersNegativeTestJSON-325727619 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:27:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fe0e1f84-56d8-4acd-afb6-f6cb6cf5d0ea tempest-ServersNegativeTestJSON-325727619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0c2aec00-fe07-4e19-8fb1-a27a035fae5f 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:44 devstack sudo[91989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0c2aec00-fe07-4e19-8fb1-a27a035fae5f 1073741824 Jul 11 04:27:44 devstack sudo[91989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-688164eb-3ceb-490a-8413-ad81744610d1 req-753ba8a6-4138-4a87-81e8-351a9cd2235d tempest-AttachVolumeTestJSON-642925562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:27:44 devstack sudo[91979]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1c287a8e-320d-4fc9-96c9-903bc407bb09" returned: 0 in 0.758s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:44 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] Lock "cinder-quobyte-1c287a8e-320d-4fc9-96c9-903bc407bb09" released by "delete_volume" :: held 1.725s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:27:44 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] Created reservations ['46e7e482-fe49-433b-8904-feea1d7fe22e', 'e551731b-14ff-4445-abf2-3b07d7775b79', '86ac0720-3892-409f-a8aa-e7201eda37af', 'd0788435-dd35-41c5-8707-274d491ad488'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:27:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:27:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:27:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:27:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:27:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:27:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:45 devstack sudo[91993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:27:45 devstack sudo[91993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:45 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a5248c72-c539-4025-b80b-438378a77357 tempest-VolumesDeleteCascade-1995094936 None] Acquiring lock "cinder-714ba826-9874-4f9c-8a5a-4c020f5a6449-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:27:45 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a5248c72-c539-4025-b80b-438378a77357 tempest-VolumesDeleteCascade-1995094936 None] Lock "cinder-714ba826-9874-4f9c-8a5a-4c020f5a6449-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:27:45 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a5248c72-c539-4025-b80b-438378a77357 tempest-VolumesDeleteCascade-1995094936 None] Acquiring lock "cinder-quobyte-714ba826-9874-4f9c-8a5a-4c020f5a6449" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:27:45 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a5248c72-c539-4025-b80b-438378a77357 tempest-VolumesDeleteCascade-1995094936 None] Lock "cinder-quobyte-714ba826-9874-4f9c-8a5a-4c020f5a6449" acquired by "delete_volume" :: waited 0.023s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:27:45 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ec9c9f-793d-47ab-b1b0-33137418c46a]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:27:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a5248c72-c539-4025-b80b-438378a77357 tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-714ba826-9874-4f9c-8a5a-4c020f5a6449 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:45 devstack sudo[91998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-714ba826-9874-4f9c-8a5a-4c020f5a6449 Jul 11 04:27:45 devstack sudo[91998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:45 devstack sudo[91989]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fe0e1f84-56d8-4acd-afb6-f6cb6cf5d0ea tempest-ServersNegativeTestJSON-325727619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0c2aec00-fe07-4e19-8fb1-a27a035fae5f 1073741824" returned: 0 in 1.171s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fe0e1f84-56d8-4acd-afb6-f6cb6cf5d0ea tempest-ServersNegativeTestJSON-325727619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0c2aec00-fe07-4e19-8fb1-a27a035fae5f {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:46 devstack sudo[92001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0c2aec00-fe07-4e19-8fb1-a27a035fae5f Jul 11 04:27:46 devstack sudo[92001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:46 devstack sudo[91993]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 1.150s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:46 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:27:46 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] Deleted volume successfully. Jul 11 04:27:46 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4ee6acf1-56d5-4860-a073-7397c3257bf1 tempest-VolumesDeleteCascade-1995094936 None] Lock "cinder-1c287a8e-320d-4fc9-96c9-903bc407bb09-delete_volume" released by "delete_volume" :: held 6.597s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:27:46 devstack sudo[91998]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a5248c72-c539-4025-b80b-438378a77357 tempest-VolumesDeleteCascade-1995094936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-714ba826-9874-4f9c-8a5a-4c020f5a6449" returned: 0 in 1.185s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a5248c72-c539-4025-b80b-438378a77357 tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-714ba826-9874-4f9c-8a5a-4c020f5a6449 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:46 devstack sudo[92030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-714ba826-9874-4f9c-8a5a-4c020f5a6449 Jul 11 04:27:46 devstack sudo[92030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:46 devstack sudo[92001]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fe0e1f84-56d8-4acd-afb6-f6cb6cf5d0ea tempest-ServersNegativeTestJSON-325727619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0c2aec00-fe07-4e19-8fb1-a27a035fae5f" returned: 0 in 0.836s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:46 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-fe0e1f84-56d8-4acd-afb6-f6cb6cf5d0ea tempest-ServersNegativeTestJSON-325727619 None] <== create_volume: return (2112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:27:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fe0e1f84-56d8-4acd-afb6-f6cb6cf5d0ea tempest-ServersNegativeTestJSON-325727619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.115s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:27:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-688164eb-3ceb-490a-8413-ad81744610d1 req-753ba8a6-4138-4a87-81e8-351a9cd2235d tempest-AttachVolumeTestJSON-642925562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.954s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:27:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fe0e1f84-56d8-4acd-afb6-f6cb6cf5d0ea tempest-ServersNegativeTestJSON-325727619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e997074-42b2-49a5-bb3b-b76687b03876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c2aec00-fe07-4e19-8fb1-a27a035fae5f', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fe0e1f84-56d8-4acd-afb6-f6cb6cf5d0ea tempest-ServersNegativeTestJSON-325727619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23dfdb5d-7051-4dbd-8480-a5c85780de97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:46 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a459e9-2089-49df-b008-36d6241f3e31]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:27:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-688164eb-3ceb-490a-8413-ad81744610d1 req-753ba8a6-4138-4a87-81e8-351a9cd2235d tempest-AttachVolumeTestJSON-642925562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3afd5cbd-6afb-4e23-a0d9-9231f067c087 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:46 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-fe0e1f84-56d8-4acd-afb6-f6cb6cf5d0ea tempest-ServersNegativeTestJSON-325727619 None] Volume volume-0c2aec00-fe07-4e19-8fb1-a27a035fae5f (0c2aec00-fe07-4e19-8fb1-a27a035fae5f): created successfully Jul 11 04:27:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fe0e1f84-56d8-4acd-afb6-f6cb6cf5d0ea tempest-ServersNegativeTestJSON-325727619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23dfdb5d-7051-4dbd-8480-a5c85780de97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fe0e1f84-56d8-4acd-afb6-f6cb6cf5d0ea tempest-ServersNegativeTestJSON-325727619 None] Flow 'volume_create_manager' (ffd1b0b4-a6ea-4e20-9adb-2deaf670eef2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:27:46 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-fe0e1f84-56d8-4acd-afb6-f6cb6cf5d0ea tempest-ServersNegativeTestJSON-325727619 None] Created volume successfully. Jul 11 04:27:46 devstack sudo[92032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3afd5cbd-6afb-4e23-a0d9-9231f067c087 Jul 11 04:27:46 devstack sudo[92032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:47 devstack sudo[92030]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a5248c72-c539-4025-b80b-438378a77357 tempest-VolumesDeleteCascade-1995094936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-714ba826-9874-4f9c-8a5a-4c020f5a6449" returned: 0 in 0.678s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:47 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a5248c72-c539-4025-b80b-438378a77357 tempest-VolumesDeleteCascade-1995094936 None] Lock "cinder-quobyte-714ba826-9874-4f9c-8a5a-4c020f5a6449" released by "delete_volume" :: held 1.912s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:27:47 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-a5248c72-c539-4025-b80b-438378a77357 tempest-VolumesDeleteCascade-1995094936 None] Created reservations ['751ac6d0-589c-4413-abf2-fdd24ff1de7d', 'a75296a9-2521-4339-a831-d7febe70340b', 'cd88fc7c-9fdf-4160-afed-d3ac6ac9a66c', 'f0aec9b0-7bfd-4e81-811d-e31e918eccde'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:27:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a5248c72-c539-4025-b80b-438378a77357 tempest-VolumesDeleteCascade-1995094936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:27:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a5248c72-c539-4025-b80b-438378a77357 tempest-VolumesDeleteCascade-1995094936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:27:47 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-a5248c72-c539-4025-b80b-438378a77357 tempest-VolumesDeleteCascade-1995094936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:27:47 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-a5248c72-c539-4025-b80b-438378a77357 tempest-VolumesDeleteCascade-1995094936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:27:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a5248c72-c539-4025-b80b-438378a77357 tempest-VolumesDeleteCascade-1995094936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:27:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a5248c72-c539-4025-b80b-438378a77357 tempest-VolumesDeleteCascade-1995094936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:47 devstack sudo[92039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:27:47 devstack sudo[92039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:47 devstack sudo[92032]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-688164eb-3ceb-490a-8413-ad81744610d1 req-753ba8a6-4138-4a87-81e8-351a9cd2235d tempest-AttachVolumeTestJSON-642925562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3afd5cbd-6afb-4e23-a0d9-9231f067c087" returned: 0 in 0.788s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-688164eb-3ceb-490a-8413-ad81744610d1 req-753ba8a6-4138-4a87-81e8-351a9cd2235d tempest-AttachVolumeTestJSON-642925562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.826s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:27:47 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-688164eb-3ceb-490a-8413-ad81744610d1 req-753ba8a6-4138-4a87-81e8-351a9cd2235d tempest-AttachVolumeTestJSON-642925562 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95', 'name': 'volume-3afd5cbd-6afb-4e23-a0d9-9231f067c087', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '02940a15-c646-45d6-b500-1e61ed79dc73', 'enforce_multipath': True} {{(pid=86964) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 04:27:47 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-688164eb-3ceb-490a-8413-ad81744610d1 req-753ba8a6-4138-4a87-81e8-351a9cd2235d tempest-AttachVolumeTestJSON-642925562 None] attachment_update completed successfully. Jul 11 04:27:48 devstack sudo[92039]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a5248c72-c539-4025-b80b-438378a77357 tempest-VolumesDeleteCascade-1995094936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.710s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:48 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-a5248c72-c539-4025-b80b-438378a77357 tempest-VolumesDeleteCascade-1995094936 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:27:48 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-88877ced-b408-4ea9-8f3c-971e8c387138 tempest-ServersNegativeTestJSON-325727619 None] Acquiring lock "cinder-0c2aec00-fe07-4e19-8fb1-a27a035fae5f-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:27:48 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-a5248c72-c539-4025-b80b-438378a77357 tempest-VolumesDeleteCascade-1995094936 None] Deleted volume successfully. Jul 11 04:27:48 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-88877ced-b408-4ea9-8f3c-971e8c387138 tempest-ServersNegativeTestJSON-325727619 None] Lock "cinder-0c2aec00-fe07-4e19-8fb1-a27a035fae5f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:27:48 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a5248c72-c539-4025-b80b-438378a77357 tempest-VolumesDeleteCascade-1995094936 None] Lock "cinder-714ba826-9874-4f9c-8a5a-4c020f5a6449-delete_volume" released by "delete_volume" :: held 2.854s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:27:48 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-88877ced-b408-4ea9-8f3c-971e8c387138 tempest-ServersNegativeTestJSON-325727619 None] Acquiring lock "cinder-quobyte-0c2aec00-fe07-4e19-8fb1-a27a035fae5f" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:27:48 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-88877ced-b408-4ea9-8f3c-971e8c387138 tempest-ServersNegativeTestJSON-325727619 None] Lock "cinder-quobyte-0c2aec00-fe07-4e19-8fb1-a27a035fae5f" acquired by "delete_volume" :: waited 0.014s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:27:48 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e222a3-4a04-4a96-93c4-8196b2ffa30e]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:27:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-88877ced-b408-4ea9-8f3c-971e8c387138 tempest-ServersNegativeTestJSON-325727619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0c2aec00-fe07-4e19-8fb1-a27a035fae5f {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:48 devstack sudo[92066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0c2aec00-fe07-4e19-8fb1-a27a035fae5f Jul 11 04:27:48 devstack sudo[92066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:49 devstack sudo[92066]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-88877ced-b408-4ea9-8f3c-971e8c387138 tempest-ServersNegativeTestJSON-325727619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0c2aec00-fe07-4e19-8fb1-a27a035fae5f" returned: 0 in 0.858s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-88877ced-b408-4ea9-8f3c-971e8c387138 tempest-ServersNegativeTestJSON-325727619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0c2aec00-fe07-4e19-8fb1-a27a035fae5f {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:49 devstack sudo[92073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0c2aec00-fe07-4e19-8fb1-a27a035fae5f Jul 11 04:27:49 devstack sudo[92073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:49 devstack sudo[92073]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-88877ced-b408-4ea9-8f3c-971e8c387138 tempest-ServersNegativeTestJSON-325727619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0c2aec00-fe07-4e19-8fb1-a27a035fae5f" returned: 0 in 0.628s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:49 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-88877ced-b408-4ea9-8f3c-971e8c387138 tempest-ServersNegativeTestJSON-325727619 None] Lock "cinder-quobyte-0c2aec00-fe07-4e19-8fb1-a27a035fae5f" released by "delete_volume" :: held 1.522s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:27:49 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-88877ced-b408-4ea9-8f3c-971e8c387138 tempest-ServersNegativeTestJSON-325727619 None] Created reservations ['bcf91c97-cfdb-4d72-a872-d6a35c1798bb', '22839182-1328-4ca3-8f5f-3cdb2f8f1f7c', 'c6aee7d8-e08b-405f-b5e0-034349929e1f', '099c4b56-dde2-4c76-9db6-d88b7aa46de4'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:27:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-88877ced-b408-4ea9-8f3c-971e8c387138 tempest-ServersNegativeTestJSON-325727619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:27:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-88877ced-b408-4ea9-8f3c-971e8c387138 tempest-ServersNegativeTestJSON-325727619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:27:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-88877ced-b408-4ea9-8f3c-971e8c387138 tempest-ServersNegativeTestJSON-325727619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:27:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-88877ced-b408-4ea9-8f3c-971e8c387138 tempest-ServersNegativeTestJSON-325727619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:27:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-88877ced-b408-4ea9-8f3c-971e8c387138 tempest-ServersNegativeTestJSON-325727619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:27:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-88877ced-b408-4ea9-8f3c-971e8c387138 tempest-ServersNegativeTestJSON-325727619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:49 devstack sudo[92076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:27:49 devstack sudo[92076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4d631fc8-17e1-4585-b4c6-6b096f0a1a50 tempest-ServersNegativeTestJSON-325727619 None] Acquiring lock "cinder-d4c2d617-ec1b-47ca-a24c-53c895a1acc9-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:27:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4d631fc8-17e1-4585-b4c6-6b096f0a1a50 tempest-ServersNegativeTestJSON-325727619 None] Lock "cinder-d4c2d617-ec1b-47ca-a24c-53c895a1acc9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:27:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4d631fc8-17e1-4585-b4c6-6b096f0a1a50 tempest-ServersNegativeTestJSON-325727619 None] Acquiring lock "cinder-quobyte-d4c2d617-ec1b-47ca-a24c-53c895a1acc9" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:27:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4d631fc8-17e1-4585-b4c6-6b096f0a1a50 tempest-ServersNegativeTestJSON-325727619 None] Lock "cinder-quobyte-d4c2d617-ec1b-47ca-a24c-53c895a1acc9" acquired by "delete_volume" :: waited 0.021s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:27:50 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57b9eab-125e-4d86-9895-342b1840d51d]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:27:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4d631fc8-17e1-4585-b4c6-6b096f0a1a50 tempest-ServersNegativeTestJSON-325727619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4c2d617-ec1b-47ca-a24c-53c895a1acc9 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:50 devstack sudo[92076]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-88877ced-b408-4ea9-8f3c-971e8c387138 tempest-ServersNegativeTestJSON-325727619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.675s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:50 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-88877ced-b408-4ea9-8f3c-971e8c387138 tempest-ServersNegativeTestJSON-325727619 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:27:50 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-88877ced-b408-4ea9-8f3c-971e8c387138 tempest-ServersNegativeTestJSON-325727619 None] Deleted volume successfully. Jul 11 04:27:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-88877ced-b408-4ea9-8f3c-971e8c387138 tempest-ServersNegativeTestJSON-325727619 None] Lock "cinder-0c2aec00-fe07-4e19-8fb1-a27a035fae5f-delete_volume" released by "delete_volume" :: held 2.423s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:27:50 devstack sudo[92079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4c2d617-ec1b-47ca-a24c-53c895a1acc9 Jul 11 04:27:50 devstack sudo[92079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:50 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f4225f2-8a5c-4c8a-aa13-64fa1113e576 tempest-VolumesCloneTest-1315988380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:27:50 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2f4225f2-8a5c-4c8a-aa13-64fa1113e576 tempest-VolumesCloneTest-1315988380 None] Flow 'volume_create_manager' (1cf5c49a-2c7a-49d5-9bb4-343f4d986f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:27:50 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2f4225f2-8a5c-4c8a-aa13-64fa1113e576 tempest-VolumesCloneTest-1315988380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5546ade7-24ba-4cfa-978c-b2b116765d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:50 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2f4225f2-8a5c-4c8a-aa13-64fa1113e576 tempest-VolumesCloneTest-1315988380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5546ade7-24ba-4cfa-978c-b2b116765d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-645585748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3df4a71e-421c-47fb-afb3-2ba8425fc7a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb935e950bb4a8f9bd154f6a9319ad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:27:51Z,use_quota=True,user_id='2adde34f02c04af4ba0c3def82e3c5ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:50 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2f4225f2-8a5c-4c8a-aa13-64fa1113e576 tempest-VolumesCloneTest-1315988380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd07f5d5-f2a5-4096-b087-ff7cf430633c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:50 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2f4225f2-8a5c-4c8a-aa13-64fa1113e576 tempest-VolumesCloneTest-1315988380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd07f5d5-f2a5-4096-b087-ff7cf430633c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:50 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2f4225f2-8a5c-4c8a-aa13-64fa1113e576 tempest-VolumesCloneTest-1315988380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8175d677-91a7-4dbc-ac31-3c10c7a1890e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:50 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2f4225f2-8a5c-4c8a-aa13-64fa1113e576 tempest-VolumesCloneTest-1315988380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8175d677-91a7-4dbc-ac31-3c10c7a1890e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3df4a71e-421c-47fb-afb3-2ba8425fc7a3', 'volume_name': 'volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:50 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2f4225f2-8a5c-4c8a-aa13-64fa1113e576 tempest-VolumesCloneTest-1315988380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab527b6-cf6b-4055-9310-b0a17eefa5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:50 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2f4225f2-8a5c-4c8a-aa13-64fa1113e576 tempest-VolumesCloneTest-1315988380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab527b6-cf6b-4055-9310-b0a17eefa5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:50 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2f4225f2-8a5c-4c8a-aa13-64fa1113e576 tempest-VolumesCloneTest-1315988380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8bdd5f5-153b-4267-b190-ca364e42b10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:50 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-2f4225f2-8a5c-4c8a-aa13-64fa1113e576 tempest-VolumesCloneTest-1315988380 None] Volume 3df4a71e-421c-47fb-afb3-2ba8425fc7a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3', 'volume_size': 1} Jul 11 04:27:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2f4225f2-8a5c-4c8a-aa13-64fa1113e576 tempest-VolumesCloneTest-1315988380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:27:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2f4225f2-8a5c-4c8a-aa13-64fa1113e576 tempest-VolumesCloneTest-1315988380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:27:50 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2f4225f2-8a5c-4c8a-aa13-64fa1113e576 tempest-VolumesCloneTest-1315988380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-645585748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3df4a71e-421c-47fb-afb3-2ba8425fc7a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb935e950bb4a8f9bd154f6a9319ad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:27:51Z,use_quota=True,user_id='2adde34f02c04af4ba0c3def82e3c5ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:27:50 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-2f4225f2-8a5c-4c8a-aa13-64fa1113e576 tempest-VolumesCloneTest-1315988380 None] Creating volume 3df4a71e-421c-47fb-afb3-2ba8425fc7a3 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:27:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2f4225f2-8a5c-4c8a-aa13-64fa1113e576 tempest-VolumesCloneTest-1315988380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:27:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2f4225f2-8a5c-4c8a-aa13-64fa1113e576 tempest-VolumesCloneTest-1315988380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:27:50 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2f4225f2-8a5c-4c8a-aa13-64fa1113e576 tempest-VolumesCloneTest-1315988380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:27:50 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2f4225f2-8a5c-4c8a-aa13-64fa1113e576 tempest-VolumesCloneTest-1315988380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:27:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2f4225f2-8a5c-4c8a-aa13-64fa1113e576 tempest-VolumesCloneTest-1315988380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:27:50 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2f4225f2-8a5c-4c8a-aa13-64fa1113e576 tempest-VolumesCloneTest-1315988380 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:27:50 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-2f4225f2-8a5c-4c8a-aa13-64fa1113e576 tempest-VolumesCloneTest-1315988380 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:27:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2f4225f2-8a5c-4c8a-aa13-64fa1113e576 tempest-VolumesCloneTest-1315988380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:51 devstack sudo[92081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3 1073741824 Jul 11 04:27:51 devstack sudo[92081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:51 devstack sudo[92079]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4d631fc8-17e1-4585-b4c6-6b096f0a1a50 tempest-ServersNegativeTestJSON-325727619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4c2d617-ec1b-47ca-a24c-53c895a1acc9" returned: 0 in 0.792s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4d631fc8-17e1-4585-b4c6-6b096f0a1a50 tempest-ServersNegativeTestJSON-325727619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4c2d617-ec1b-47ca-a24c-53c895a1acc9 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:51 devstack sudo[92086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4c2d617-ec1b-47ca-a24c-53c895a1acc9 Jul 11 04:27:51 devstack sudo[92086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:51 devstack sudo[92081]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2f4225f2-8a5c-4c8a-aa13-64fa1113e576 tempest-VolumesCloneTest-1315988380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3 1073741824" returned: 0 in 0.834s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2f4225f2-8a5c-4c8a-aa13-64fa1113e576 tempest-VolumesCloneTest-1315988380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:51 devstack sudo[92091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3 Jul 11 04:27:51 devstack sudo[92091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:51 devstack sudo[92086]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4d631fc8-17e1-4585-b4c6-6b096f0a1a50 tempest-ServersNegativeTestJSON-325727619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4c2d617-ec1b-47ca-a24c-53c895a1acc9" returned: 0 in 0.644s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:52 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4d631fc8-17e1-4585-b4c6-6b096f0a1a50 tempest-ServersNegativeTestJSON-325727619 None] Lock "cinder-quobyte-d4c2d617-ec1b-47ca-a24c-53c895a1acc9" released by "delete_volume" :: held 1.478s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:27:52 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-4d631fc8-17e1-4585-b4c6-6b096f0a1a50 tempest-ServersNegativeTestJSON-325727619 None] Created reservations ['57db0e9f-9286-4594-bd52-63b052bb91d6', '22f35380-a644-4971-83fb-9cbb7337ec7c', '75c08737-249d-4d28-b88f-308fb3b39cf3', 'a867c471-3c12-4a06-8865-eb8b0da4a1da'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:27:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4d631fc8-17e1-4585-b4c6-6b096f0a1a50 tempest-ServersNegativeTestJSON-325727619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:27:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4d631fc8-17e1-4585-b4c6-6b096f0a1a50 tempest-ServersNegativeTestJSON-325727619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:27:52 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4d631fc8-17e1-4585-b4c6-6b096f0a1a50 tempest-ServersNegativeTestJSON-325727619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:27:52 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4d631fc8-17e1-4585-b4c6-6b096f0a1a50 tempest-ServersNegativeTestJSON-325727619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:27:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4d631fc8-17e1-4585-b4c6-6b096f0a1a50 tempest-ServersNegativeTestJSON-325727619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:27:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4d631fc8-17e1-4585-b4c6-6b096f0a1a50 tempest-ServersNegativeTestJSON-325727619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:52 devstack sudo[92094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:27:52 devstack sudo[92094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:52 devstack sudo[92091]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2f4225f2-8a5c-4c8a-aa13-64fa1113e576 tempest-VolumesCloneTest-1315988380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3" returned: 0 in 0.665s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:52 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2f4225f2-8a5c-4c8a-aa13-64fa1113e576 tempest-VolumesCloneTest-1315988380 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:27:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2f4225f2-8a5c-4c8a-aa13-64fa1113e576 tempest-VolumesCloneTest-1315988380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:27:52 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2f4225f2-8a5c-4c8a-aa13-64fa1113e576 tempest-VolumesCloneTest-1315988380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8bdd5f5-153b-4267-b190-ca364e42b10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:52 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2f4225f2-8a5c-4c8a-aa13-64fa1113e576 tempest-VolumesCloneTest-1315988380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb9f791f-0ea2-4864-98af-f86e3e08dd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:52 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-2f4225f2-8a5c-4c8a-aa13-64fa1113e576 tempest-VolumesCloneTest-1315988380 None] Volume volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3 (3df4a71e-421c-47fb-afb3-2ba8425fc7a3): created successfully Jul 11 04:27:52 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2f4225f2-8a5c-4c8a-aa13-64fa1113e576 tempest-VolumesCloneTest-1315988380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb9f791f-0ea2-4864-98af-f86e3e08dd93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:52 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2f4225f2-8a5c-4c8a-aa13-64fa1113e576 tempest-VolumesCloneTest-1315988380 None] Flow 'volume_create_manager' (1cf5c49a-2c7a-49d5-9bb4-343f4d986f18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:27:52 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-2f4225f2-8a5c-4c8a-aa13-64fa1113e576 tempest-VolumesCloneTest-1315988380 None] Created volume successfully. Jul 11 04:27:52 devstack sudo[92094]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4d631fc8-17e1-4585-b4c6-6b096f0a1a50 tempest-ServersNegativeTestJSON-325727619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.639s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:52 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-4d631fc8-17e1-4585-b4c6-6b096f0a1a50 tempest-ServersNegativeTestJSON-325727619 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:27:52 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-4d631fc8-17e1-4585-b4c6-6b096f0a1a50 tempest-ServersNegativeTestJSON-325727619 None] Deleted volume successfully. Jul 11 04:27:52 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4d631fc8-17e1-4585-b4c6-6b096f0a1a50 tempest-ServersNegativeTestJSON-325727619 None] Lock "cinder-d4c2d617-ec1b-47ca-a24c-53c895a1acc9-delete_volume" released by "delete_volume" :: held 2.342s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:27:53 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:27:53 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Flow 'volume_create_manager' (b77bc28a-76d6-43be-8f73-020ec4d6fb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:27:53 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e8628ce-dea0-4497-b946-664e5ae83dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:53 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e8628ce-dea0-4497-b946-664e5ae83dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1518651529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cadf6fee-3649-4781-8d61-c95f0b803008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb935e950bb4a8f9bd154f6a9319ad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:27:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=3df4a71e-421c-47fb-afb3-2ba8425fc7a3,status='creating',terminated_at=None,updated_at=2026-07-11T02:27:53Z,use_quota=True,user_id='2adde34f02c04af4ba0c3def82e3c5ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:53 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d247d389-ee49-4c81-9b98-b02ef5cfe16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:53 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d247d389-ee49-4c81-9b98-b02ef5cfe16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:53 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ed24fad-682f-4592-9095-b5844de0ad54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:53 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ed24fad-682f-4592-9095-b5844de0ad54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cadf6fee-3649-4781-8d61-c95f0b803008', 'volume_name': 'volume-cadf6fee-3649-4781-8d61-c95f0b803008', 'volume_size': 2, 'source_volid': '3df4a71e-421c-47fb-afb3-2ba8425fc7a3', 'source_volstatus': 'available'}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:53 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5449b4c-7d42-45ca-a9a2-fa7661f10ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:53 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5449b4c-7d42-45ca-a9a2-fa7661f10ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:27:53 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17936a93-23c3-4f51-804b-ae98a712c3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:27:53 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Volume cadf6fee-3649-4781-8d61-c95f0b803008: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cadf6fee-3649-4781-8d61-c95f0b803008', 'volume_size': 2, 'source_volid': '3df4a71e-421c-47fb-afb3-2ba8425fc7a3', 'source_volstatus': 'available'} Jul 11 04:27:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:27:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:27:53 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Cloning volume 3df4a71e-421c-47fb-afb3-2ba8425fc7a3 to volume cadf6fee-3649-4781-8d61-c95f0b803008 Jul 11 04:27:53 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Creating offline snapshot aa6bf6ee-9ff9-4859-b724-5b14d0f6795a of volume 3df4a71e-421c-47fb-afb3-2ba8425fc7a3 {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:27:53 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[0471c751-436c-4793-8793-6189ba66fb72]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:27:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:53 devstack sudo[92102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3 Jul 11 04:27:53 devstack sudo[92102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:54 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-f1aa571b-3980-4bca-b02a-a71ace8d30e4 req-ea346dcc-e0c6-4f01-8364-fbfd532fba92 tempest-AttachVolumeTestJSON-642925562 None] Terminate volume connection completed successfully. Jul 11 04:27:54 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-f1aa571b-3980-4bca-b02a-a71ace8d30e4 req-ea346dcc-e0c6-4f01-8364-fbfd532fba92 tempest-AttachVolumeTestJSON-642925562 None] Deleting attachment 282a2d37-74a3-41a9-9cf4-09787bdb5296. {{(pid=86964) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 04:27:54 devstack sudo[92102]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3" returned: 0 in 0.941s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3.aa6bf6ee-9ff9-4859-b724-5b14d0f6795a 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:54 devstack sudo[92115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3.aa6bf6ee-9ff9-4859-b724-5b14d0f6795a 1G Jul 11 04:27:54 devstack sudo[92115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:55 devstack sudo[92115]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3.aa6bf6ee-9ff9-4859-b724-5b14d0f6795a 1G" returned: 0 in 1.166s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3.aa6bf6ee-9ff9-4859-b724-5b14d0f6795a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:55 devstack sudo[92139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3.aa6bf6ee-9ff9-4859-b724-5b14d0f6795a Jul 11 04:27:55 devstack sudo[92139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:56 devstack sudo[92139]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3.aa6bf6ee-9ff9-4859-b724-5b14d0f6795a" returned: 0 in 0.773s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:56 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3.aa6bf6ee-9ff9-4859-b724-5b14d0f6795a is being set with open permissions: ugo+rw Jul 11 04:27:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3.aa6bf6ee-9ff9-4859-b724-5b14d0f6795a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:56 devstack sudo[92146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3.aa6bf6ee-9ff9-4859-b724-5b14d0f6795a Jul 11 04:27:56 devstack sudo[92146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:56 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-b8b525b3-2a2a-47cb-a125-1f195c1853bc req-5955bc3e-7d9c-4a3d-b4a0-b6ee7eeefbe5 tempest-AttachVolumeTestJSON-642925562 None] Terminate volume connection completed successfully. Jul 11 04:27:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-b8b525b3-2a2a-47cb-a125-1f195c1853bc req-5955bc3e-7d9c-4a3d-b4a0-b6ee7eeefbe5 tempest-AttachVolumeTestJSON-642925562 None] Deleting attachment 02940a15-c646-45d6-b500-1e61ed79dc73. {{(pid=86964) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 04:27:57 devstack sudo[92146]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3.aa6bf6ee-9ff9-4859-b724-5b14d0f6795a" returned: 0 in 0.666s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:57 devstack sudo[92151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3.info Jul 11 04:27:57 devstack sudo[92151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:57 devstack sudo[92151]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3.info" returned: 0 in 0.645s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:57 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3.info is being set with open permissions: ugo+rw Jul 11 04:27:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:57 devstack sudo[92155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3.info Jul 11 04:27:57 devstack sudo[92155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:58 devstack sudo[92155]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3.info" returned: 0 in 0.666s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:58 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Acquiring lock "cinder-quobyte-cadf6fee-3649-4781-8d61-c95f0b803008" by "_copy_volume_from_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:27:58 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Lock "cinder-quobyte-cadf6fee-3649-4781-8d61-c95f0b803008" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:27:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] snapshot: aa6bf6ee-9ff9-4859-b724-5b14d0f6795a, volume: cadf6fee-3649-4781-8d61-c95f0b803008, {{(pid=86964) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 04:27:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:27:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:27:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:27:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:27:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:27:58 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbee0488-32e0-4af3-97de-0d879ed369d9]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:27:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3.aa6bf6ee-9ff9-4859-b724-5b14d0f6795a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:58 devstack sudo[92160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3.aa6bf6ee-9ff9-4859-b724-5b14d0f6795a Jul 11 04:27:58 devstack sudo[92160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:59 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:27:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:27:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:27:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:27:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:27:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:27:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:59 devstack sudo[92180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:27:59 devstack sudo[92180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:59 devstack sudo[92160]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3.aa6bf6ee-9ff9-4859-b724-5b14d0f6795a" returned: 0 in 0.946s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:27:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3 {{(pid=86964) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 04:27:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Creating direct copy from snapshot {{(pid=86964) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 04:27:59 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[46672dc8-2580-4697-a6c8-51ae253e69e1]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:27:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:27:59 devstack sudo[92209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3 Jul 11 04:27:59 devstack sudo[92209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:27:59 devstack sudo[92180]: pam_unix(sudo:session): session closed for user root Jul 11 04:27:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.870s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:27:59 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:28:00 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager._thread_info {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:28:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread count: 8 {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:28:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread info: [<_MainThread(MainThread, started 124675027595392)>, , , , , , , ] {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:28:00 devstack sudo[92209]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3" returned: 0 in 0.858s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:00 devstack cinder-volume[86964]: DEBUG cinder.utils [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Path /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-cadf6fee-3649-4781-8d61-c95f0b803008 not found in is_blk_device check {{(pid=86964) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 04:28:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-cadf6fee-3649-4781-8d61-c95f0b803008 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:00 devstack sudo[92217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-cadf6fee-3649-4781-8d61-c95f0b803008 Jul 11 04:28:00 devstack sudo[92217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-8255c850-474a-4c8e-b9c8-95b8faf7c781 req-bbe046d5-2d6b-4fe1-a5cd-e807dc36ddff tempest-ServerActionsTestOtherA-1035839598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:28:06 devstack sudo[92217]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-cadf6fee-3649-4781-8d61-c95f0b803008" returned: 0 in 6.261s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:06 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f486902-e091-47cd-9b12-e95ea80ee101]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:28:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:06 devstack sudo[92282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3 Jul 11 04:28:06 devstack sudo[92282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:07 devstack sudo[92282]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3" returned: 0 in 1.004s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:07 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Image conversion details: src /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3, size 1024.00 MB, duration 6.26 sec, destination /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-cadf6fee-3649-4781-8d61-c95f0b803008 {{(pid=86964) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 04:28:07 devstack cinder-volume[86964]: INFO cinder.image.image_utils [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Converted 1024.00 MB image at 163.51 MB/s Jul 11 04:28:07 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-cadf6fee-3649-4781-8d61-c95f0b803008 is being set with open permissions: ugo+rw Jul 11 04:28:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-cadf6fee-3649-4781-8d61-c95f0b803008 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:07 devstack sudo[92287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-cadf6fee-3649-4781-8d61-c95f0b803008 Jul 11 04:28:07 devstack sudo[92287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:08 devstack sudo[92287]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-cadf6fee-3649-4781-8d61-c95f0b803008" returned: 0 in 0.684s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:08 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Lock "cinder-quobyte-cadf6fee-3649-4781-8d61-c95f0b803008" released by "_copy_volume_from_snapshot" :: held 9.847s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:28:08 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Acquiring lock "cinder-quobyte-aa6bf6ee-9ff9-4859-b724-5b14d0f6795a" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:28:08 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Lock "cinder-quobyte-aa6bf6ee-9ff9-4859-b724-5b14d0f6795a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:28:08 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Deleting offline snapshot aa6bf6ee-9ff9-4859-b724-5b14d0f6795a of volume 3df4a71e-421c-47fb-afb3-2ba8425fc7a3 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:28:08 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] snapshot_file for this snap is: volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3.aa6bf6ee-9ff9-4859-b724-5b14d0f6795a {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:28:08 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e0bfe5-f61b-4988-a33e-5067c7b9e324]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:28:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3.aa6bf6ee-9ff9-4859-b724-5b14d0f6795a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:08 devstack sudo[92291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3.aa6bf6ee-9ff9-4859-b724-5b14d0f6795a Jul 11 04:28:08 devstack sudo[92291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:09 devstack sudo[92291]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3.aa6bf6ee-9ff9-4859-b724-5b14d0f6795a" returned: 0 in 0.859s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:09 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:28:09 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8478a0c-1ef2-42f8-8d52-19e3f2a484f5]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:28:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:09 devstack sudo[92296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3 Jul 11 04:28:09 devstack sudo[92296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:09 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-538c952f-bf39-4429-9ad9-244cad10c616 tempest-AttachVolumeTestJSON-642925562 None] Acquiring lock "cinder-3afd5cbd-6afb-4e23-a0d9-9231f067c087-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:28:09 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-538c952f-bf39-4429-9ad9-244cad10c616 tempest-AttachVolumeTestJSON-642925562 None] Lock "cinder-3afd5cbd-6afb-4e23-a0d9-9231f067c087-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:28:09 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-538c952f-bf39-4429-9ad9-244cad10c616 tempest-AttachVolumeTestJSON-642925562 None] Acquiring lock "cinder-quobyte-3afd5cbd-6afb-4e23-a0d9-9231f067c087" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:28:09 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-538c952f-bf39-4429-9ad9-244cad10c616 tempest-AttachVolumeTestJSON-642925562 None] Lock "cinder-quobyte-3afd5cbd-6afb-4e23-a0d9-9231f067c087" acquired by "delete_volume" :: waited 0.017s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:28:09 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed251883-8823-4eef-b72d-e0e8db4e6818]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:28:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-538c952f-bf39-4429-9ad9-244cad10c616 tempest-AttachVolumeTestJSON-642925562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3afd5cbd-6afb-4e23-a0d9-9231f067c087 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:09 devstack sudo[92298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3afd5cbd-6afb-4e23-a0d9-9231f067c087 Jul 11 04:28:09 devstack sudo[92298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:10 devstack sudo[92296]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3" returned: 0 in 0.846s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3.aa6bf6ee-9ff9-4859-b724-5b14d0f6795a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:10 devstack sudo[92303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3.aa6bf6ee-9ff9-4859-b724-5b14d0f6795a Jul 11 04:28:10 devstack sudo[92303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:10 devstack sudo[92298]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-538c952f-bf39-4429-9ad9-244cad10c616 tempest-AttachVolumeTestJSON-642925562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3afd5cbd-6afb-4e23-a0d9-9231f067c087" returned: 0 in 0.839s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-538c952f-bf39-4429-9ad9-244cad10c616 tempest-AttachVolumeTestJSON-642925562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3afd5cbd-6afb-4e23-a0d9-9231f067c087 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:10 devstack sudo[92308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3afd5cbd-6afb-4e23-a0d9-9231f067c087 Jul 11 04:28:10 devstack sudo[92308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:11 devstack sudo[92303]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3.aa6bf6ee-9ff9-4859-b724-5b14d0f6795a" returned: 0 in 0.840s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3.aa6bf6ee-9ff9-4859-b724-5b14d0f6795a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:11 devstack sudo[92314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3.aa6bf6ee-9ff9-4859-b724-5b14d0f6795a Jul 11 04:28:11 devstack sudo[92314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:11 devstack sudo[92308]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-538c952f-bf39-4429-9ad9-244cad10c616 tempest-AttachVolumeTestJSON-642925562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3afd5cbd-6afb-4e23-a0d9-9231f067c087" returned: 0 in 0.689s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:11 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-538c952f-bf39-4429-9ad9-244cad10c616 tempest-AttachVolumeTestJSON-642925562 None] Lock "cinder-quobyte-3afd5cbd-6afb-4e23-a0d9-9231f067c087" released by "delete_volume" :: held 1.567s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:28:11 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-538c952f-bf39-4429-9ad9-244cad10c616 tempest-AttachVolumeTestJSON-642925562 None] Created reservations ['3c89fcdb-80f3-441c-80bb-4fab61256fc3', '065f1930-6332-4b3e-918d-2f21ae330d84', '584b58fe-86bc-484d-8c69-0da20597e852', '2e9f0e4d-16e8-49a4-a55b-f9e759f54449'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:28:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-538c952f-bf39-4429-9ad9-244cad10c616 tempest-AttachVolumeTestJSON-642925562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:28:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-538c952f-bf39-4429-9ad9-244cad10c616 tempest-AttachVolumeTestJSON-642925562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:28:11 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-538c952f-bf39-4429-9ad9-244cad10c616 tempest-AttachVolumeTestJSON-642925562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:28:11 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-538c952f-bf39-4429-9ad9-244cad10c616 tempest-AttachVolumeTestJSON-642925562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:28:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-538c952f-bf39-4429-9ad9-244cad10c616 tempest-AttachVolumeTestJSON-642925562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:28:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-538c952f-bf39-4429-9ad9-244cad10c616 tempest-AttachVolumeTestJSON-642925562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:11 devstack sudo[92317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:28:11 devstack sudo[92317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:11 devstack sudo[92314]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3.aa6bf6ee-9ff9-4859-b724-5b14d0f6795a" returned: 0 in 0.668s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:11 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Lock "cinder-quobyte-aa6bf6ee-9ff9-4859-b724-5b14d0f6795a" released by "_delete_snapshot" :: held 3.336s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:28:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.223s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:28:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-8255c850-474a-4c8e-b9c8-95b8faf7c781 req-bbe046d5-2d6b-4fe1-a5cd-e807dc36ddff tempest-ServerActionsTestOtherA-1035839598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.132s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:28:11 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17936a93-23c3-4f51-804b-ae98a712c3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cadf6fee-3649-4781-8d61-c95f0b803008', 'volume_size': 2, 'source_volid': '3df4a71e-421c-47fb-afb3-2ba8425fc7a3', 'source_volstatus': 'available'}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:28:11 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (360644b2-b6a6-48e3-ae97-e735d46427af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:28:11 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[46781d12-d476-4a3a-a0c7-33c06a783988]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:28:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-8255c850-474a-4c8e-b9c8-95b8faf7c781 req-bbe046d5-2d6b-4fe1-a5cd-e807dc36ddff tempest-ServerActionsTestOtherA-1035839598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0db52474-5f6d-4c6d-93be-ef4e54a2a54b {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:11 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Volume volume-cadf6fee-3649-4781-8d61-c95f0b803008 (cadf6fee-3649-4781-8d61-c95f0b803008): created successfully Jul 11 04:28:11 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (360644b2-b6a6-48e3-ae97-e735d46427af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:28:11 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Flow 'volume_create_manager' (b77bc28a-76d6-43be-8f73-020ec4d6fb72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:28:11 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-49e8c09a-d288-4672-8664-b04166eccaed tempest-VolumesCloneTest-1315988380 None] Created volume successfully. Jul 11 04:28:12 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-64cc4f40-17d5-442d-8ca2-a71e0f30b181 tempest-AttachVolumeTestJSON-642925562 None] Acquiring lock "cinder-fff40e2d-137a-4b57-8ebc-6aedaaa6af34-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:28:12 devstack sudo[92320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0db52474-5f6d-4c6d-93be-ef4e54a2a54b Jul 11 04:28:12 devstack sudo[92320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:12 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-64cc4f40-17d5-442d-8ca2-a71e0f30b181 tempest-AttachVolumeTestJSON-642925562 None] Lock "cinder-fff40e2d-137a-4b57-8ebc-6aedaaa6af34-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:28:12 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-64cc4f40-17d5-442d-8ca2-a71e0f30b181 tempest-AttachVolumeTestJSON-642925562 None] Acquiring lock "cinder-quobyte-fff40e2d-137a-4b57-8ebc-6aedaaa6af34" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:28:12 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-64cc4f40-17d5-442d-8ca2-a71e0f30b181 tempest-AttachVolumeTestJSON-642925562 None] Lock "cinder-quobyte-fff40e2d-137a-4b57-8ebc-6aedaaa6af34" acquired by "delete_volume" :: waited 0.039s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:28:12 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[849002aa-f42f-40a3-89ef-5ee844ba60fc]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:28:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-64cc4f40-17d5-442d-8ca2-a71e0f30b181 tempest-AttachVolumeTestJSON-642925562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fff40e2d-137a-4b57-8ebc-6aedaaa6af34 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:12 devstack sudo[92317]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-538c952f-bf39-4429-9ad9-244cad10c616 tempest-AttachVolumeTestJSON-642925562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.843s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:12 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-538c952f-bf39-4429-9ad9-244cad10c616 tempest-AttachVolumeTestJSON-642925562 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:28:12 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-538c952f-bf39-4429-9ad9-244cad10c616 tempest-AttachVolumeTestJSON-642925562 None] Deleted volume successfully. Jul 11 04:28:12 devstack sudo[92323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fff40e2d-137a-4b57-8ebc-6aedaaa6af34 Jul 11 04:28:12 devstack sudo[92323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:12 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-538c952f-bf39-4429-9ad9-244cad10c616 tempest-AttachVolumeTestJSON-642925562 None] Lock "cinder-3afd5cbd-6afb-4e23-a0d9-9231f067c087-delete_volume" released by "delete_volume" :: held 2.681s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:28:12 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e8520975-5159-4ebb-83d2-153f0bda8932 tempest-VolumesCloneTest-1315988380 None] Acquiring lock "cinder-cadf6fee-3649-4781-8d61-c95f0b803008-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:28:12 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e8520975-5159-4ebb-83d2-153f0bda8932 tempest-VolumesCloneTest-1315988380 None] Lock "cinder-cadf6fee-3649-4781-8d61-c95f0b803008-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:28:12 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e8520975-5159-4ebb-83d2-153f0bda8932 tempest-VolumesCloneTest-1315988380 None] Acquiring lock "cinder-quobyte-cadf6fee-3649-4781-8d61-c95f0b803008" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:28:12 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e8520975-5159-4ebb-83d2-153f0bda8932 tempest-VolumesCloneTest-1315988380 None] Lock "cinder-quobyte-cadf6fee-3649-4781-8d61-c95f0b803008" acquired by "delete_volume" :: waited 0.033s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:28:12 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[291d405a-c576-4f90-8d24-bd23a3062b18]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:28:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e8520975-5159-4ebb-83d2-153f0bda8932 tempest-VolumesCloneTest-1315988380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-cadf6fee-3649-4781-8d61-c95f0b803008 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:12 devstack sudo[92320]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-8255c850-474a-4c8e-b9c8-95b8faf7c781 req-bbe046d5-2d6b-4fe1-a5cd-e807dc36ddff tempest-ServerActionsTestOtherA-1035839598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0db52474-5f6d-4c6d-93be-ef4e54a2a54b" returned: 0 in 0.940s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-8255c850-474a-4c8e-b9c8-95b8faf7c781 req-bbe046d5-2d6b-4fe1-a5cd-e807dc36ddff tempest-ServerActionsTestOtherA-1035839598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.997s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:28:12 devstack sudo[92329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-cadf6fee-3649-4781-8d61-c95f0b803008 Jul 11 04:28:12 devstack sudo[92329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:12 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-8255c850-474a-4c8e-b9c8-95b8faf7c781 req-bbe046d5-2d6b-4fe1-a5cd-e807dc36ddff tempest-ServerActionsTestOtherA-1035839598 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95', 'name': 'volume-0db52474-5f6d-4c6d-93be-ef4e54a2a54b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a05ddc12-60dd-428e-b826-49970788d9c9', 'enforce_multipath': True} {{(pid=86964) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 04:28:12 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-8255c850-474a-4c8e-b9c8-95b8faf7c781 req-bbe046d5-2d6b-4fe1-a5cd-e807dc36ddff tempest-ServerActionsTestOtherA-1035839598 None] attachment_update completed successfully. Jul 11 04:28:13 devstack sudo[92323]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-64cc4f40-17d5-442d-8ca2-a71e0f30b181 tempest-AttachVolumeTestJSON-642925562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fff40e2d-137a-4b57-8ebc-6aedaaa6af34" returned: 0 in 1.178s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-64cc4f40-17d5-442d-8ca2-a71e0f30b181 tempest-AttachVolumeTestJSON-642925562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fff40e2d-137a-4b57-8ebc-6aedaaa6af34 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:13 devstack sudo[92382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fff40e2d-137a-4b57-8ebc-6aedaaa6af34 Jul 11 04:28:13 devstack sudo[92382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:13 devstack sudo[92329]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e8520975-5159-4ebb-83d2-153f0bda8932 tempest-VolumesCloneTest-1315988380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-cadf6fee-3649-4781-8d61-c95f0b803008" returned: 0 in 0.990s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e8520975-5159-4ebb-83d2-153f0bda8932 tempest-VolumesCloneTest-1315988380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-cadf6fee-3649-4781-8d61-c95f0b803008 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:13 devstack sudo[92407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-cadf6fee-3649-4781-8d61-c95f0b803008 Jul 11 04:28:13 devstack sudo[92407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:14 devstack sudo[92382]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-64cc4f40-17d5-442d-8ca2-a71e0f30b181 tempest-AttachVolumeTestJSON-642925562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fff40e2d-137a-4b57-8ebc-6aedaaa6af34" returned: 0 in 0.734s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:14 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-64cc4f40-17d5-442d-8ca2-a71e0f30b181 tempest-AttachVolumeTestJSON-642925562 None] Lock "cinder-quobyte-fff40e2d-137a-4b57-8ebc-6aedaaa6af34" released by "delete_volume" :: held 1.967s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:28:14 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-64cc4f40-17d5-442d-8ca2-a71e0f30b181 tempest-AttachVolumeTestJSON-642925562 None] Created reservations ['3458caca-ea8b-44ff-b29a-c1b57648939c', 'c0601b86-69c5-4cc8-bbaa-2bd1fcdd4e1b', 'ad10181e-f07e-40b4-bdd4-04ed24bb20a9', '78d32fce-decd-4a23-b5db-9fe4b2cdfa88'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:28:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-64cc4f40-17d5-442d-8ca2-a71e0f30b181 tempest-AttachVolumeTestJSON-642925562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:28:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-64cc4f40-17d5-442d-8ca2-a71e0f30b181 tempest-AttachVolumeTestJSON-642925562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:28:14 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-64cc4f40-17d5-442d-8ca2-a71e0f30b181 tempest-AttachVolumeTestJSON-642925562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:28:14 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-64cc4f40-17d5-442d-8ca2-a71e0f30b181 tempest-AttachVolumeTestJSON-642925562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:28:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-64cc4f40-17d5-442d-8ca2-a71e0f30b181 tempest-AttachVolumeTestJSON-642925562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:28:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-64cc4f40-17d5-442d-8ca2-a71e0f30b181 tempest-AttachVolumeTestJSON-642925562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:14 devstack sudo[92726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:28:14 devstack sudo[92726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:14 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4a9f3fa2-becb-479f-b590-16dd8f094a8d tempest-AttachVolumeTestJSON-642925562 None] Acquiring lock "cinder-06344831-93ed-4bd3-b4ac-fc84ffd54667-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:28:14 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4a9f3fa2-becb-479f-b590-16dd8f094a8d tempest-AttachVolumeTestJSON-642925562 None] Lock "cinder-06344831-93ed-4bd3-b4ac-fc84ffd54667-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:28:14 devstack sudo[92407]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e8520975-5159-4ebb-83d2-153f0bda8932 tempest-VolumesCloneTest-1315988380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-cadf6fee-3649-4781-8d61-c95f0b803008" returned: 0 in 0.827s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:14 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e8520975-5159-4ebb-83d2-153f0bda8932 tempest-VolumesCloneTest-1315988380 None] Lock "cinder-quobyte-cadf6fee-3649-4781-8d61-c95f0b803008" released by "delete_volume" :: held 1.872s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:28:14 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4a9f3fa2-becb-479f-b590-16dd8f094a8d tempest-AttachVolumeTestJSON-642925562 None] Acquiring lock "cinder-quobyte-06344831-93ed-4bd3-b4ac-fc84ffd54667" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:28:14 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4a9f3fa2-becb-479f-b590-16dd8f094a8d tempest-AttachVolumeTestJSON-642925562 None] Lock "cinder-quobyte-06344831-93ed-4bd3-b4ac-fc84ffd54667" acquired by "delete_volume" :: waited 0.015s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:28:14 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1b6c0d-dc63-49c9-8e90-84f10c0cee18]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:28:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4a9f3fa2-becb-479f-b590-16dd8f094a8d tempest-AttachVolumeTestJSON-642925562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-06344831-93ed-4bd3-b4ac-fc84ffd54667 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:14 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-e8520975-5159-4ebb-83d2-153f0bda8932 tempest-VolumesCloneTest-1315988380 None] Created reservations ['fafee1a3-5b23-495c-829b-504e955d6f4e', 'a028611e-d306-4546-89f6-43c8bfeb3134', '8404eeee-98fc-4d44-b572-71f59238f233', 'ea2960ff-487c-4408-8376-3b3a08f68844'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:28:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e8520975-5159-4ebb-83d2-153f0bda8932 tempest-VolumesCloneTest-1315988380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:28:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e8520975-5159-4ebb-83d2-153f0bda8932 tempest-VolumesCloneTest-1315988380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:28:14 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e8520975-5159-4ebb-83d2-153f0bda8932 tempest-VolumesCloneTest-1315988380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:28:14 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e8520975-5159-4ebb-83d2-153f0bda8932 tempest-VolumesCloneTest-1315988380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:28:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e8520975-5159-4ebb-83d2-153f0bda8932 tempest-VolumesCloneTest-1315988380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:28:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e8520975-5159-4ebb-83d2-153f0bda8932 tempest-VolumesCloneTest-1315988380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:14 devstack sudo[92729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:28:14 devstack sudo[92729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:14 devstack sudo[92728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-06344831-93ed-4bd3-b4ac-fc84ffd54667 Jul 11 04:28:14 devstack sudo[92728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:15 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f045e2f3-036e-4644-b632-aa7706c36d43 tempest-VolumesCloneTest-1315988380 None] Acquiring lock "cinder-3df4a71e-421c-47fb-afb3-2ba8425fc7a3-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:28:15 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f045e2f3-036e-4644-b632-aa7706c36d43 tempest-VolumesCloneTest-1315988380 None] Lock "cinder-3df4a71e-421c-47fb-afb3-2ba8425fc7a3-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:28:15 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f045e2f3-036e-4644-b632-aa7706c36d43 tempest-VolumesCloneTest-1315988380 None] Acquiring lock "cinder-quobyte-3df4a71e-421c-47fb-afb3-2ba8425fc7a3" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:28:15 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f045e2f3-036e-4644-b632-aa7706c36d43 tempest-VolumesCloneTest-1315988380 None] Lock "cinder-quobyte-3df4a71e-421c-47fb-afb3-2ba8425fc7a3" acquired by "delete_volume" :: waited 0.020s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:28:15 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[958eea20-77b0-4b6a-a959-3b814c75779b]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:28:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f045e2f3-036e-4644-b632-aa7706c36d43 tempest-VolumesCloneTest-1315988380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:15 devstack sudo[92733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3 Jul 11 04:28:15 devstack sudo[92733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:15 devstack sudo[92726]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-64cc4f40-17d5-442d-8ca2-a71e0f30b181 tempest-AttachVolumeTestJSON-642925562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 1.142s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:15 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-64cc4f40-17d5-442d-8ca2-a71e0f30b181 tempest-AttachVolumeTestJSON-642925562 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:28:15 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-64cc4f40-17d5-442d-8ca2-a71e0f30b181 tempest-AttachVolumeTestJSON-642925562 None] Deleted volume successfully. Jul 11 04:28:15 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-64cc4f40-17d5-442d-8ca2-a71e0f30b181 tempest-AttachVolumeTestJSON-642925562 None] Lock "cinder-fff40e2d-137a-4b57-8ebc-6aedaaa6af34-delete_volume" released by "delete_volume" :: held 3.488s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:28:15 devstack sudo[92729]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e8520975-5159-4ebb-83d2-153f0bda8932 tempest-VolumesCloneTest-1315988380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.895s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:15 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-e8520975-5159-4ebb-83d2-153f0bda8932 tempest-VolumesCloneTest-1315988380 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:28:15 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-e8520975-5159-4ebb-83d2-153f0bda8932 tempest-VolumesCloneTest-1315988380 None] Deleted volume successfully. Jul 11 04:28:15 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e8520975-5159-4ebb-83d2-153f0bda8932 tempest-VolumesCloneTest-1315988380 None] Lock "cinder-cadf6fee-3649-4781-8d61-c95f0b803008-delete_volume" released by "delete_volume" :: held 3.088s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:28:15 devstack sudo[92728]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4a9f3fa2-becb-479f-b590-16dd8f094a8d tempest-AttachVolumeTestJSON-642925562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-06344831-93ed-4bd3-b4ac-fc84ffd54667" returned: 0 in 1.236s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4a9f3fa2-becb-479f-b590-16dd8f094a8d tempest-AttachVolumeTestJSON-642925562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-06344831-93ed-4bd3-b4ac-fc84ffd54667 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:15 devstack sudo[92740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-06344831-93ed-4bd3-b4ac-fc84ffd54667 Jul 11 04:28:15 devstack sudo[92740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:16 devstack sudo[92733]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f045e2f3-036e-4644-b632-aa7706c36d43 tempest-VolumesCloneTest-1315988380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3" returned: 0 in 0.950s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f045e2f3-036e-4644-b632-aa7706c36d43 tempest-VolumesCloneTest-1315988380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:16 devstack sudo[92745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3 Jul 11 04:28:16 devstack sudo[92745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:16 devstack sudo[92740]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4a9f3fa2-becb-479f-b590-16dd8f094a8d tempest-AttachVolumeTestJSON-642925562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-06344831-93ed-4bd3-b4ac-fc84ffd54667" returned: 0 in 0.891s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:16 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4a9f3fa2-becb-479f-b590-16dd8f094a8d tempest-AttachVolumeTestJSON-642925562 None] Lock "cinder-quobyte-06344831-93ed-4bd3-b4ac-fc84ffd54667" released by "delete_volume" :: held 2.193s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:28:16 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-4a9f3fa2-becb-479f-b590-16dd8f094a8d tempest-AttachVolumeTestJSON-642925562 None] Created reservations ['440e86e9-6e2d-4b24-b793-5a29920bce5e', '4ae8f3a0-b355-47f4-a10c-7e28d787bffe', 'caf849c6-0e33-4dee-bd0c-050f1d0268d3', '2563fb06-e3c0-41eb-8274-9c0629c68832'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:28:16 devstack sudo[92745]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f045e2f3-036e-4644-b632-aa7706c36d43 tempest-VolumesCloneTest-1315988380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3df4a71e-421c-47fb-afb3-2ba8425fc7a3" returned: 0 in 0.824s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:16 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f045e2f3-036e-4644-b632-aa7706c36d43 tempest-VolumesCloneTest-1315988380 None] Lock "cinder-quobyte-3df4a71e-421c-47fb-afb3-2ba8425fc7a3" released by "delete_volume" :: held 1.855s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:28:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4a9f3fa2-becb-479f-b590-16dd8f094a8d tempest-AttachVolumeTestJSON-642925562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:28:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4a9f3fa2-becb-479f-b590-16dd8f094a8d tempest-AttachVolumeTestJSON-642925562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:28:17 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4a9f3fa2-becb-479f-b590-16dd8f094a8d tempest-AttachVolumeTestJSON-642925562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:28:17 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4a9f3fa2-becb-479f-b590-16dd8f094a8d tempest-AttachVolumeTestJSON-642925562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:28:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4a9f3fa2-becb-479f-b590-16dd8f094a8d tempest-AttachVolumeTestJSON-642925562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:28:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4a9f3fa2-becb-479f-b590-16dd8f094a8d tempest-AttachVolumeTestJSON-642925562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:17 devstack sudo[92749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:28:17 devstack sudo[92749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:17 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-f045e2f3-036e-4644-b632-aa7706c36d43 tempest-VolumesCloneTest-1315988380 None] Created reservations ['8485d5dd-8430-4c42-9e98-d1518c63a7fa', 'fa141734-5481-4c0a-9137-ef14bc8a19c5', '02567b52-647e-4d29-86e9-2699865283de', '34d04dcf-de55-4bd8-96de-c4ec41b6bab2'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:28:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f045e2f3-036e-4644-b632-aa7706c36d43 tempest-VolumesCloneTest-1315988380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:28:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f045e2f3-036e-4644-b632-aa7706c36d43 tempest-VolumesCloneTest-1315988380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:28:17 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-f045e2f3-036e-4644-b632-aa7706c36d43 tempest-VolumesCloneTest-1315988380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:28:17 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-f045e2f3-036e-4644-b632-aa7706c36d43 tempest-VolumesCloneTest-1315988380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:28:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f045e2f3-036e-4644-b632-aa7706c36d43 tempest-VolumesCloneTest-1315988380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:28:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f045e2f3-036e-4644-b632-aa7706c36d43 tempest-VolumesCloneTest-1315988380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:17 devstack sudo[92751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:28:17 devstack sudo[92751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:17 devstack sudo[92749]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4a9f3fa2-becb-479f-b590-16dd8f094a8d tempest-AttachVolumeTestJSON-642925562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.787s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:17 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-4a9f3fa2-becb-479f-b590-16dd8f094a8d tempest-AttachVolumeTestJSON-642925562 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:28:17 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-4a9f3fa2-becb-479f-b590-16dd8f094a8d tempest-AttachVolumeTestJSON-642925562 None] Deleted volume successfully. Jul 11 04:28:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4a9f3fa2-becb-479f-b590-16dd8f094a8d tempest-AttachVolumeTestJSON-642925562 None] Lock "cinder-06344831-93ed-4bd3-b4ac-fc84ffd54667-delete_volume" released by "delete_volume" :: held 3.318s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:28:17 devstack sudo[92751]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f045e2f3-036e-4644-b632-aa7706c36d43 tempest-VolumesCloneTest-1315988380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.772s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:17 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-f045e2f3-036e-4644-b632-aa7706c36d43 tempest-VolumesCloneTest-1315988380 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:28:17 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-f045e2f3-036e-4644-b632-aa7706c36d43 tempest-VolumesCloneTest-1315988380 None] Deleted volume successfully. Jul 11 04:28:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f045e2f3-036e-4644-b632-aa7706c36d43 tempest-VolumesCloneTest-1315988380 None] Lock "cinder-3df4a71e-421c-47fb-afb3-2ba8425fc7a3-delete_volume" released by "delete_volume" :: held 2.904s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:28:22 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-b30414eb-a63c-4aaa-851e-cb16760be49a tempest-VolumesSnapshotListTestJSON-1360492201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:28:22 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b30414eb-a63c-4aaa-851e-cb16760be49a tempest-VolumesSnapshotListTestJSON-1360492201 None] Flow 'volume_create_manager' (45166e2e-2d6b-46d8-8a7a-3cdca73c7bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:28:22 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b30414eb-a63c-4aaa-851e-cb16760be49a tempest-VolumesSnapshotListTestJSON-1360492201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93844747-ad36-4796-818b-e5829cebc46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:28:22 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b30414eb-a63c-4aaa-851e-cb16760be49a tempest-VolumesSnapshotListTestJSON-1360492201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93844747-ad36-4796-818b-e5829cebc46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1933658819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcb6335b-f76c-436b-a09d-9aa66a87741d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee1256008de448d580aadd760d270e75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:28:22Z,use_quota=True,user_id='dc5eb671589948998b60341de3f4b76c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:28:22 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b30414eb-a63c-4aaa-851e-cb16760be49a tempest-VolumesSnapshotListTestJSON-1360492201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc105e1d-6bab-475f-8930-0f308e17eda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:28:22 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b30414eb-a63c-4aaa-851e-cb16760be49a tempest-VolumesSnapshotListTestJSON-1360492201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc105e1d-6bab-475f-8930-0f308e17eda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:28:22 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b30414eb-a63c-4aaa-851e-cb16760be49a tempest-VolumesSnapshotListTestJSON-1360492201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe5dd269-2d15-471d-9e90-7b5020534b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:28:22 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b30414eb-a63c-4aaa-851e-cb16760be49a tempest-VolumesSnapshotListTestJSON-1360492201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe5dd269-2d15-471d-9e90-7b5020534b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcb6335b-f76c-436b-a09d-9aa66a87741d', 'volume_name': 'volume-dcb6335b-f76c-436b-a09d-9aa66a87741d', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:28:22 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b30414eb-a63c-4aaa-851e-cb16760be49a tempest-VolumesSnapshotListTestJSON-1360492201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04035961-664e-4b8d-9210-48a0558bd888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:28:22 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b30414eb-a63c-4aaa-851e-cb16760be49a tempest-VolumesSnapshotListTestJSON-1360492201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04035961-664e-4b8d-9210-48a0558bd888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:28:22 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b30414eb-a63c-4aaa-851e-cb16760be49a tempest-VolumesSnapshotListTestJSON-1360492201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e19f749e-d684-48f5-83ac-09bc5a0a3db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:28:22 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-b30414eb-a63c-4aaa-851e-cb16760be49a tempest-VolumesSnapshotListTestJSON-1360492201 None] Volume dcb6335b-f76c-436b-a09d-9aa66a87741d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcb6335b-f76c-436b-a09d-9aa66a87741d', 'volume_size': 1} Jul 11 04:28:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b30414eb-a63c-4aaa-851e-cb16760be49a tempest-VolumesSnapshotListTestJSON-1360492201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:28:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b30414eb-a63c-4aaa-851e-cb16760be49a tempest-VolumesSnapshotListTestJSON-1360492201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:28:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b30414eb-a63c-4aaa-851e-cb16760be49a tempest-VolumesSnapshotListTestJSON-1360492201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1933658819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcb6335b-f76c-436b-a09d-9aa66a87741d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee1256008de448d580aadd760d270e75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:28:22Z,use_quota=True,user_id='dc5eb671589948998b60341de3f4b76c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:28:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-b30414eb-a63c-4aaa-851e-cb16760be49a tempest-VolumesSnapshotListTestJSON-1360492201 None] Creating volume dcb6335b-f76c-436b-a09d-9aa66a87741d {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:28:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b30414eb-a63c-4aaa-851e-cb16760be49a tempest-VolumesSnapshotListTestJSON-1360492201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:28:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b30414eb-a63c-4aaa-851e-cb16760be49a tempest-VolumesSnapshotListTestJSON-1360492201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:28:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b30414eb-a63c-4aaa-851e-cb16760be49a tempest-VolumesSnapshotListTestJSON-1360492201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:28:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b30414eb-a63c-4aaa-851e-cb16760be49a tempest-VolumesSnapshotListTestJSON-1360492201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:28:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b30414eb-a63c-4aaa-851e-cb16760be49a tempest-VolumesSnapshotListTestJSON-1360492201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:28:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b30414eb-a63c-4aaa-851e-cb16760be49a tempest-VolumesSnapshotListTestJSON-1360492201 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:28:22 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-b30414eb-a63c-4aaa-851e-cb16760be49a tempest-VolumesSnapshotListTestJSON-1360492201 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:28:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b30414eb-a63c-4aaa-851e-cb16760be49a tempest-VolumesSnapshotListTestJSON-1360492201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:22 devstack sudo[92763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d 1073741824 Jul 11 04:28:22 devstack sudo[92763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:23 devstack sudo[92763]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b30414eb-a63c-4aaa-851e-cb16760be49a tempest-VolumesSnapshotListTestJSON-1360492201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d 1073741824" returned: 0 in 1.264s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b30414eb-a63c-4aaa-851e-cb16760be49a tempest-VolumesSnapshotListTestJSON-1360492201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:23 devstack sudo[92773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d Jul 11 04:28:23 devstack sudo[92773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:24 devstack sudo[92773]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b30414eb-a63c-4aaa-851e-cb16760be49a tempest-VolumesSnapshotListTestJSON-1360492201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d" returned: 0 in 0.957s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:24 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b30414eb-a63c-4aaa-851e-cb16760be49a tempest-VolumesSnapshotListTestJSON-1360492201 None] <== create_volume: return (2293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:28:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b30414eb-a63c-4aaa-851e-cb16760be49a tempest-VolumesSnapshotListTestJSON-1360492201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.295s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:28:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b30414eb-a63c-4aaa-851e-cb16760be49a tempest-VolumesSnapshotListTestJSON-1360492201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e19f749e-d684-48f5-83ac-09bc5a0a3db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcb6335b-f76c-436b-a09d-9aa66a87741d', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:28:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b30414eb-a63c-4aaa-851e-cb16760be49a tempest-VolumesSnapshotListTestJSON-1360492201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd05948-0c95-4f0a-a65a-f4727d860a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:28:24 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-b30414eb-a63c-4aaa-851e-cb16760be49a tempest-VolumesSnapshotListTestJSON-1360492201 None] Volume volume-dcb6335b-f76c-436b-a09d-9aa66a87741d (dcb6335b-f76c-436b-a09d-9aa66a87741d): created successfully Jul 11 04:28:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b30414eb-a63c-4aaa-851e-cb16760be49a tempest-VolumesSnapshotListTestJSON-1360492201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd05948-0c95-4f0a-a65a-f4727d860a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:28:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b30414eb-a63c-4aaa-851e-cb16760be49a tempest-VolumesSnapshotListTestJSON-1360492201 None] Flow 'volume_create_manager' (45166e2e-2d6b-46d8-8a7a-3cdca73c7bee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:28:24 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-b30414eb-a63c-4aaa-851e-cb16760be49a tempest-VolumesSnapshotListTestJSON-1360492201 None] Created volume successfully. Jul 11 04:28:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-dd47d2ed-04a6-424f-abc2-751d4b2dca0e tempest-VolumesSnapshotListTestJSON-1360492201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:28:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-dd47d2ed-04a6-424f-abc2-751d4b2dca0e tempest-VolumesSnapshotListTestJSON-1360492201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:28:25 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-dd47d2ed-04a6-424f-abc2-751d4b2dca0e tempest-VolumesSnapshotListTestJSON-1360492201 None] Creating offline snapshot 54387337-a494-4999-8d2a-57ce7cdd888f of volume dcb6335b-f76c-436b-a09d-9aa66a87741d {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:28:25 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdba9af-84de-4c7f-a79d-29c48bd1510d]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:28:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dd47d2ed-04a6-424f-abc2-751d4b2dca0e tempest-VolumesSnapshotListTestJSON-1360492201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:25 devstack sudo[92784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d Jul 11 04:28:25 devstack sudo[92784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:25 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-3701cbe2-56a2-470e-b756-82e6e69c9451 req-8f5529f2-43b9-4021-b35f-6343c9931ad5 tempest-ServerActionsTestOtherA-1035839598 None] Terminate volume connection completed successfully. Jul 11 04:28:25 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-3701cbe2-56a2-470e-b756-82e6e69c9451 req-8f5529f2-43b9-4021-b35f-6343c9931ad5 tempest-ServerActionsTestOtherA-1035839598 None] Deleting attachment a05ddc12-60dd-428e-b826-49970788d9c9. {{(pid=86964) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 04:28:26 devstack sudo[92784]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dd47d2ed-04a6-424f-abc2-751d4b2dca0e tempest-VolumesSnapshotListTestJSON-1360492201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d" returned: 0 in 1.018s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dd47d2ed-04a6-424f-abc2-751d4b2dca0e tempest-VolumesSnapshotListTestJSON-1360492201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.54387337-a494-4999-8d2a-57ce7cdd888f 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:26 devstack sudo[92815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.54387337-a494-4999-8d2a-57ce7cdd888f 1G Jul 11 04:28:26 devstack sudo[92815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:27 devstack sudo[92815]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dd47d2ed-04a6-424f-abc2-751d4b2dca0e tempest-VolumesSnapshotListTestJSON-1360492201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.54387337-a494-4999-8d2a-57ce7cdd888f 1G" returned: 0 in 1.102s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dd47d2ed-04a6-424f-abc2-751d4b2dca0e tempest-VolumesSnapshotListTestJSON-1360492201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcb6335b-f76c-436b-a09d-9aa66a87741d -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.54387337-a494-4999-8d2a-57ce7cdd888f {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:27 devstack sudo[92842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcb6335b-f76c-436b-a09d-9aa66a87741d -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.54387337-a494-4999-8d2a-57ce7cdd888f Jul 11 04:28:27 devstack sudo[92842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:27 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=82,cinder:UPDATE=110,cinder:DELETE=7,cinder:INSERT=28 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:28:27 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=91,cinder:UPDATE=98,cinder:INSERT=20,cinder:DELETE=9 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:28:27 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c6a9d3f-9872-496e-b69d-c71f1b979f21 tempest-VolumesTestJSON-857071933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:28:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9c6a9d3f-9872-496e-b69d-c71f1b979f21 tempest-VolumesTestJSON-857071933 None] Flow 'volume_create_manager' (722a2e18-ceb5-4de6-9a58-eaa814635e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:28:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9c6a9d3f-9872-496e-b69d-c71f1b979f21 tempest-VolumesTestJSON-857071933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf26b671-2aff-4469-9cc6-9e11fffe11b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:28:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9c6a9d3f-9872-496e-b69d-c71f1b979f21 tempest-VolumesTestJSON-857071933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf26b671-2aff-4469-9cc6-9e11fffe11b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1508028614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fec23e2-0069-46a1-9ae0-30f164f23b58,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd7efcc5ae4e4588913e1101290b5db6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:28:28Z,use_quota=True,user_id='88f8c37a56ac464db37e335d5507529e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:28:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9c6a9d3f-9872-496e-b69d-c71f1b979f21 tempest-VolumesTestJSON-857071933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50055931-72cd-4cd2-be34-660cb9b8bb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:28:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9c6a9d3f-9872-496e-b69d-c71f1b979f21 tempest-VolumesTestJSON-857071933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50055931-72cd-4cd2-be34-660cb9b8bb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:28:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9c6a9d3f-9872-496e-b69d-c71f1b979f21 tempest-VolumesTestJSON-857071933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3589fc7-9af2-4fe9-8297-76ecfa79de77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:28:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9c6a9d3f-9872-496e-b69d-c71f1b979f21 tempest-VolumesTestJSON-857071933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3589fc7-9af2-4fe9-8297-76ecfa79de77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fec23e2-0069-46a1-9ae0-30f164f23b58', 'volume_name': 'volume-6fec23e2-0069-46a1-9ae0-30f164f23b58', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:28:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9c6a9d3f-9872-496e-b69d-c71f1b979f21 tempest-VolumesTestJSON-857071933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae92d6f9-8d4c-4dd0-92ef-8585a7a4ab09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:28:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9c6a9d3f-9872-496e-b69d-c71f1b979f21 tempest-VolumesTestJSON-857071933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae92d6f9-8d4c-4dd0-92ef-8585a7a4ab09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:28:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9c6a9d3f-9872-496e-b69d-c71f1b979f21 tempest-VolumesTestJSON-857071933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd8b56a-6058-4d73-929e-518acce19ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:28:27 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-9c6a9d3f-9872-496e-b69d-c71f1b979f21 tempest-VolumesTestJSON-857071933 None] Volume 6fec23e2-0069-46a1-9ae0-30f164f23b58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fec23e2-0069-46a1-9ae0-30f164f23b58', 'volume_size': 1} Jul 11 04:28:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9c6a9d3f-9872-496e-b69d-c71f1b979f21 tempest-VolumesTestJSON-857071933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:28:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-3701cbe2-56a2-470e-b756-82e6e69c9451 req-6237ab0c-9bbb-4f72-994c-c7c9984f8c36 tempest-ServerActionsTestOtherA-1035839598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:28:28 devstack sudo[92842]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dd47d2ed-04a6-424f-abc2-751d4b2dca0e tempest-VolumesSnapshotListTestJSON-1360492201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcb6335b-f76c-436b-a09d-9aa66a87741d -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.54387337-a494-4999-8d2a-57ce7cdd888f" returned: 0 in 0.809s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:28 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-dd47d2ed-04a6-424f-abc2-751d4b2dca0e tempest-VolumesSnapshotListTestJSON-1360492201 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.54387337-a494-4999-8d2a-57ce7cdd888f is being set with open permissions: ugo+rw Jul 11 04:28:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dd47d2ed-04a6-424f-abc2-751d4b2dca0e tempest-VolumesSnapshotListTestJSON-1360492201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.54387337-a494-4999-8d2a-57ce7cdd888f {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:28 devstack sudo[92855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.54387337-a494-4999-8d2a-57ce7cdd888f Jul 11 04:28:28 devstack sudo[92855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:29 devstack sudo[92855]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dd47d2ed-04a6-424f-abc2-751d4b2dca0e tempest-VolumesSnapshotListTestJSON-1360492201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.54387337-a494-4999-8d2a-57ce7cdd888f" returned: 0 in 0.687s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dd47d2ed-04a6-424f-abc2-751d4b2dca0e tempest-VolumesSnapshotListTestJSON-1360492201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:29 devstack sudo[92862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.info Jul 11 04:28:29 devstack sudo[92862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:29 devstack sudo[92862]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dd47d2ed-04a6-424f-abc2-751d4b2dca0e tempest-VolumesSnapshotListTestJSON-1360492201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.info" returned: 0 in 0.639s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:29 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-dd47d2ed-04a6-424f-abc2-751d4b2dca0e tempest-VolumesSnapshotListTestJSON-1360492201 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.info is being set with open permissions: ugo+rw Jul 11 04:28:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dd47d2ed-04a6-424f-abc2-751d4b2dca0e tempest-VolumesSnapshotListTestJSON-1360492201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:29 devstack sudo[92868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.info Jul 11 04:28:29 devstack sudo[92868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:30 devstack sudo[92868]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dd47d2ed-04a6-424f-abc2-751d4b2dca0e tempest-VolumesSnapshotListTestJSON-1360492201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.info" returned: 0 in 0.642s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-dd47d2ed-04a6-424f-abc2-751d4b2dca0e tempest-VolumesSnapshotListTestJSON-1360492201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.985s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:28:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9c6a9d3f-9872-496e-b69d-c71f1b979f21 tempest-VolumesTestJSON-857071933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.486s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:28:30 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-9c6a9d3f-9872-496e-b69d-c71f1b979f21 tempest-VolumesTestJSON-857071933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1508028614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fec23e2-0069-46a1-9ae0-30f164f23b58,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd7efcc5ae4e4588913e1101290b5db6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:28:28Z,use_quota=True,user_id='88f8c37a56ac464db37e335d5507529e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:28:30 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-9c6a9d3f-9872-496e-b69d-c71f1b979f21 tempest-VolumesTestJSON-857071933 None] Creating volume 6fec23e2-0069-46a1-9ae0-30f164f23b58 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:28:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9c6a9d3f-9872-496e-b69d-c71f1b979f21 tempest-VolumesTestJSON-857071933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:28:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9c6a9d3f-9872-496e-b69d-c71f1b979f21 tempest-VolumesTestJSON-857071933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:28:30 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-9c6a9d3f-9872-496e-b69d-c71f1b979f21 tempest-VolumesTestJSON-857071933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:28:30 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-9c6a9d3f-9872-496e-b69d-c71f1b979f21 tempest-VolumesTestJSON-857071933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:28:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9c6a9d3f-9872-496e-b69d-c71f1b979f21 tempest-VolumesTestJSON-857071933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:28:30 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-9c6a9d3f-9872-496e-b69d-c71f1b979f21 tempest-VolumesTestJSON-857071933 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:28:30 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-9c6a9d3f-9872-496e-b69d-c71f1b979f21 tempest-VolumesTestJSON-857071933 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:28:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9c6a9d3f-9872-496e-b69d-c71f1b979f21 tempest-VolumesTestJSON-857071933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6fec23e2-0069-46a1-9ae0-30f164f23b58 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:30 devstack sudo[92871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6fec23e2-0069-46a1-9ae0-30f164f23b58 1073741824 Jul 11 04:28:30 devstack sudo[92871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:30 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-dd47d2ed-04a6-424f-abc2-751d4b2dca0e tempest-VolumesSnapshotListTestJSON-1360492201 None] Create snapshot completed successfully Jul 11 04:28:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-dd428c83-9fb1-4f58-aa2c-a6d4c97f6390 tempest-VolumesSnapshotListTestJSON-1360492201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:28:31 devstack sudo[92871]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9c6a9d3f-9872-496e-b69d-c71f1b979f21 tempest-VolumesTestJSON-857071933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6fec23e2-0069-46a1-9ae0-30f164f23b58 1073741824" returned: 0 in 0.829s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9c6a9d3f-9872-496e-b69d-c71f1b979f21 tempest-VolumesTestJSON-857071933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6fec23e2-0069-46a1-9ae0-30f164f23b58 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:31 devstack sudo[92876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6fec23e2-0069-46a1-9ae0-30f164f23b58 Jul 11 04:28:31 devstack sudo[92876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:31 devstack sudo[92876]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9c6a9d3f-9872-496e-b69d-c71f1b979f21 tempest-VolumesTestJSON-857071933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6fec23e2-0069-46a1-9ae0-30f164f23b58" returned: 0 in 0.644s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:31 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-9c6a9d3f-9872-496e-b69d-c71f1b979f21 tempest-VolumesTestJSON-857071933 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:28:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9c6a9d3f-9872-496e-b69d-c71f1b979f21 tempest-VolumesTestJSON-857071933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:28:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-3701cbe2-56a2-470e-b756-82e6e69c9451 req-6237ab0c-9bbb-4f72-994c-c7c9984f8c36 tempest-ServerActionsTestOtherA-1035839598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.667s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:28:31 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9c6a9d3f-9872-496e-b69d-c71f1b979f21 tempest-VolumesTestJSON-857071933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd8b56a-6058-4d73-929e-518acce19ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fec23e2-0069-46a1-9ae0-30f164f23b58', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:28:32 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9c6a9d3f-9872-496e-b69d-c71f1b979f21 tempest-VolumesTestJSON-857071933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38945057-594a-4009-8805-6a23a1d59ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:28:32 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6cc983-3d3a-4d51-a546-214117e1e751]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:28:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-3701cbe2-56a2-470e-b756-82e6e69c9451 req-6237ab0c-9bbb-4f72-994c-c7c9984f8c36 tempest-ServerActionsTestOtherA-1035839598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0db52474-5f6d-4c6d-93be-ef4e54a2a54b {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:32 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-9c6a9d3f-9872-496e-b69d-c71f1b979f21 tempest-VolumesTestJSON-857071933 None] Volume volume-6fec23e2-0069-46a1-9ae0-30f164f23b58 (6fec23e2-0069-46a1-9ae0-30f164f23b58): created successfully Jul 11 04:28:32 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9c6a9d3f-9872-496e-b69d-c71f1b979f21 tempest-VolumesTestJSON-857071933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38945057-594a-4009-8805-6a23a1d59ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:28:32 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9c6a9d3f-9872-496e-b69d-c71f1b979f21 tempest-VolumesTestJSON-857071933 None] Flow 'volume_create_manager' (722a2e18-ceb5-4de6-9a58-eaa814635e00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:28:32 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-9c6a9d3f-9872-496e-b69d-c71f1b979f21 tempest-VolumesTestJSON-857071933 None] Created volume successfully. Jul 11 04:28:32 devstack sudo[92879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0db52474-5f6d-4c6d-93be-ef4e54a2a54b Jul 11 04:28:32 devstack sudo[92879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:32 devstack sudo[92879]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-3701cbe2-56a2-470e-b756-82e6e69c9451 req-6237ab0c-9bbb-4f72-994c-c7c9984f8c36 tempest-ServerActionsTestOtherA-1035839598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0db52474-5f6d-4c6d-93be-ef4e54a2a54b" returned: 0 in 0.775s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-3701cbe2-56a2-470e-b756-82e6e69c9451 req-6237ab0c-9bbb-4f72-994c-c7c9984f8c36 tempest-ServerActionsTestOtherA-1035839598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.809s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:28:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-dd428c83-9fb1-4f58-aa2c-a6d4c97f6390 tempest-VolumesSnapshotListTestJSON-1360492201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.848s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:28:32 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-dd428c83-9fb1-4f58-aa2c-a6d4c97f6390 tempest-VolumesSnapshotListTestJSON-1360492201 None] Creating offline snapshot 5554fa55-f5e2-487b-9e99-ce0a5d2ff63e of volume dcb6335b-f76c-436b-a09d-9aa66a87741d {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:28:32 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-3701cbe2-56a2-470e-b756-82e6e69c9451 req-6237ab0c-9bbb-4f72-994c-c7c9984f8c36 tempest-ServerActionsTestOtherA-1035839598 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95', 'name': 'volume-0db52474-5f6d-4c6d-93be-ef4e54a2a54b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e5870136-80ce-410b-bc85-c8ae85326cf5', 'enforce_multipath': True} {{(pid=86964) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 04:28:32 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[116e518e-f278-4140-a5df-8b17d63ff1ba]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:28:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dd428c83-9fb1-4f58-aa2c-a6d4c97f6390 tempest-VolumesSnapshotListTestJSON-1360492201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.54387337-a494-4999-8d2a-57ce7cdd888f {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:32 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-3701cbe2-56a2-470e-b756-82e6e69c9451 req-6237ab0c-9bbb-4f72-994c-c7c9984f8c36 tempest-ServerActionsTestOtherA-1035839598 None] attachment_update completed successfully. Jul 11 04:28:32 devstack sudo[92884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.54387337-a494-4999-8d2a-57ce7cdd888f Jul 11 04:28:32 devstack sudo[92884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:33 devstack sudo[92884]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dd428c83-9fb1-4f58-aa2c-a6d4c97f6390 tempest-VolumesSnapshotListTestJSON-1360492201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.54387337-a494-4999-8d2a-57ce7cdd888f" returned: 0 in 0.878s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:33 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-dd428c83-9fb1-4f58-aa2c-a6d4c97f6390 tempest-VolumesSnapshotListTestJSON-1360492201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcb6335b-f76c-436b-a09d-9aa66a87741d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:28:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dd428c83-9fb1-4f58-aa2c-a6d4c97f6390 tempest-VolumesSnapshotListTestJSON-1360492201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.54387337-a494-4999-8d2a-57ce7cdd888f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.5554fa55-f5e2-487b-9e99-ce0a5d2ff63e 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:33 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c128404-a226-4f1e-a4dd-8c60f2a1fe46 tempest-VolumesTestJSON-857071933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:28:33 devstack sudo[92894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.54387337-a494-4999-8d2a-57ce7cdd888f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.5554fa55-f5e2-487b-9e99-ce0a5d2ff63e 1G Jul 11 04:28:33 devstack sudo[92894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9c128404-a226-4f1e-a4dd-8c60f2a1fe46 tempest-VolumesTestJSON-857071933 None] Flow 'volume_create_manager' (88a156de-9f97-42d6-b2d7-bbc275549edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:28:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9c128404-a226-4f1e-a4dd-8c60f2a1fe46 tempest-VolumesTestJSON-857071933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ddbd0c9-eac2-40f0-b7e1-ca2937baf2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:28:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9c128404-a226-4f1e-a4dd-8c60f2a1fe46 tempest-VolumesTestJSON-857071933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ddbd0c9-eac2-40f0-b7e1-ca2937baf2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1707434928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e16e06f6-2a6b-4cc8-80d3-0879012189d1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd7efcc5ae4e4588913e1101290b5db6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:28:34Z,use_quota=True,user_id='88f8c37a56ac464db37e335d5507529e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:28:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9c128404-a226-4f1e-a4dd-8c60f2a1fe46 tempest-VolumesTestJSON-857071933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a34980ea-01fd-4dae-987b-6a0fb237c00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:28:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9c128404-a226-4f1e-a4dd-8c60f2a1fe46 tempest-VolumesTestJSON-857071933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a34980ea-01fd-4dae-987b-6a0fb237c00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:28:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9c128404-a226-4f1e-a4dd-8c60f2a1fe46 tempest-VolumesTestJSON-857071933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a22b163f-6512-4e13-b498-ee5a63cccdb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:28:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9c128404-a226-4f1e-a4dd-8c60f2a1fe46 tempest-VolumesTestJSON-857071933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a22b163f-6512-4e13-b498-ee5a63cccdb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e16e06f6-2a6b-4cc8-80d3-0879012189d1', 'volume_name': 'volume-e16e06f6-2a6b-4cc8-80d3-0879012189d1', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:28:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9c128404-a226-4f1e-a4dd-8c60f2a1fe46 tempest-VolumesTestJSON-857071933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50fb75c0-080b-4a0a-a0e0-15a40890d25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:28:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9c128404-a226-4f1e-a4dd-8c60f2a1fe46 tempest-VolumesTestJSON-857071933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50fb75c0-080b-4a0a-a0e0-15a40890d25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:28:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9c128404-a226-4f1e-a4dd-8c60f2a1fe46 tempest-VolumesTestJSON-857071933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0e422f5-72ec-46bc-aa8d-61ca6ea9b6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:28:33 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-9c128404-a226-4f1e-a4dd-8c60f2a1fe46 tempest-VolumesTestJSON-857071933 None] Volume e16e06f6-2a6b-4cc8-80d3-0879012189d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e16e06f6-2a6b-4cc8-80d3-0879012189d1', 'volume_size': 1} Jul 11 04:28:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9c128404-a226-4f1e-a4dd-8c60f2a1fe46 tempest-VolumesTestJSON-857071933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:28:34 devstack sudo[92894]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dd428c83-9fb1-4f58-aa2c-a6d4c97f6390 tempest-VolumesSnapshotListTestJSON-1360492201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.54387337-a494-4999-8d2a-57ce7cdd888f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.5554fa55-f5e2-487b-9e99-ce0a5d2ff63e 1G" returned: 0 in 1.087s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dd428c83-9fb1-4f58-aa2c-a6d4c97f6390 tempest-VolumesSnapshotListTestJSON-1360492201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.54387337-a494-4999-8d2a-57ce7cdd888f -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.5554fa55-f5e2-487b-9e99-ce0a5d2ff63e {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:34 devstack sudo[92900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.54387337-a494-4999-8d2a-57ce7cdd888f -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.5554fa55-f5e2-487b-9e99-ce0a5d2ff63e Jul 11 04:28:34 devstack sudo[92900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:35 devstack sudo[92900]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dd428c83-9fb1-4f58-aa2c-a6d4c97f6390 tempest-VolumesSnapshotListTestJSON-1360492201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.54387337-a494-4999-8d2a-57ce7cdd888f -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.5554fa55-f5e2-487b-9e99-ce0a5d2ff63e" returned: 0 in 0.909s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:35 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-dd428c83-9fb1-4f58-aa2c-a6d4c97f6390 tempest-VolumesSnapshotListTestJSON-1360492201 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.5554fa55-f5e2-487b-9e99-ce0a5d2ff63e is being set with open permissions: ugo+rw Jul 11 04:28:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dd428c83-9fb1-4f58-aa2c-a6d4c97f6390 tempest-VolumesSnapshotListTestJSON-1360492201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.5554fa55-f5e2-487b-9e99-ce0a5d2ff63e {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:35 devstack sudo[92935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.5554fa55-f5e2-487b-9e99-ce0a5d2ff63e Jul 11 04:28:35 devstack sudo[92935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:36 devstack sudo[92935]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dd428c83-9fb1-4f58-aa2c-a6d4c97f6390 tempest-VolumesSnapshotListTestJSON-1360492201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.5554fa55-f5e2-487b-9e99-ce0a5d2ff63e" returned: 0 in 0.751s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-dd428c83-9fb1-4f58-aa2c-a6d4c97f6390 tempest-VolumesSnapshotListTestJSON-1360492201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.767s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:28:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9c128404-a226-4f1e-a4dd-8c60f2a1fe46 tempest-VolumesTestJSON-857071933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.702s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:28:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-9c128404-a226-4f1e-a4dd-8c60f2a1fe46 tempest-VolumesTestJSON-857071933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1707434928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e16e06f6-2a6b-4cc8-80d3-0879012189d1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd7efcc5ae4e4588913e1101290b5db6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:28:34Z,use_quota=True,user_id='88f8c37a56ac464db37e335d5507529e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:28:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-9c128404-a226-4f1e-a4dd-8c60f2a1fe46 tempest-VolumesTestJSON-857071933 None] Creating volume e16e06f6-2a6b-4cc8-80d3-0879012189d1 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:28:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9c128404-a226-4f1e-a4dd-8c60f2a1fe46 tempest-VolumesTestJSON-857071933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:28:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9c128404-a226-4f1e-a4dd-8c60f2a1fe46 tempest-VolumesTestJSON-857071933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:28:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-9c128404-a226-4f1e-a4dd-8c60f2a1fe46 tempest-VolumesTestJSON-857071933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:28:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-9c128404-a226-4f1e-a4dd-8c60f2a1fe46 tempest-VolumesTestJSON-857071933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:28:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9c128404-a226-4f1e-a4dd-8c60f2a1fe46 tempest-VolumesTestJSON-857071933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:28:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-9c128404-a226-4f1e-a4dd-8c60f2a1fe46 tempest-VolumesTestJSON-857071933 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:28:36 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-9c128404-a226-4f1e-a4dd-8c60f2a1fe46 tempest-VolumesTestJSON-857071933 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:28:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9c128404-a226-4f1e-a4dd-8c60f2a1fe46 tempest-VolumesTestJSON-857071933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e16e06f6-2a6b-4cc8-80d3-0879012189d1 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:36 devstack sudo[93012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e16e06f6-2a6b-4cc8-80d3-0879012189d1 1073741824 Jul 11 04:28:36 devstack sudo[93012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:36 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-dd428c83-9fb1-4f58-aa2c-a6d4c97f6390 tempest-VolumesSnapshotListTestJSON-1360492201 None] Create snapshot completed successfully Jul 11 04:28:37 devstack sudo[93012]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9c128404-a226-4f1e-a4dd-8c60f2a1fe46 tempest-VolumesTestJSON-857071933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e16e06f6-2a6b-4cc8-80d3-0879012189d1 1073741824" returned: 0 in 1.042s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9c128404-a226-4f1e-a4dd-8c60f2a1fe46 tempest-VolumesTestJSON-857071933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e16e06f6-2a6b-4cc8-80d3-0879012189d1 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:37 devstack sudo[93037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e16e06f6-2a6b-4cc8-80d3-0879012189d1 Jul 11 04:28:37 devstack sudo[93037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7fe0666d-97b3-4c3f-8247-ed553505c86d tempest-VolumesSnapshotListTestJSON-1360492201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:28:38 devstack sudo[93037]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9c128404-a226-4f1e-a4dd-8c60f2a1fe46 tempest-VolumesTestJSON-857071933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e16e06f6-2a6b-4cc8-80d3-0879012189d1" returned: 0 in 0.719s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:38 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-9c128404-a226-4f1e-a4dd-8c60f2a1fe46 tempest-VolumesTestJSON-857071933 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:28:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9c128404-a226-4f1e-a4dd-8c60f2a1fe46 tempest-VolumesTestJSON-857071933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.814s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:28:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7fe0666d-97b3-4c3f-8247-ed553505c86d tempest-VolumesSnapshotListTestJSON-1360492201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.656s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:28:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9c128404-a226-4f1e-a4dd-8c60f2a1fe46 tempest-VolumesTestJSON-857071933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0e422f5-72ec-46bc-aa8d-61ca6ea9b6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e16e06f6-2a6b-4cc8-80d3-0879012189d1', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:28:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9c128404-a226-4f1e-a4dd-8c60f2a1fe46 tempest-VolumesTestJSON-857071933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87cebc5b-676e-4b64-a7db-f97323c06dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:28:38 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-7fe0666d-97b3-4c3f-8247-ed553505c86d tempest-VolumesSnapshotListTestJSON-1360492201 None] Creating offline snapshot 1f46e7f4-5c39-4650-be86-41a6ab10bf5a of volume dcb6335b-f76c-436b-a09d-9aa66a87741d {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:28:38 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-9c128404-a226-4f1e-a4dd-8c60f2a1fe46 tempest-VolumesTestJSON-857071933 None] Volume volume-e16e06f6-2a6b-4cc8-80d3-0879012189d1 (e16e06f6-2a6b-4cc8-80d3-0879012189d1): created successfully Jul 11 04:28:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9c128404-a226-4f1e-a4dd-8c60f2a1fe46 tempest-VolumesTestJSON-857071933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87cebc5b-676e-4b64-a7db-f97323c06dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:28:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9c128404-a226-4f1e-a4dd-8c60f2a1fe46 tempest-VolumesTestJSON-857071933 None] Flow 'volume_create_manager' (88a156de-9f97-42d6-b2d7-bbc275549edc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:28:38 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc68195-f01a-4d11-a492-affd87da9498]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:28:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7fe0666d-97b3-4c3f-8247-ed553505c86d tempest-VolumesSnapshotListTestJSON-1360492201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.5554fa55-f5e2-487b-9e99-ce0a5d2ff63e {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:38 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-9c128404-a226-4f1e-a4dd-8c60f2a1fe46 tempest-VolumesTestJSON-857071933 None] Created volume successfully. Jul 11 04:28:38 devstack sudo[93041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.5554fa55-f5e2-487b-9e99-ce0a5d2ff63e Jul 11 04:28:38 devstack sudo[93041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:39 devstack sudo[93041]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7fe0666d-97b3-4c3f-8247-ed553505c86d tempest-VolumesSnapshotListTestJSON-1360492201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.5554fa55-f5e2-487b-9e99-ce0a5d2ff63e" returned: 0 in 1.130s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:39 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-7fe0666d-97b3-4c3f-8247-ed553505c86d tempest-VolumesSnapshotListTestJSON-1360492201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcb6335b-f76c-436b-a09d-9aa66a87741d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:28:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7fe0666d-97b3-4c3f-8247-ed553505c86d tempest-VolumesSnapshotListTestJSON-1360492201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.5554fa55-f5e2-487b-9e99-ce0a5d2ff63e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.1f46e7f4-5c39-4650-be86-41a6ab10bf5a 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:39 devstack sudo[93408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.5554fa55-f5e2-487b-9e99-ce0a5d2ff63e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.1f46e7f4-5c39-4650-be86-41a6ab10bf5a 1G Jul 11 04:28:39 devstack sudo[93408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:40 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d148cab-a01a-4fb6-b3a3-beab422bf90c tempest-VolumesTestJSON-857071933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:28:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5d148cab-a01a-4fb6-b3a3-beab422bf90c tempest-VolumesTestJSON-857071933 None] Flow 'volume_create_manager' (c2efab7b-d05b-4e68-9704-44efaf528dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:28:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5d148cab-a01a-4fb6-b3a3-beab422bf90c tempest-VolumesTestJSON-857071933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25c5626e-2d3c-40e8-8bcc-dc0ff5c97597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:28:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5d148cab-a01a-4fb6-b3a3-beab422bf90c tempest-VolumesTestJSON-857071933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25c5626e-2d3c-40e8-8bcc-dc0ff5c97597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1605274656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e67d3c54-c89c-492a-b3d5-b55220c7c880,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd7efcc5ae4e4588913e1101290b5db6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:28:40Z,use_quota=True,user_id='88f8c37a56ac464db37e335d5507529e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:28:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5d148cab-a01a-4fb6-b3a3-beab422bf90c tempest-VolumesTestJSON-857071933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c30dff8-01f9-4494-a000-320df7dcce57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:28:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5d148cab-a01a-4fb6-b3a3-beab422bf90c tempest-VolumesTestJSON-857071933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c30dff8-01f9-4494-a000-320df7dcce57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:28:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5d148cab-a01a-4fb6-b3a3-beab422bf90c tempest-VolumesTestJSON-857071933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b9c2a32-a733-477e-a6f9-0461be4baca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:28:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5d148cab-a01a-4fb6-b3a3-beab422bf90c tempest-VolumesTestJSON-857071933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b9c2a32-a733-477e-a6f9-0461be4baca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e67d3c54-c89c-492a-b3d5-b55220c7c880', 'volume_name': 'volume-e67d3c54-c89c-492a-b3d5-b55220c7c880', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:28:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5d148cab-a01a-4fb6-b3a3-beab422bf90c tempest-VolumesTestJSON-857071933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7b2f70-9b33-4978-9f8b-d1d5dedaf534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:28:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5d148cab-a01a-4fb6-b3a3-beab422bf90c tempest-VolumesTestJSON-857071933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7b2f70-9b33-4978-9f8b-d1d5dedaf534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:28:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5d148cab-a01a-4fb6-b3a3-beab422bf90c tempest-VolumesTestJSON-857071933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c4027a8-35f0-4bfb-81aa-dd23970ac1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:28:40 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-5d148cab-a01a-4fb6-b3a3-beab422bf90c tempest-VolumesTestJSON-857071933 None] Volume e67d3c54-c89c-492a-b3d5-b55220c7c880: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e67d3c54-c89c-492a-b3d5-b55220c7c880', 'volume_size': 1} Jul 11 04:28:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5d148cab-a01a-4fb6-b3a3-beab422bf90c tempest-VolumesTestJSON-857071933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:28:41 devstack sudo[93408]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7fe0666d-97b3-4c3f-8247-ed553505c86d tempest-VolumesSnapshotListTestJSON-1360492201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.5554fa55-f5e2-487b-9e99-ce0a5d2ff63e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.1f46e7f4-5c39-4650-be86-41a6ab10bf5a 1G" returned: 0 in 1.428s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7fe0666d-97b3-4c3f-8247-ed553505c86d tempest-VolumesSnapshotListTestJSON-1360492201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.5554fa55-f5e2-487b-9e99-ce0a5d2ff63e -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.1f46e7f4-5c39-4650-be86-41a6ab10bf5a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:41 devstack sudo[93453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.5554fa55-f5e2-487b-9e99-ce0a5d2ff63e -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.1f46e7f4-5c39-4650-be86-41a6ab10bf5a Jul 11 04:28:41 devstack sudo[93453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:41 devstack sudo[93453]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7fe0666d-97b3-4c3f-8247-ed553505c86d tempest-VolumesSnapshotListTestJSON-1360492201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.5554fa55-f5e2-487b-9e99-ce0a5d2ff63e -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.1f46e7f4-5c39-4650-be86-41a6ab10bf5a" returned: 0 in 0.762s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:41 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-7fe0666d-97b3-4c3f-8247-ed553505c86d tempest-VolumesSnapshotListTestJSON-1360492201 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.1f46e7f4-5c39-4650-be86-41a6ab10bf5a is being set with open permissions: ugo+rw Jul 11 04:28:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7fe0666d-97b3-4c3f-8247-ed553505c86d tempest-VolumesSnapshotListTestJSON-1360492201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.1f46e7f4-5c39-4650-be86-41a6ab10bf5a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:41 devstack sudo[93458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.1f46e7f4-5c39-4650-be86-41a6ab10bf5a Jul 11 04:28:41 devstack sudo[93458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:42 devstack sudo[93458]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7fe0666d-97b3-4c3f-8247-ed553505c86d tempest-VolumesSnapshotListTestJSON-1360492201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.1f46e7f4-5c39-4650-be86-41a6ab10bf5a" returned: 0 in 1.049s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7fe0666d-97b3-4c3f-8247-ed553505c86d tempest-VolumesSnapshotListTestJSON-1360492201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.519s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:28:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5d148cab-a01a-4fb6-b3a3-beab422bf90c tempest-VolumesTestJSON-857071933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.231s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:28:42 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-5d148cab-a01a-4fb6-b3a3-beab422bf90c tempest-VolumesTestJSON-857071933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1605274656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e67d3c54-c89c-492a-b3d5-b55220c7c880,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd7efcc5ae4e4588913e1101290b5db6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:28:40Z,use_quota=True,user_id='88f8c37a56ac464db37e335d5507529e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:28:42 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-5d148cab-a01a-4fb6-b3a3-beab422bf90c tempest-VolumesTestJSON-857071933 None] Creating volume e67d3c54-c89c-492a-b3d5-b55220c7c880 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:28:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5d148cab-a01a-4fb6-b3a3-beab422bf90c tempest-VolumesTestJSON-857071933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:28:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5d148cab-a01a-4fb6-b3a3-beab422bf90c tempest-VolumesTestJSON-857071933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:28:42 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-5d148cab-a01a-4fb6-b3a3-beab422bf90c tempest-VolumesTestJSON-857071933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:28:42 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-5d148cab-a01a-4fb6-b3a3-beab422bf90c tempest-VolumesTestJSON-857071933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:28:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5d148cab-a01a-4fb6-b3a3-beab422bf90c tempest-VolumesTestJSON-857071933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:28:42 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-5d148cab-a01a-4fb6-b3a3-beab422bf90c tempest-VolumesTestJSON-857071933 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:28:42 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-5d148cab-a01a-4fb6-b3a3-beab422bf90c tempest-VolumesTestJSON-857071933 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:28:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5d148cab-a01a-4fb6-b3a3-beab422bf90c tempest-VolumesTestJSON-857071933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e67d3c54-c89c-492a-b3d5-b55220c7c880 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:42 devstack sudo[93463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e67d3c54-c89c-492a-b3d5-b55220c7c880 1073741824 Jul 11 04:28:42 devstack sudo[93463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:42 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-7fe0666d-97b3-4c3f-8247-ed553505c86d tempest-VolumesSnapshotListTestJSON-1360492201 None] Create snapshot completed successfully Jul 11 04:28:44 devstack sudo[93463]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5d148cab-a01a-4fb6-b3a3-beab422bf90c tempest-VolumesTestJSON-857071933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e67d3c54-c89c-492a-b3d5-b55220c7c880 1073741824" returned: 0 in 1.331s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5d148cab-a01a-4fb6-b3a3-beab422bf90c tempest-VolumesTestJSON-857071933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e67d3c54-c89c-492a-b3d5-b55220c7c880 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:44 devstack sudo[93469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e67d3c54-c89c-492a-b3d5-b55220c7c880 Jul 11 04:28:44 devstack sudo[93469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:45 devstack sudo[93469]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5d148cab-a01a-4fb6-b3a3-beab422bf90c tempest-VolumesTestJSON-857071933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e67d3c54-c89c-492a-b3d5-b55220c7c880" returned: 0 in 1.321s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-5d148cab-a01a-4fb6-b3a3-beab422bf90c tempest-VolumesTestJSON-857071933 None] <== create_volume: return (2713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:28:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5d148cab-a01a-4fb6-b3a3-beab422bf90c tempest-VolumesTestJSON-857071933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.716s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:28:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5d148cab-a01a-4fb6-b3a3-beab422bf90c tempest-VolumesTestJSON-857071933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c4027a8-35f0-4bfb-81aa-dd23970ac1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e67d3c54-c89c-492a-b3d5-b55220c7c880', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:28:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5d148cab-a01a-4fb6-b3a3-beab422bf90c tempest-VolumesTestJSON-857071933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (306a5d4c-db17-41e1-8dbb-bbb9bb0a15da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:28:45 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-5d148cab-a01a-4fb6-b3a3-beab422bf90c tempest-VolumesTestJSON-857071933 None] Volume volume-e67d3c54-c89c-492a-b3d5-b55220c7c880 (e67d3c54-c89c-492a-b3d5-b55220c7c880): created successfully Jul 11 04:28:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5d148cab-a01a-4fb6-b3a3-beab422bf90c tempest-VolumesTestJSON-857071933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (306a5d4c-db17-41e1-8dbb-bbb9bb0a15da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:28:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5d148cab-a01a-4fb6-b3a3-beab422bf90c tempest-VolumesTestJSON-857071933 None] Flow 'volume_create_manager' (c2efab7b-d05b-4e68-9704-44efaf528dde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:28:45 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-5d148cab-a01a-4fb6-b3a3-beab422bf90c tempest-VolumesTestJSON-857071933 None] Created volume successfully. Jul 11 04:28:45 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-46c4c1b4-96e8-40a5-93b8-60920537e343 tempest-VolumesSnapshotListTestJSON-1360492201 None] Acquiring lock "cinder-1f46e7f4-5c39-4650-be86-41a6ab10bf5a-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:28:45 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-46c4c1b4-96e8-40a5-93b8-60920537e343 tempest-VolumesSnapshotListTestJSON-1360492201 None] Lock "cinder-1f46e7f4-5c39-4650-be86-41a6ab10bf5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:28:45 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-46c4c1b4-96e8-40a5-93b8-60920537e343 tempest-VolumesSnapshotListTestJSON-1360492201 None] Acquiring lock "cinder-quobyte-dcb6335b-f76c-436b-a09d-9aa66a87741d" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:28:45 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-46c4c1b4-96e8-40a5-93b8-60920537e343 tempest-VolumesSnapshotListTestJSON-1360492201 None] Lock "cinder-quobyte-dcb6335b-f76c-436b-a09d-9aa66a87741d" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:28:45 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-46c4c1b4-96e8-40a5-93b8-60920537e343 tempest-VolumesSnapshotListTestJSON-1360492201 None] Acquiring lock "cinder-quobyte-1f46e7f4-5c39-4650-be86-41a6ab10bf5a" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:28:45 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-46c4c1b4-96e8-40a5-93b8-60920537e343 tempest-VolumesSnapshotListTestJSON-1360492201 None] Lock "cinder-quobyte-1f46e7f4-5c39-4650-be86-41a6ab10bf5a" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:28:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-46c4c1b4-96e8-40a5-93b8-60920537e343 tempest-VolumesSnapshotListTestJSON-1360492201 None] Deleting offline snapshot 1f46e7f4-5c39-4650-be86-41a6ab10bf5a of volume dcb6335b-f76c-436b-a09d-9aa66a87741d {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:28:46 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-46c4c1b4-96e8-40a5-93b8-60920537e343 tempest-VolumesSnapshotListTestJSON-1360492201 None] snapshot_file for this snap is: volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.1f46e7f4-5c39-4650-be86-41a6ab10bf5a {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:28:46 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cf0be5-ae48-4af6-8240-c74ffa1477cb]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:28:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-46c4c1b4-96e8-40a5-93b8-60920537e343 tempest-VolumesSnapshotListTestJSON-1360492201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.1f46e7f4-5c39-4650-be86-41a6ab10bf5a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:46 devstack sudo[93475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.1f46e7f4-5c39-4650-be86-41a6ab10bf5a Jul 11 04:28:46 devstack sudo[93475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:47 devstack sudo[93475]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-46c4c1b4-96e8-40a5-93b8-60920537e343 tempest-VolumesSnapshotListTestJSON-1360492201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.1f46e7f4-5c39-4650-be86-41a6ab10bf5a" returned: 0 in 1.177s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:47 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-46c4c1b4-96e8-40a5-93b8-60920537e343 tempest-VolumesSnapshotListTestJSON-1360492201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcb6335b-f76c-436b-a09d-9aa66a87741d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:28:47 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b98df8c3-97a8-4ed8-90bc-266a30cb6c13 tempest-VolumesTestJSON-857071933 None] Acquiring lock "cinder-e67d3c54-c89c-492a-b3d5-b55220c7c880-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:28:47 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48d32e6-b340-4126-938c-d3b023a0347b]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:28:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-46c4c1b4-96e8-40a5-93b8-60920537e343 tempest-VolumesSnapshotListTestJSON-1360492201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.5554fa55-f5e2-487b-9e99-ce0a5d2ff63e {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:47 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b98df8c3-97a8-4ed8-90bc-266a30cb6c13 tempest-VolumesTestJSON-857071933 None] Lock "cinder-e67d3c54-c89c-492a-b3d5-b55220c7c880-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:28:47 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b98df8c3-97a8-4ed8-90bc-266a30cb6c13 tempest-VolumesTestJSON-857071933 None] Acquiring lock "cinder-quobyte-e67d3c54-c89c-492a-b3d5-b55220c7c880" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:28:47 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b98df8c3-97a8-4ed8-90bc-266a30cb6c13 tempest-VolumesTestJSON-857071933 None] Lock "cinder-quobyte-e67d3c54-c89c-492a-b3d5-b55220c7c880" acquired by "delete_volume" :: waited 0.029s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:28:47 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce9650d-ca14-48b0-9b2d-6bb8b0796401]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:28:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b98df8c3-97a8-4ed8-90bc-266a30cb6c13 tempest-VolumesTestJSON-857071933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e67d3c54-c89c-492a-b3d5-b55220c7c880 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:47 devstack sudo[93480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.5554fa55-f5e2-487b-9e99-ce0a5d2ff63e Jul 11 04:28:47 devstack sudo[93480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:47 devstack sudo[93481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e67d3c54-c89c-492a-b3d5-b55220c7c880 Jul 11 04:28:47 devstack sudo[93481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:48 devstack sudo[93480]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-46c4c1b4-96e8-40a5-93b8-60920537e343 tempest-VolumesSnapshotListTestJSON-1360492201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.5554fa55-f5e2-487b-9e99-ce0a5d2ff63e" returned: 0 in 1.100s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:48 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-46c4c1b4-96e8-40a5-93b8-60920537e343 tempest-VolumesSnapshotListTestJSON-1360492201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcb6335b-f76c-436b-a09d-9aa66a87741d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:28:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-46c4c1b4-96e8-40a5-93b8-60920537e343 tempest-VolumesSnapshotListTestJSON-1360492201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.1f46e7f4-5c39-4650-be86-41a6ab10bf5a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:48 devstack sudo[93491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.1f46e7f4-5c39-4650-be86-41a6ab10bf5a Jul 11 04:28:48 devstack sudo[93491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:48 devstack sudo[93481]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b98df8c3-97a8-4ed8-90bc-266a30cb6c13 tempest-VolumesTestJSON-857071933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e67d3c54-c89c-492a-b3d5-b55220c7c880" returned: 0 in 1.071s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b98df8c3-97a8-4ed8-90bc-266a30cb6c13 tempest-VolumesTestJSON-857071933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e67d3c54-c89c-492a-b3d5-b55220c7c880 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:48 devstack sudo[93493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e67d3c54-c89c-492a-b3d5-b55220c7c880 Jul 11 04:28:48 devstack sudo[93493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:49 devstack sudo[93491]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-46c4c1b4-96e8-40a5-93b8-60920537e343 tempest-VolumesSnapshotListTestJSON-1360492201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.1f46e7f4-5c39-4650-be86-41a6ab10bf5a" returned: 0 in 1.110s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-46c4c1b4-96e8-40a5-93b8-60920537e343 tempest-VolumesSnapshotListTestJSON-1360492201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.1f46e7f4-5c39-4650-be86-41a6ab10bf5a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:49 devstack sudo[93499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.1f46e7f4-5c39-4650-be86-41a6ab10bf5a Jul 11 04:28:49 devstack sudo[93499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:49 devstack sudo[93493]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b98df8c3-97a8-4ed8-90bc-266a30cb6c13 tempest-VolumesTestJSON-857071933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e67d3c54-c89c-492a-b3d5-b55220c7c880" returned: 0 in 1.062s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:49 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b98df8c3-97a8-4ed8-90bc-266a30cb6c13 tempest-VolumesTestJSON-857071933 None] Lock "cinder-quobyte-e67d3c54-c89c-492a-b3d5-b55220c7c880" released by "delete_volume" :: held 2.213s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:28:49 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-b98df8c3-97a8-4ed8-90bc-266a30cb6c13 tempest-VolumesTestJSON-857071933 None] Created reservations ['a77357a0-abe9-40f0-a15a-0a3120095c13', '857bb4ec-5133-416f-b511-8470527f02b1', '94769f99-8dac-4f59-8f9e-c3203575418b', 'd408f5e3-1528-4093-b79c-ca812f3d5d5c'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:28:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b98df8c3-97a8-4ed8-90bc-266a30cb6c13 tempest-VolumesTestJSON-857071933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:28:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b98df8c3-97a8-4ed8-90bc-266a30cb6c13 tempest-VolumesTestJSON-857071933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:28:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b98df8c3-97a8-4ed8-90bc-266a30cb6c13 tempest-VolumesTestJSON-857071933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:28:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b98df8c3-97a8-4ed8-90bc-266a30cb6c13 tempest-VolumesTestJSON-857071933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:28:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b98df8c3-97a8-4ed8-90bc-266a30cb6c13 tempest-VolumesTestJSON-857071933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:28:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b98df8c3-97a8-4ed8-90bc-266a30cb6c13 tempest-VolumesTestJSON-857071933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:49 devstack sudo[93501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:28:49 devstack sudo[93501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-00cb33f2-2023-41c9-a50e-cdce7eae54d2 tempest-VolumesTestJSON-857071933 None] Acquiring lock "cinder-e16e06f6-2a6b-4cc8-80d3-0879012189d1-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:28:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-00cb33f2-2023-41c9-a50e-cdce7eae54d2 tempest-VolumesTestJSON-857071933 None] Lock "cinder-e16e06f6-2a6b-4cc8-80d3-0879012189d1-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:28:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-00cb33f2-2023-41c9-a50e-cdce7eae54d2 tempest-VolumesTestJSON-857071933 None] Acquiring lock "cinder-quobyte-e16e06f6-2a6b-4cc8-80d3-0879012189d1" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:28:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-00cb33f2-2023-41c9-a50e-cdce7eae54d2 tempest-VolumesTestJSON-857071933 None] Lock "cinder-quobyte-e16e06f6-2a6b-4cc8-80d3-0879012189d1" acquired by "delete_volume" :: waited 0.039s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:28:50 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f72211-50b7-4838-9fff-e43947625d21]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:28:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-00cb33f2-2023-41c9-a50e-cdce7eae54d2 tempest-VolumesTestJSON-857071933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e16e06f6-2a6b-4cc8-80d3-0879012189d1 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:50 devstack sudo[93499]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-46c4c1b4-96e8-40a5-93b8-60920537e343 tempest-VolumesSnapshotListTestJSON-1360492201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.1f46e7f4-5c39-4650-be86-41a6ab10bf5a" returned: 0 in 0.977s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:50 devstack sudo[93503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e16e06f6-2a6b-4cc8-80d3-0879012189d1 Jul 11 04:28:50 devstack sudo[93503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-46c4c1b4-96e8-40a5-93b8-60920537e343 tempest-VolumesSnapshotListTestJSON-1360492201 None] Lock "cinder-quobyte-1f46e7f4-5c39-4650-be86-41a6ab10bf5a" released by "_delete_snapshot" :: held 4.558s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:28:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-46c4c1b4-96e8-40a5-93b8-60920537e343 tempest-VolumesSnapshotListTestJSON-1360492201 None] Lock "cinder-quobyte-dcb6335b-f76c-436b-a09d-9aa66a87741d" released by "delete_snapshot" :: held 4.600s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:28:50 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-46c4c1b4-96e8-40a5-93b8-60920537e343 tempest-VolumesSnapshotListTestJSON-1360492201 None] Created reservations ['34cbcc98-643e-4932-a56b-cf6d4a4e707f', '5805e3ba-ba5c-46bf-9794-53fea1167a3a', '9145c4a2-f386-40f1-8baf-3dfc96098fc1', '90bc85ff-6946-4b9e-8211-591839732094'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:28:50 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-46c4c1b4-96e8-40a5-93b8-60920537e343 tempest-VolumesSnapshotListTestJSON-1360492201 None] Delete snapshot completed successfully. Jul 11 04:28:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-46c4c1b4-96e8-40a5-93b8-60920537e343 tempest-VolumesSnapshotListTestJSON-1360492201 None] Lock "cinder-1f46e7f4-5c39-4650-be86-41a6ab10bf5a-delete_snapshot" released by "delete_snapshot" :: held 4.841s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:28:50 devstack sudo[93501]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b98df8c3-97a8-4ed8-90bc-266a30cb6c13 tempest-VolumesTestJSON-857071933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 1.084s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:50 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-b98df8c3-97a8-4ed8-90bc-266a30cb6c13 tempest-VolumesTestJSON-857071933 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:28:50 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-b98df8c3-97a8-4ed8-90bc-266a30cb6c13 tempest-VolumesTestJSON-857071933 None] Deleted volume successfully. Jul 11 04:28:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b98df8c3-97a8-4ed8-90bc-266a30cb6c13 tempest-VolumesTestJSON-857071933 None] Lock "cinder-e67d3c54-c89c-492a-b3d5-b55220c7c880-delete_volume" released by "delete_volume" :: held 3.645s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:28:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e1d6f051-43bc-4cbe-b672-e76f5cbc422c tempest-VolumesSnapshotListTestJSON-1360492201 None] Acquiring lock "cinder-5554fa55-f5e2-487b-9e99-ce0a5d2ff63e-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:28:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e1d6f051-43bc-4cbe-b672-e76f5cbc422c tempest-VolumesSnapshotListTestJSON-1360492201 None] Lock "cinder-5554fa55-f5e2-487b-9e99-ce0a5d2ff63e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:28:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e1d6f051-43bc-4cbe-b672-e76f5cbc422c tempest-VolumesSnapshotListTestJSON-1360492201 None] Acquiring lock "cinder-quobyte-dcb6335b-f76c-436b-a09d-9aa66a87741d" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:28:51 devstack sudo[93503]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-00cb33f2-2023-41c9-a50e-cdce7eae54d2 tempest-VolumesTestJSON-857071933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e16e06f6-2a6b-4cc8-80d3-0879012189d1" returned: 0 in 1.183s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-00cb33f2-2023-41c9-a50e-cdce7eae54d2 tempest-VolumesTestJSON-857071933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e16e06f6-2a6b-4cc8-80d3-0879012189d1 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e1d6f051-43bc-4cbe-b672-e76f5cbc422c tempest-VolumesSnapshotListTestJSON-1360492201 None] Lock "cinder-quobyte-dcb6335b-f76c-436b-a09d-9aa66a87741d" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:28:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e1d6f051-43bc-4cbe-b672-e76f5cbc422c tempest-VolumesSnapshotListTestJSON-1360492201 None] Acquiring lock "cinder-quobyte-5554fa55-f5e2-487b-9e99-ce0a5d2ff63e" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:28:51 devstack sudo[93510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e16e06f6-2a6b-4cc8-80d3-0879012189d1 Jul 11 04:28:51 devstack sudo[93510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e1d6f051-43bc-4cbe-b672-e76f5cbc422c tempest-VolumesSnapshotListTestJSON-1360492201 None] Lock "cinder-quobyte-5554fa55-f5e2-487b-9e99-ce0a5d2ff63e" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:28:51 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-e1d6f051-43bc-4cbe-b672-e76f5cbc422c tempest-VolumesSnapshotListTestJSON-1360492201 None] Deleting offline snapshot 5554fa55-f5e2-487b-9e99-ce0a5d2ff63e of volume dcb6335b-f76c-436b-a09d-9aa66a87741d {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:28:51 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-e1d6f051-43bc-4cbe-b672-e76f5cbc422c tempest-VolumesSnapshotListTestJSON-1360492201 None] snapshot_file for this snap is: volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.5554fa55-f5e2-487b-9e99-ce0a5d2ff63e {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:28:51 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfb9ead-03b9-4a7e-bfda-b7ee9f5097e6]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:28:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e1d6f051-43bc-4cbe-b672-e76f5cbc422c tempest-VolumesSnapshotListTestJSON-1360492201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.5554fa55-f5e2-487b-9e99-ce0a5d2ff63e {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:51 devstack sudo[93512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.5554fa55-f5e2-487b-9e99-ce0a5d2ff63e Jul 11 04:28:51 devstack sudo[93512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:52 devstack sudo[93510]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-00cb33f2-2023-41c9-a50e-cdce7eae54d2 tempest-VolumesTestJSON-857071933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e16e06f6-2a6b-4cc8-80d3-0879012189d1" returned: 0 in 0.751s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:52 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-00cb33f2-2023-41c9-a50e-cdce7eae54d2 tempest-VolumesTestJSON-857071933 None] Lock "cinder-quobyte-e16e06f6-2a6b-4cc8-80d3-0879012189d1" released by "delete_volume" :: held 2.011s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:28:52 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-00cb33f2-2023-41c9-a50e-cdce7eae54d2 tempest-VolumesTestJSON-857071933 None] Created reservations ['5020b680-699e-4c18-943f-311706feaaea', 'fb09c83d-b027-4be5-94cf-2d41e971cd37', '09dc8f52-577b-41cf-b2ac-db363eacce5f', 'f38f65e8-1028-4c4b-bfac-9b7ae8093639'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:28:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-00cb33f2-2023-41c9-a50e-cdce7eae54d2 tempest-VolumesTestJSON-857071933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:28:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-00cb33f2-2023-41c9-a50e-cdce7eae54d2 tempest-VolumesTestJSON-857071933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:28:52 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-00cb33f2-2023-41c9-a50e-cdce7eae54d2 tempest-VolumesTestJSON-857071933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:28:52 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-00cb33f2-2023-41c9-a50e-cdce7eae54d2 tempest-VolumesTestJSON-857071933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:28:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-00cb33f2-2023-41c9-a50e-cdce7eae54d2 tempest-VolumesTestJSON-857071933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:28:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-00cb33f2-2023-41c9-a50e-cdce7eae54d2 tempest-VolumesTestJSON-857071933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:52 devstack sudo[93518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:28:52 devstack sudo[93518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:52 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-66ebdede-29e3-4db9-a97c-3318e2e64ced tempest-VolumesTestJSON-857071933 None] Acquiring lock "cinder-6fec23e2-0069-46a1-9ae0-30f164f23b58-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:28:52 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-66ebdede-29e3-4db9-a97c-3318e2e64ced tempest-VolumesTestJSON-857071933 None] Lock "cinder-6fec23e2-0069-46a1-9ae0-30f164f23b58-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:28:52 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-66ebdede-29e3-4db9-a97c-3318e2e64ced tempest-VolumesTestJSON-857071933 None] Acquiring lock "cinder-quobyte-6fec23e2-0069-46a1-9ae0-30f164f23b58" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:28:52 devstack sudo[93512]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e1d6f051-43bc-4cbe-b672-e76f5cbc422c tempest-VolumesSnapshotListTestJSON-1360492201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.5554fa55-f5e2-487b-9e99-ce0a5d2ff63e" returned: 0 in 1.188s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:52 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-e1d6f051-43bc-4cbe-b672-e76f5cbc422c tempest-VolumesSnapshotListTestJSON-1360492201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcb6335b-f76c-436b-a09d-9aa66a87741d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:28:52 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[992f4f56-b4f9-452f-a47e-5434f02d4f77]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:28:52 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-66ebdede-29e3-4db9-a97c-3318e2e64ced tempest-VolumesTestJSON-857071933 None] Lock "cinder-quobyte-6fec23e2-0069-46a1-9ae0-30f164f23b58" acquired by "delete_volume" :: waited 0.057s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:28:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e1d6f051-43bc-4cbe-b672-e76f5cbc422c tempest-VolumesSnapshotListTestJSON-1360492201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.54387337-a494-4999-8d2a-57ce7cdd888f {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:52 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f0be18-1c84-4d56-b43a-c8e998865f2e]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:28:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-66ebdede-29e3-4db9-a97c-3318e2e64ced tempest-VolumesTestJSON-857071933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6fec23e2-0069-46a1-9ae0-30f164f23b58 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:52 devstack sudo[93521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6fec23e2-0069-46a1-9ae0-30f164f23b58 Jul 11 04:28:52 devstack sudo[93521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:52 devstack sudo[93520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.54387337-a494-4999-8d2a-57ce7cdd888f Jul 11 04:28:52 devstack sudo[93520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:53 devstack sudo[93518]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-00cb33f2-2023-41c9-a50e-cdce7eae54d2 tempest-VolumesTestJSON-857071933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 1.268s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:53 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-00cb33f2-2023-41c9-a50e-cdce7eae54d2 tempest-VolumesTestJSON-857071933 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:28:53 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-00cb33f2-2023-41c9-a50e-cdce7eae54d2 tempest-VolumesTestJSON-857071933 None] Deleted volume successfully. Jul 11 04:28:53 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-00cb33f2-2023-41c9-a50e-cdce7eae54d2 tempest-VolumesTestJSON-857071933 None] Lock "cinder-e16e06f6-2a6b-4cc8-80d3-0879012189d1-delete_volume" released by "delete_volume" :: held 3.653s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:28:53 devstack sudo[93520]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e1d6f051-43bc-4cbe-b672-e76f5cbc422c tempest-VolumesSnapshotListTestJSON-1360492201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.54387337-a494-4999-8d2a-57ce7cdd888f" returned: 0 in 1.055s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:53 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-e1d6f051-43bc-4cbe-b672-e76f5cbc422c tempest-VolumesSnapshotListTestJSON-1360492201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcb6335b-f76c-436b-a09d-9aa66a87741d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:28:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e1d6f051-43bc-4cbe-b672-e76f5cbc422c tempest-VolumesSnapshotListTestJSON-1360492201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.5554fa55-f5e2-487b-9e99-ce0a5d2ff63e {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:53 devstack sudo[93528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.5554fa55-f5e2-487b-9e99-ce0a5d2ff63e Jul 11 04:28:53 devstack sudo[93528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:54 devstack sudo[93521]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-66ebdede-29e3-4db9-a97c-3318e2e64ced tempest-VolumesTestJSON-857071933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6fec23e2-0069-46a1-9ae0-30f164f23b58" returned: 0 in 1.293s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-66ebdede-29e3-4db9-a97c-3318e2e64ced tempest-VolumesTestJSON-857071933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6fec23e2-0069-46a1-9ae0-30f164f23b58 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:54 devstack sudo[93533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6fec23e2-0069-46a1-9ae0-30f164f23b58 Jul 11 04:28:54 devstack sudo[93533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:54 devstack sudo[93533]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-66ebdede-29e3-4db9-a97c-3318e2e64ced tempest-VolumesTestJSON-857071933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6fec23e2-0069-46a1-9ae0-30f164f23b58" returned: 0 in 0.723s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:54 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-66ebdede-29e3-4db9-a97c-3318e2e64ced tempest-VolumesTestJSON-857071933 None] Lock "cinder-quobyte-6fec23e2-0069-46a1-9ae0-30f164f23b58" released by "delete_volume" :: held 2.072s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:28:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e1d6f051-43bc-4cbe-b672-e76f5cbc422c tempest-VolumesSnapshotListTestJSON-1360492201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.5554fa55-f5e2-487b-9e99-ce0a5d2ff63e" returned: 0 in 1.002s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:54 devstack sudo[93528]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e1d6f051-43bc-4cbe-b672-e76f5cbc422c tempest-VolumesSnapshotListTestJSON-1360492201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.5554fa55-f5e2-487b-9e99-ce0a5d2ff63e {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:54 devstack sudo[93565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.5554fa55-f5e2-487b-9e99-ce0a5d2ff63e Jul 11 04:28:54 devstack sudo[93565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:54 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-66ebdede-29e3-4db9-a97c-3318e2e64ced tempest-VolumesTestJSON-857071933 None] Created reservations ['3645efa9-e57f-4ba7-8eca-374550cb9932', '73559c50-e38a-42e8-b00a-8be166eae847', '552578c9-9419-41a1-8dac-7e31e08252e2', '441d65bb-b2b6-4dc7-9511-59e2b432a3a9'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:28:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-66ebdede-29e3-4db9-a97c-3318e2e64ced tempest-VolumesTestJSON-857071933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:28:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-66ebdede-29e3-4db9-a97c-3318e2e64ced tempest-VolumesTestJSON-857071933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:28:55 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-66ebdede-29e3-4db9-a97c-3318e2e64ced tempest-VolumesTestJSON-857071933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:28:55 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-66ebdede-29e3-4db9-a97c-3318e2e64ced tempest-VolumesTestJSON-857071933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:28:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-66ebdede-29e3-4db9-a97c-3318e2e64ced tempest-VolumesTestJSON-857071933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:28:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-66ebdede-29e3-4db9-a97c-3318e2e64ced tempest-VolumesTestJSON-857071933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:55 devstack sudo[93568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:28:55 devstack sudo[93568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:55 devstack sudo[93565]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e1d6f051-43bc-4cbe-b672-e76f5cbc422c tempest-VolumesSnapshotListTestJSON-1360492201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.5554fa55-f5e2-487b-9e99-ce0a5d2ff63e" returned: 0 in 0.796s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:55 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e1d6f051-43bc-4cbe-b672-e76f5cbc422c tempest-VolumesSnapshotListTestJSON-1360492201 None] Lock "cinder-quobyte-5554fa55-f5e2-487b-9e99-ce0a5d2ff63e" released by "_delete_snapshot" :: held 4.198s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:28:55 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e1d6f051-43bc-4cbe-b672-e76f5cbc422c tempest-VolumesSnapshotListTestJSON-1360492201 None] Lock "cinder-quobyte-dcb6335b-f76c-436b-a09d-9aa66a87741d" released by "delete_snapshot" :: held 4.246s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:28:55 devstack sudo[93568]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-66ebdede-29e3-4db9-a97c-3318e2e64ced tempest-VolumesTestJSON-857071933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.702s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:55 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-66ebdede-29e3-4db9-a97c-3318e2e64ced tempest-VolumesTestJSON-857071933 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:28:55 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-66ebdede-29e3-4db9-a97c-3318e2e64ced tempest-VolumesTestJSON-857071933 None] Deleted volume successfully. Jul 11 04:28:55 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-e1d6f051-43bc-4cbe-b672-e76f5cbc422c tempest-VolumesSnapshotListTestJSON-1360492201 None] Created reservations ['b9c22a43-0c29-4264-89b1-22fa173fefff', '5f472497-209a-4d88-9e6d-e24defffd839', '3073e1d2-80c5-4cab-90a5-60b56491cba1', 'e10a5d5b-f551-45a8-ad26-91fa0003933c'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:28:55 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-66ebdede-29e3-4db9-a97c-3318e2e64ced tempest-VolumesTestJSON-857071933 None] Lock "cinder-6fec23e2-0069-46a1-9ae0-30f164f23b58-delete_volume" released by "delete_volume" :: held 3.212s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:28:55 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-e1d6f051-43bc-4cbe-b672-e76f5cbc422c tempest-VolumesSnapshotListTestJSON-1360492201 None] Delete snapshot completed successfully. Jul 11 04:28:55 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e1d6f051-43bc-4cbe-b672-e76f5cbc422c tempest-VolumesSnapshotListTestJSON-1360492201 None] Lock "cinder-5554fa55-f5e2-487b-9e99-ce0a5d2ff63e-delete_snapshot" released by "delete_snapshot" :: held 4.452s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:28:56 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4b7580d8-c3fa-4c0f-be3e-795dca86b1d9 tempest-VolumesSnapshotListTestJSON-1360492201 None] Acquiring lock "cinder-54387337-a494-4999-8d2a-57ce7cdd888f-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:28:56 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4b7580d8-c3fa-4c0f-be3e-795dca86b1d9 tempest-VolumesSnapshotListTestJSON-1360492201 None] Lock "cinder-54387337-a494-4999-8d2a-57ce7cdd888f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:28:56 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4b7580d8-c3fa-4c0f-be3e-795dca86b1d9 tempest-VolumesSnapshotListTestJSON-1360492201 None] Acquiring lock "cinder-quobyte-dcb6335b-f76c-436b-a09d-9aa66a87741d" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:28:56 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4b7580d8-c3fa-4c0f-be3e-795dca86b1d9 tempest-VolumesSnapshotListTestJSON-1360492201 None] Lock "cinder-quobyte-dcb6335b-f76c-436b-a09d-9aa66a87741d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:28:56 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4b7580d8-c3fa-4c0f-be3e-795dca86b1d9 tempest-VolumesSnapshotListTestJSON-1360492201 None] Acquiring lock "cinder-quobyte-54387337-a494-4999-8d2a-57ce7cdd888f" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:28:56 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4b7580d8-c3fa-4c0f-be3e-795dca86b1d9 tempest-VolumesSnapshotListTestJSON-1360492201 None] Lock "cinder-quobyte-54387337-a494-4999-8d2a-57ce7cdd888f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:28:56 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-4b7580d8-c3fa-4c0f-be3e-795dca86b1d9 tempest-VolumesSnapshotListTestJSON-1360492201 None] Deleting offline snapshot 54387337-a494-4999-8d2a-57ce7cdd888f of volume dcb6335b-f76c-436b-a09d-9aa66a87741d {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:28:56 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-4b7580d8-c3fa-4c0f-be3e-795dca86b1d9 tempest-VolumesSnapshotListTestJSON-1360492201 None] snapshot_file for this snap is: volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.54387337-a494-4999-8d2a-57ce7cdd888f {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:28:56 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[c871f3a2-b2a5-42fd-833c-8fa08849fcc3]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:28:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4b7580d8-c3fa-4c0f-be3e-795dca86b1d9 tempest-VolumesSnapshotListTestJSON-1360492201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.54387337-a494-4999-8d2a-57ce7cdd888f {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:57 devstack sudo[93621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.54387337-a494-4999-8d2a-57ce7cdd888f Jul 11 04:28:57 devstack sudo[93621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:57 devstack sudo[93621]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4b7580d8-c3fa-4c0f-be3e-795dca86b1d9 tempest-VolumesSnapshotListTestJSON-1360492201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.54387337-a494-4999-8d2a-57ce7cdd888f" returned: 0 in 0.793s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:57 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-4b7580d8-c3fa-4c0f-be3e-795dca86b1d9 tempest-VolumesSnapshotListTestJSON-1360492201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcb6335b-f76c-436b-a09d-9aa66a87741d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:28:57 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f1effa-a33c-4cc4-a384-256025fad091]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:28:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4b7580d8-c3fa-4c0f-be3e-795dca86b1d9 tempest-VolumesSnapshotListTestJSON-1360492201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:57 devstack sudo[93626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d Jul 11 04:28:57 devstack sudo[93626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:58 devstack sudo[93626]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4b7580d8-c3fa-4c0f-be3e-795dca86b1d9 tempest-VolumesSnapshotListTestJSON-1360492201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d" returned: 0 in 0.752s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4b7580d8-c3fa-4c0f-be3e-795dca86b1d9 tempest-VolumesSnapshotListTestJSON-1360492201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.54387337-a494-4999-8d2a-57ce7cdd888f {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:58 devstack sudo[93632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.54387337-a494-4999-8d2a-57ce7cdd888f Jul 11 04:28:58 devstack sudo[93632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:59 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:28:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:28:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:28:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:28:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:28:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:28:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:59 devstack sudo[93637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:28:59 devstack sudo[93637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:59 devstack sudo[93632]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4b7580d8-c3fa-4c0f-be3e-795dca86b1d9 tempest-VolumesSnapshotListTestJSON-1360492201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.54387337-a494-4999-8d2a-57ce7cdd888f" returned: 0 in 0.803s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4b7580d8-c3fa-4c0f-be3e-795dca86b1d9 tempest-VolumesSnapshotListTestJSON-1360492201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.54387337-a494-4999-8d2a-57ce7cdd888f {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:28:59 devstack sudo[93639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.54387337-a494-4999-8d2a-57ce7cdd888f Jul 11 04:28:59 devstack sudo[93639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:28:59 devstack sudo[93637]: pam_unix(sudo:session): session closed for user root Jul 11 04:28:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.740s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:28:59 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:28:59 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager._thread_info {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:28:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread count: 8 {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:28:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread info: [<_MainThread(MainThread, started 124675027595392)>, , , , , , , ] {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:29:00 devstack sudo[93639]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4b7580d8-c3fa-4c0f-be3e-795dca86b1d9 tempest-VolumesSnapshotListTestJSON-1360492201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d.54387337-a494-4999-8d2a-57ce7cdd888f" returned: 0 in 0.833s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:00 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4b7580d8-c3fa-4c0f-be3e-795dca86b1d9 tempest-VolumesSnapshotListTestJSON-1360492201 None] Lock "cinder-quobyte-54387337-a494-4999-8d2a-57ce7cdd888f" released by "_delete_snapshot" :: held 3.309s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:29:00 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4b7580d8-c3fa-4c0f-be3e-795dca86b1d9 tempest-VolumesSnapshotListTestJSON-1360492201 None] Lock "cinder-quobyte-dcb6335b-f76c-436b-a09d-9aa66a87741d" released by "delete_snapshot" :: held 3.336s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:29:00 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-4b7580d8-c3fa-4c0f-be3e-795dca86b1d9 tempest-VolumesSnapshotListTestJSON-1360492201 None] Created reservations ['11fa95a2-82ee-431e-898c-402bef99c4e6', '8a03210f-b745-4de8-b7de-1f79eb2d48f9', 'f9e7eb29-ff4a-47ce-88ff-5445127c2a67', '5d6adf9b-1c27-4ab4-a4a4-59d7a8ba102b'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:29:00 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-4b7580d8-c3fa-4c0f-be3e-795dca86b1d9 tempest-VolumesSnapshotListTestJSON-1360492201 None] Delete snapshot completed successfully. Jul 11 04:29:00 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4b7580d8-c3fa-4c0f-be3e-795dca86b1d9 tempest-VolumesSnapshotListTestJSON-1360492201 None] Lock "cinder-54387337-a494-4999-8d2a-57ce7cdd888f-delete_snapshot" released by "delete_snapshot" :: held 3.478s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:29:01 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-dd679900-c044-44b4-abd0-84df3d09bf2d tempest-VolumesSnapshotListTestJSON-1360492201 None] Acquiring lock "cinder-dcb6335b-f76c-436b-a09d-9aa66a87741d-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:29:01 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-dd679900-c044-44b4-abd0-84df3d09bf2d tempest-VolumesSnapshotListTestJSON-1360492201 None] Lock "cinder-dcb6335b-f76c-436b-a09d-9aa66a87741d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:29:01 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-dd679900-c044-44b4-abd0-84df3d09bf2d tempest-VolumesSnapshotListTestJSON-1360492201 None] Acquiring lock "cinder-quobyte-dcb6335b-f76c-436b-a09d-9aa66a87741d" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:29:01 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-dd679900-c044-44b4-abd0-84df3d09bf2d tempest-VolumesSnapshotListTestJSON-1360492201 None] Lock "cinder-quobyte-dcb6335b-f76c-436b-a09d-9aa66a87741d" acquired by "delete_volume" :: waited 0.024s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:29:01 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e98639-1da3-4c74-9b83-7edbb788b0c0]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:29:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dd679900-c044-44b4-abd0-84df3d09bf2d tempest-VolumesSnapshotListTestJSON-1360492201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:01 devstack sudo[93679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d Jul 11 04:29:01 devstack sudo[93679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:02 devstack sudo[93679]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dd679900-c044-44b4-abd0-84df3d09bf2d tempest-VolumesSnapshotListTestJSON-1360492201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d" returned: 0 in 0.914s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dd679900-c044-44b4-abd0-84df3d09bf2d tempest-VolumesSnapshotListTestJSON-1360492201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:02 devstack sudo[93684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d Jul 11 04:29:02 devstack sudo[93684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:03 devstack sudo[93684]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dd679900-c044-44b4-abd0-84df3d09bf2d tempest-VolumesSnapshotListTestJSON-1360492201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcb6335b-f76c-436b-a09d-9aa66a87741d" returned: 0 in 1.048s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:03 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-dd679900-c044-44b4-abd0-84df3d09bf2d tempest-VolumesSnapshotListTestJSON-1360492201 None] Lock "cinder-quobyte-dcb6335b-f76c-436b-a09d-9aa66a87741d" released by "delete_volume" :: held 2.038s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:29:03 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-dd679900-c044-44b4-abd0-84df3d09bf2d tempest-VolumesSnapshotListTestJSON-1360492201 None] Created reservations ['8ec98f19-7a11-4abb-baeb-450828551ae7', '06e5f3e6-f87a-4776-9beb-56d9a606c6ac', 'bf01be40-de05-44c2-a706-20fafd9f8de8', '3664c11b-e60a-4f83-97f8-762a0b9b4b15'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:29:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-dd679900-c044-44b4-abd0-84df3d09bf2d tempest-VolumesSnapshotListTestJSON-1360492201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:29:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-dd679900-c044-44b4-abd0-84df3d09bf2d tempest-VolumesSnapshotListTestJSON-1360492201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:29:03 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-dd679900-c044-44b4-abd0-84df3d09bf2d tempest-VolumesSnapshotListTestJSON-1360492201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:29:03 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-dd679900-c044-44b4-abd0-84df3d09bf2d tempest-VolumesSnapshotListTestJSON-1360492201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:29:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-dd679900-c044-44b4-abd0-84df3d09bf2d tempest-VolumesSnapshotListTestJSON-1360492201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:29:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dd679900-c044-44b4-abd0-84df3d09bf2d tempest-VolumesSnapshotListTestJSON-1360492201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:03 devstack sudo[93690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:29:03 devstack sudo[93690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:04 devstack sudo[93690]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dd679900-c044-44b4-abd0-84df3d09bf2d tempest-VolumesSnapshotListTestJSON-1360492201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 1.358s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:04 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-dd679900-c044-44b4-abd0-84df3d09bf2d tempest-VolumesSnapshotListTestJSON-1360492201 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:29:04 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-dd679900-c044-44b4-abd0-84df3d09bf2d tempest-VolumesSnapshotListTestJSON-1360492201 None] Deleted volume successfully. Jul 11 04:29:04 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-dd679900-c044-44b4-abd0-84df3d09bf2d tempest-VolumesSnapshotListTestJSON-1360492201 None] Lock "cinder-dcb6335b-f76c-436b-a09d-9aa66a87741d-delete_volume" released by "delete_volume" :: held 3.782s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:29:05 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-aab2017d-5ed3-4587-ab78-703b65c15c37 tempest-GroupSnapshotsTest-1799390916 None] Group tempest-GroupSnapshotsTest-Group-646568815: creating Jul 11 04:29:05 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-aab2017d-5ed3-4587-ab78-703b65c15c37 tempest-GroupSnapshotsTest-1799390916 None] Group tempest-GroupSnapshotsTest-Group-646568815: created successfully Jul 11 04:29:05 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-aab2017d-5ed3-4587-ab78-703b65c15c37 tempest-GroupSnapshotsTest-1799390916 None] Create group completed successfully. Jul 11 04:29:05 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-9c1467f2-7989-4d1d-9bef-06aa7e87a508 req-b9f3430c-9766-4073-a10d-3bdecac5e678 tempest-ServerActionsTestOtherA-1035839598 None] Terminate volume connection completed successfully. Jul 11 04:29:05 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-9c1467f2-7989-4d1d-9bef-06aa7e87a508 req-b9f3430c-9766-4073-a10d-3bdecac5e678 tempest-ServerActionsTestOtherA-1035839598 None] Deleting attachment e5870136-80ce-410b-bc85-c8ae85326cf5. {{(pid=86964) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 04:29:06 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-d18d3545-3906-45e5-ab15-5a66d2726518 tempest-AttachVolumeShelveTestJSON-291210436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:29:06 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-d18d3545-3906-45e5-ab15-5a66d2726518 tempest-AttachVolumeShelveTestJSON-291210436 None] Flow 'volume_create_manager' (40d30d5a-21fc-4228-a13f-8511174c0ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:29:06 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-d18d3545-3906-45e5-ab15-5a66d2726518 tempest-AttachVolumeShelveTestJSON-291210436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d3c4d6a-e1e9-44ab-8e2d-2f808d6662e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:06 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-d18d3545-3906-45e5-ab15-5a66d2726518 tempest-AttachVolumeShelveTestJSON-291210436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d3c4d6a-e1e9-44ab-8e2d-2f808d6662e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-452816848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceee026f-89f5-4fe7-b36c-79348522657d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='629d8ee112a243f8a2033d15b535bba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:29:06Z,use_quota=True,user_id='7ba3c0f728a343cc8663cddd0b9bc3d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:29:06 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-d18d3545-3906-45e5-ab15-5a66d2726518 tempest-AttachVolumeShelveTestJSON-291210436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aaeb294-5881-4dba-ab49-69a156064c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:06 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-d18d3545-3906-45e5-ab15-5a66d2726518 tempest-AttachVolumeShelveTestJSON-291210436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aaeb294-5881-4dba-ab49-69a156064c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:29:06 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-d18d3545-3906-45e5-ab15-5a66d2726518 tempest-AttachVolumeShelveTestJSON-291210436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c1aec91-5d21-4652-9853-360e9b980fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:06 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-d18d3545-3906-45e5-ab15-5a66d2726518 tempest-AttachVolumeShelveTestJSON-291210436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c1aec91-5d21-4652-9853-360e9b980fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ceee026f-89f5-4fe7-b36c-79348522657d', 'volume_name': 'volume-ceee026f-89f5-4fe7-b36c-79348522657d', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:29:06 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-d18d3545-3906-45e5-ab15-5a66d2726518 tempest-AttachVolumeShelveTestJSON-291210436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d92074e-6d6c-4fda-b942-4e33fd61897c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:06 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-d18d3545-3906-45e5-ab15-5a66d2726518 tempest-AttachVolumeShelveTestJSON-291210436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d92074e-6d6c-4fda-b942-4e33fd61897c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:29:06 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-d18d3545-3906-45e5-ab15-5a66d2726518 tempest-AttachVolumeShelveTestJSON-291210436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9601a8b-f305-4994-a0aa-3ebf6cbd6640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:06 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-d18d3545-3906-45e5-ab15-5a66d2726518 tempest-AttachVolumeShelveTestJSON-291210436 None] Volume ceee026f-89f5-4fe7-b36c-79348522657d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ceee026f-89f5-4fe7-b36c-79348522657d', 'volume_size': 1} Jul 11 04:29:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d18d3545-3906-45e5-ab15-5a66d2726518 tempest-AttachVolumeShelveTestJSON-291210436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:29:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d18d3545-3906-45e5-ab15-5a66d2726518 tempest-AttachVolumeShelveTestJSON-291210436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:29:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-d18d3545-3906-45e5-ab15-5a66d2726518 tempest-AttachVolumeShelveTestJSON-291210436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-452816848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceee026f-89f5-4fe7-b36c-79348522657d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='629d8ee112a243f8a2033d15b535bba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:29:06Z,use_quota=True,user_id='7ba3c0f728a343cc8663cddd0b9bc3d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:29:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-d18d3545-3906-45e5-ab15-5a66d2726518 tempest-AttachVolumeShelveTestJSON-291210436 None] Creating volume ceee026f-89f5-4fe7-b36c-79348522657d {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:29:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d18d3545-3906-45e5-ab15-5a66d2726518 tempest-AttachVolumeShelveTestJSON-291210436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:29:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d18d3545-3906-45e5-ab15-5a66d2726518 tempest-AttachVolumeShelveTestJSON-291210436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:29:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-d18d3545-3906-45e5-ab15-5a66d2726518 tempest-AttachVolumeShelveTestJSON-291210436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:29:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-d18d3545-3906-45e5-ab15-5a66d2726518 tempest-AttachVolumeShelveTestJSON-291210436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:29:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d18d3545-3906-45e5-ab15-5a66d2726518 tempest-AttachVolumeShelveTestJSON-291210436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:29:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-d18d3545-3906-45e5-ab15-5a66d2726518 tempest-AttachVolumeShelveTestJSON-291210436 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:29:06 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-d18d3545-3906-45e5-ab15-5a66d2726518 tempest-AttachVolumeShelveTestJSON-291210436 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:29:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d18d3545-3906-45e5-ab15-5a66d2726518 tempest-AttachVolumeShelveTestJSON-291210436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ceee026f-89f5-4fe7-b36c-79348522657d 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:06 devstack sudo[93722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ceee026f-89f5-4fe7-b36c-79348522657d 1073741824 Jul 11 04:29:06 devstack sudo[93722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:07 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-353c79af-f6bc-4103-8b9e-ec20a60770f9 tempest-GroupSnapshotsTest-1799390916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:29:07 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-353c79af-f6bc-4103-8b9e-ec20a60770f9 tempest-GroupSnapshotsTest-1799390916 None] Flow 'volume_create_manager' (bd06ef46-83ff-467a-a110-f39e7a047103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:29:07 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-353c79af-f6bc-4103-8b9e-ec20a60770f9 tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e58929df-7a46-4ec7-b83b-771cab030b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:07 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-353c79af-f6bc-4103-8b9e-ec20a60770f9 tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e58929df-7a46-4ec7-b83b-771cab030b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-269748856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2bfbd0db-bafa-4feb-9b01-ef73e6d8e4ac,host='devstack@QuobyteHD#QuobyteHD',id=59596506-64f3-4c9b-9dab-00e75bb1ddb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58be74b0ee43492bb1037c8c48daf403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:29:07Z,use_quota=True,user_id='a6072455344c4e1b88ff5a6efb3f2113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f29120d4-3fb8-4f08-81cc-05ae81016fd3),volume_type_id=f29120d4-3fb8-4f08-81cc-05ae81016fd3)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:29:07 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-353c79af-f6bc-4103-8b9e-ec20a60770f9 tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cffa786a-05bc-4c71-a974-5f660cf4cf58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:07 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-353c79af-f6bc-4103-8b9e-ec20a60770f9 tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cffa786a-05bc-4c71-a974-5f660cf4cf58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:29:07 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-353c79af-f6bc-4103-8b9e-ec20a60770f9 tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11447cba-39dd-4216-aeb0-a589d3d500ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:07 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-353c79af-f6bc-4103-8b9e-ec20a60770f9 tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11447cba-39dd-4216-aeb0-a589d3d500ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59596506-64f3-4c9b-9dab-00e75bb1ddb6', 'volume_name': 'volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:29:07 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-353c79af-f6bc-4103-8b9e-ec20a60770f9 tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f0d89c-e6a6-4f1e-97b0-239b7fcea890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:07 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-353c79af-f6bc-4103-8b9e-ec20a60770f9 tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f0d89c-e6a6-4f1e-97b0-239b7fcea890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:29:07 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-353c79af-f6bc-4103-8b9e-ec20a60770f9 tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6f90b5d-5e48-4a6f-a840-b294dd1297e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:07 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-353c79af-f6bc-4103-8b9e-ec20a60770f9 tempest-GroupSnapshotsTest-1799390916 None] Volume 59596506-64f3-4c9b-9dab-00e75bb1ddb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6', 'volume_size': 1} Jul 11 04:29:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-353c79af-f6bc-4103-8b9e-ec20a60770f9 tempest-GroupSnapshotsTest-1799390916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:29:07 devstack sudo[93722]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d18d3545-3906-45e5-ab15-5a66d2726518 tempest-AttachVolumeShelveTestJSON-291210436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ceee026f-89f5-4fe7-b36c-79348522657d 1073741824" returned: 0 in 1.042s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d18d3545-3906-45e5-ab15-5a66d2726518 tempest-AttachVolumeShelveTestJSON-291210436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ceee026f-89f5-4fe7-b36c-79348522657d {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:07 devstack sudo[93729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ceee026f-89f5-4fe7-b36c-79348522657d Jul 11 04:29:07 devstack sudo[93729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:08 devstack sudo[93729]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d18d3545-3906-45e5-ab15-5a66d2726518 tempest-AttachVolumeShelveTestJSON-291210436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ceee026f-89f5-4fe7-b36c-79348522657d" returned: 0 in 0.767s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:08 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-d18d3545-3906-45e5-ab15-5a66d2726518 tempest-AttachVolumeShelveTestJSON-291210436 None] <== create_volume: return (1872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:29:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d18d3545-3906-45e5-ab15-5a66d2726518 tempest-AttachVolumeShelveTestJSON-291210436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.877s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:29:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-353c79af-f6bc-4103-8b9e-ec20a60770f9 tempest-GroupSnapshotsTest-1799390916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.283s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:29:08 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-353c79af-f6bc-4103-8b9e-ec20a60770f9 tempest-GroupSnapshotsTest-1799390916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2bfbd0db-bafa-4feb-9b01-ef73e6d8e4ac,created_at=2026-07-11T02:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-269748856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2bfbd0db-bafa-4feb-9b01-ef73e6d8e4ac,host='devstack@QuobyteHD#QuobyteHD',id=59596506-64f3-4c9b-9dab-00e75bb1ddb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58be74b0ee43492bb1037c8c48daf403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:29:07Z,use_quota=True,user_id='a6072455344c4e1b88ff5a6efb3f2113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f29120d4-3fb8-4f08-81cc-05ae81016fd3),volume_type_id=f29120d4-3fb8-4f08-81cc-05ae81016fd3)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:29:08 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-353c79af-f6bc-4103-8b9e-ec20a60770f9 tempest-GroupSnapshotsTest-1799390916 None] Creating volume 59596506-64f3-4c9b-9dab-00e75bb1ddb6 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:29:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-353c79af-f6bc-4103-8b9e-ec20a60770f9 tempest-GroupSnapshotsTest-1799390916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:29:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-353c79af-f6bc-4103-8b9e-ec20a60770f9 tempest-GroupSnapshotsTest-1799390916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:29:08 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-353c79af-f6bc-4103-8b9e-ec20a60770f9 tempest-GroupSnapshotsTest-1799390916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:29:08 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-353c79af-f6bc-4103-8b9e-ec20a60770f9 tempest-GroupSnapshotsTest-1799390916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:29:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-353c79af-f6bc-4103-8b9e-ec20a60770f9 tempest-GroupSnapshotsTest-1799390916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:29:08 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-353c79af-f6bc-4103-8b9e-ec20a60770f9 tempest-GroupSnapshotsTest-1799390916 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:29:08 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-353c79af-f6bc-4103-8b9e-ec20a60770f9 tempest-GroupSnapshotsTest-1799390916 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:29:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-353c79af-f6bc-4103-8b9e-ec20a60770f9 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-d18d3545-3906-45e5-ab15-5a66d2726518 tempest-AttachVolumeShelveTestJSON-291210436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9601a8b-f305-4994-a0aa-3ebf6cbd6640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ceee026f-89f5-4fe7-b36c-79348522657d', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:29:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-d18d3545-3906-45e5-ab15-5a66d2726518 tempest-AttachVolumeShelveTestJSON-291210436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0ba2053-9722-409b-84d6-8bf7c54d1730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:08 devstack sudo[93732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6 1073741824 Jul 11 04:29:08 devstack sudo[93732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:08 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-d18d3545-3906-45e5-ab15-5a66d2726518 tempest-AttachVolumeShelveTestJSON-291210436 None] Volume volume-ceee026f-89f5-4fe7-b36c-79348522657d (ceee026f-89f5-4fe7-b36c-79348522657d): created successfully Jul 11 04:29:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-d18d3545-3906-45e5-ab15-5a66d2726518 tempest-AttachVolumeShelveTestJSON-291210436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0ba2053-9722-409b-84d6-8bf7c54d1730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:29:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-d18d3545-3906-45e5-ab15-5a66d2726518 tempest-AttachVolumeShelveTestJSON-291210436 None] Flow 'volume_create_manager' (40d30d5a-21fc-4228-a13f-8511174c0ab2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:29:08 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-d18d3545-3906-45e5-ab15-5a66d2726518 tempest-AttachVolumeShelveTestJSON-291210436 None] Created volume successfully. Jul 11 04:29:09 devstack sudo[93732]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-353c79af-f6bc-4103-8b9e-ec20a60770f9 tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6 1073741824" returned: 0 in 0.933s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-353c79af-f6bc-4103-8b9e-ec20a60770f9 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:09 devstack sudo[93751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6 Jul 11 04:29:09 devstack sudo[93751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:10 devstack sudo[93751]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-353c79af-f6bc-4103-8b9e-ec20a60770f9 tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6" returned: 0 in 1.008s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:10 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-353c79af-f6bc-4103-8b9e-ec20a60770f9 tempest-GroupSnapshotsTest-1799390916 None] <== create_volume: return (2047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:29:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-353c79af-f6bc-4103-8b9e-ec20a60770f9 tempest-GroupSnapshotsTest-1799390916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.052s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:29:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-353c79af-f6bc-4103-8b9e-ec20a60770f9 tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6f90b5d-5e48-4a6f-a840-b294dd1297e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:29:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-353c79af-f6bc-4103-8b9e-ec20a60770f9 tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (916a7d97-7f51-4dc9-9b77-be1d14bac6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:10 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-353c79af-f6bc-4103-8b9e-ec20a60770f9 tempest-GroupSnapshotsTest-1799390916 None] Volume volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6 (59596506-64f3-4c9b-9dab-00e75bb1ddb6): created successfully Jul 11 04:29:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-353c79af-f6bc-4103-8b9e-ec20a60770f9 tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (916a7d97-7f51-4dc9-9b77-be1d14bac6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:29:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-353c79af-f6bc-4103-8b9e-ec20a60770f9 tempest-GroupSnapshotsTest-1799390916 None] Flow 'volume_create_manager' (bd06ef46-83ff-467a-a110-f39e7a047103) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:29:10 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-353c79af-f6bc-4103-8b9e-ec20a60770f9 tempest-GroupSnapshotsTest-1799390916 None] Created volume successfully. Jul 11 04:29:11 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-ca667129-fc7b-4d4a-a578-e8bca201f394 tempest-GroupSnapshotsTest-1799390916 None] GroupSnapshot e8c37436-c431-49e0-9e96-1e1383fb9ae1: creating. Jul 11 04:29:11 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ca667129-fc7b-4d4a-a578-e8bca201f394 tempest-GroupSnapshotsTest-1799390916 None] Group snapshot e8c37436-c431-49e0-9e96-1e1383fb9ae1: creating. {{(pid=86964) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 11 04:29:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ca667129-fc7b-4d4a-a578-e8bca201f394 tempest-GroupSnapshotsTest-1799390916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:29:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ca667129-fc7b-4d4a-a578-e8bca201f394 tempest-GroupSnapshotsTest-1799390916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:29:11 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-ca667129-fc7b-4d4a-a578-e8bca201f394 tempest-GroupSnapshotsTest-1799390916 None] Creating offline snapshot d4f1985b-e7be-46b7-b35e-246e36b55ce5 of volume 59596506-64f3-4c9b-9dab-00e75bb1ddb6 {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:29:11 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[118f7662-a96a-4518-b6ef-90d84d9f908c]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:29:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ca667129-fc7b-4d4a-a578-e8bca201f394 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:11 devstack sudo[93771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6 Jul 11 04:29:11 devstack sudo[93771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:12 devstack sudo[93771]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ca667129-fc7b-4d4a-a578-e8bca201f394 tempest-GroupSnapshotsTest-1799390916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6" returned: 0 in 0.967s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ca667129-fc7b-4d4a-a578-e8bca201f394 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6.d4f1985b-e7be-46b7-b35e-246e36b55ce5 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:12 devstack sudo[93779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6.d4f1985b-e7be-46b7-b35e-246e36b55ce5 1G Jul 11 04:29:12 devstack sudo[93779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:13 devstack sudo[93779]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ca667129-fc7b-4d4a-a578-e8bca201f394 tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6.d4f1985b-e7be-46b7-b35e-246e36b55ce5 1G" returned: 0 in 1.111s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ca667129-fc7b-4d4a-a578-e8bca201f394 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6.d4f1985b-e7be-46b7-b35e-246e36b55ce5 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:13 devstack sudo[93789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6.d4f1985b-e7be-46b7-b35e-246e36b55ce5 Jul 11 04:29:13 devstack sudo[93789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:14 devstack sudo[93789]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ca667129-fc7b-4d4a-a578-e8bca201f394 tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6.d4f1985b-e7be-46b7-b35e-246e36b55ce5" returned: 0 in 0.815s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:14 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-ca667129-fc7b-4d4a-a578-e8bca201f394 tempest-GroupSnapshotsTest-1799390916 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6.d4f1985b-e7be-46b7-b35e-246e36b55ce5 is being set with open permissions: ugo+rw: NotImplementedError Jul 11 04:29:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ca667129-fc7b-4d4a-a578-e8bca201f394 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6.d4f1985b-e7be-46b7-b35e-246e36b55ce5 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:14 devstack sudo[93794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6.d4f1985b-e7be-46b7-b35e-246e36b55ce5 Jul 11 04:29:14 devstack sudo[93794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:14 devstack sudo[93794]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ca667129-fc7b-4d4a-a578-e8bca201f394 tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6.d4f1985b-e7be-46b7-b35e-246e36b55ce5" returned: 0 in 0.696s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ca667129-fc7b-4d4a-a578-e8bca201f394 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:14 devstack sudo[93798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6.info Jul 11 04:29:14 devstack sudo[93798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:15 devstack sudo[93798]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ca667129-fc7b-4d4a-a578-e8bca201f394 tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6.info" returned: 0 in 0.815s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:15 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-ca667129-fc7b-4d4a-a578-e8bca201f394 tempest-GroupSnapshotsTest-1799390916 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6.info is being set with open permissions: ugo+rw: NotImplementedError Jul 11 04:29:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ca667129-fc7b-4d4a-a578-e8bca201f394 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:15 devstack sudo[93810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6.info Jul 11 04:29:15 devstack sudo[93810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:16 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f448fbb3-d9cd-4077-ac3b-0070636b16a0 tempest-ServerActionsTestOtherA-1035839598 None] Acquiring lock "cinder-0db52474-5f6d-4c6d-93be-ef4e54a2a54b-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:29:16 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f448fbb3-d9cd-4077-ac3b-0070636b16a0 tempest-ServerActionsTestOtherA-1035839598 None] Lock "cinder-0db52474-5f6d-4c6d-93be-ef4e54a2a54b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:29:16 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f448fbb3-d9cd-4077-ac3b-0070636b16a0 tempest-ServerActionsTestOtherA-1035839598 None] Acquiring lock "cinder-quobyte-0db52474-5f6d-4c6d-93be-ef4e54a2a54b" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:29:16 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f448fbb3-d9cd-4077-ac3b-0070636b16a0 tempest-ServerActionsTestOtherA-1035839598 None] Lock "cinder-quobyte-0db52474-5f6d-4c6d-93be-ef4e54a2a54b" acquired by "delete_volume" :: waited 0.038s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:29:16 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e66527-3ee3-45a3-ba51-e9d57f3d6393]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:29:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f448fbb3-d9cd-4077-ac3b-0070636b16a0 tempest-ServerActionsTestOtherA-1035839598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0db52474-5f6d-4c6d-93be-ef4e54a2a54b {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:16 devstack sudo[93812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0db52474-5f6d-4c6d-93be-ef4e54a2a54b Jul 11 04:29:16 devstack sudo[93812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:16 devstack sudo[93810]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ca667129-fc7b-4d4a-a578-e8bca201f394 tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6.info" returned: 0 in 0.969s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ca667129-fc7b-4d4a-a578-e8bca201f394 tempest-GroupSnapshotsTest-1799390916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.504s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:29:16 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-ca667129-fc7b-4d4a-a578-e8bca201f394 tempest-GroupSnapshotsTest-1799390916 None] group_snapshot e8c37436-c431-49e0-9e96-1e1383fb9ae1: created successfully Jul 11 04:29:17 devstack sudo[93812]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f448fbb3-d9cd-4077-ac3b-0070636b16a0 tempest-ServerActionsTestOtherA-1035839598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0db52474-5f6d-4c6d-93be-ef4e54a2a54b" returned: 0 in 0.910s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f448fbb3-d9cd-4077-ac3b-0070636b16a0 tempest-ServerActionsTestOtherA-1035839598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0db52474-5f6d-4c6d-93be-ef4e54a2a54b {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:17 devstack sudo[93819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0db52474-5f6d-4c6d-93be-ef4e54a2a54b Jul 11 04:29:17 devstack sudo[93819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:18 devstack sudo[93819]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f448fbb3-d9cd-4077-ac3b-0070636b16a0 tempest-ServerActionsTestOtherA-1035839598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0db52474-5f6d-4c6d-93be-ef4e54a2a54b" returned: 0 in 0.890s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:18 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f448fbb3-d9cd-4077-ac3b-0070636b16a0 tempest-ServerActionsTestOtherA-1035839598 None] Lock "cinder-quobyte-0db52474-5f6d-4c6d-93be-ef4e54a2a54b" released by "delete_volume" :: held 1.867s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:29:18 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-f448fbb3-d9cd-4077-ac3b-0070636b16a0 tempest-ServerActionsTestOtherA-1035839598 None] Created reservations ['1ad9e399-4899-4281-9f62-dd17d5c4b94a', '6e7e832f-826a-4666-b80a-9f7a6bda5435', '51688855-4968-4492-9607-6a17442d439b', 'abbed35d-4463-4b76-98db-d1d05a206862'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:29:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f448fbb3-d9cd-4077-ac3b-0070636b16a0 tempest-ServerActionsTestOtherA-1035839598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:29:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f448fbb3-d9cd-4077-ac3b-0070636b16a0 tempest-ServerActionsTestOtherA-1035839598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:29:18 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-f448fbb3-d9cd-4077-ac3b-0070636b16a0 tempest-ServerActionsTestOtherA-1035839598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:29:18 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-f448fbb3-d9cd-4077-ac3b-0070636b16a0 tempest-ServerActionsTestOtherA-1035839598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:29:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f448fbb3-d9cd-4077-ac3b-0070636b16a0 tempest-ServerActionsTestOtherA-1035839598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:29:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f448fbb3-d9cd-4077-ac3b-0070636b16a0 tempest-ServerActionsTestOtherA-1035839598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:18 devstack sudo[93828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:29:18 devstack sudo[93828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-cfacd700-ba28-4300-95e4-a645a1498240 tempest-GroupSnapshotsTest-1799390916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:29:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-cfacd700-ba28-4300-95e4-a645a1498240 tempest-GroupSnapshotsTest-1799390916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:29:18 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-cfacd700-ba28-4300-95e4-a645a1498240 tempest-GroupSnapshotsTest-1799390916 None] Acquiring lock "cinder-quobyte-d4f1985b-e7be-46b7-b35e-246e36b55ce5-e3bf3b61-4e96-41c6-81eb-acfd343be946" by "_create_volume_from_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:29:18 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-cfacd700-ba28-4300-95e4-a645a1498240 tempest-GroupSnapshotsTest-1799390916 None] Lock "cinder-quobyte-d4f1985b-e7be-46b7-b35e-246e36b55ce5-e3bf3b61-4e96-41c6-81eb-acfd343be946" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:29:18 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-cfacd700-ba28-4300-95e4-a645a1498240 tempest-GroupSnapshotsTest-1799390916 None] Creating volume e3bf3b61-4e96-41c6-81eb-acfd343be946 from snapshot d4f1985b-e7be-46b7-b35e-246e36b55ce5 {{(pid=86964) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 04:29:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-cfacd700-ba28-4300-95e4-a645a1498240 tempest-GroupSnapshotsTest-1799390916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:29:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-cfacd700-ba28-4300-95e4-a645a1498240 tempest-GroupSnapshotsTest-1799390916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:29:18 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-cfacd700-ba28-4300-95e4-a645a1498240 tempest-GroupSnapshotsTest-1799390916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:29:18 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-cfacd700-ba28-4300-95e4-a645a1498240 tempest-GroupSnapshotsTest-1799390916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:29:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-cfacd700-ba28-4300-95e4-a645a1498240 tempest-GroupSnapshotsTest-1799390916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:29:18 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-cfacd700-ba28-4300-95e4-a645a1498240 tempest-GroupSnapshotsTest-1799390916 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:29:18 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-cfacd700-ba28-4300-95e4-a645a1498240 tempest-GroupSnapshotsTest-1799390916 None] Acquiring lock "cinder-quobyte-e3bf3b61-4e96-41c6-81eb-acfd343be946" by "_copy_volume_from_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:29:18 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-cfacd700-ba28-4300-95e4-a645a1498240 tempest-GroupSnapshotsTest-1799390916 None] Lock "cinder-quobyte-e3bf3b61-4e96-41c6-81eb-acfd343be946" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:29:18 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-cfacd700-ba28-4300-95e4-a645a1498240 tempest-GroupSnapshotsTest-1799390916 None] snapshot: d4f1985b-e7be-46b7-b35e-246e36b55ce5, volume: e3bf3b61-4e96-41c6-81eb-acfd343be946, {{(pid=86964) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 04:29:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-cfacd700-ba28-4300-95e4-a645a1498240 tempest-GroupSnapshotsTest-1799390916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:29:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-cfacd700-ba28-4300-95e4-a645a1498240 tempest-GroupSnapshotsTest-1799390916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:29:19 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-cfacd700-ba28-4300-95e4-a645a1498240 tempest-GroupSnapshotsTest-1799390916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:29:19 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-cfacd700-ba28-4300-95e4-a645a1498240 tempest-GroupSnapshotsTest-1799390916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:29:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-cfacd700-ba28-4300-95e4-a645a1498240 tempest-GroupSnapshotsTest-1799390916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:29:19 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[2707cd68-23c1-4f54-87fa-b6b0998de869]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:29:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cfacd700-ba28-4300-95e4-a645a1498240 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6.d4f1985b-e7be-46b7-b35e-246e36b55ce5 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:19 devstack sudo[93831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6.d4f1985b-e7be-46b7-b35e-246e36b55ce5 Jul 11 04:29:19 devstack sudo[93831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:19 devstack sudo[93828]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f448fbb3-d9cd-4077-ac3b-0070636b16a0 tempest-ServerActionsTestOtherA-1035839598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 1.306s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:19 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-f448fbb3-d9cd-4077-ac3b-0070636b16a0 tempest-ServerActionsTestOtherA-1035839598 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:29:19 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-f448fbb3-d9cd-4077-ac3b-0070636b16a0 tempest-ServerActionsTestOtherA-1035839598 None] Deleted volume successfully. Jul 11 04:29:19 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f448fbb3-d9cd-4077-ac3b-0070636b16a0 tempest-ServerActionsTestOtherA-1035839598 None] Lock "cinder-0db52474-5f6d-4c6d-93be-ef4e54a2a54b-delete_volume" released by "delete_volume" :: held 3.525s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:29:20 devstack sudo[93831]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cfacd700-ba28-4300-95e4-a645a1498240 tempest-GroupSnapshotsTest-1799390916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6.d4f1985b-e7be-46b7-b35e-246e36b55ce5" returned: 0 in 1.205s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:20 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-cfacd700-ba28-4300-95e4-a645a1498240 tempest-GroupSnapshotsTest-1799390916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:29:20 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-cfacd700-ba28-4300-95e4-a645a1498240 tempest-GroupSnapshotsTest-1799390916 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6 {{(pid=86964) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 04:29:20 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-cfacd700-ba28-4300-95e4-a645a1498240 tempest-GroupSnapshotsTest-1799390916 None] Creating direct copy from snapshot {{(pid=86964) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 04:29:20 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d6a7fd-1d77-488c-a5ad-3665bae236f7]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:29:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cfacd700-ba28-4300-95e4-a645a1498240 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:20 devstack sudo[93843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6 Jul 11 04:29:20 devstack sudo[93843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:21 devstack sudo[93843]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cfacd700-ba28-4300-95e4-a645a1498240 tempest-GroupSnapshotsTest-1799390916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6" returned: 0 in 1.088s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:21 devstack cinder-volume[86964]: DEBUG cinder.utils [None req-cfacd700-ba28-4300-95e4-a645a1498240 tempest-GroupSnapshotsTest-1799390916 None] Path /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e3bf3b61-4e96-41c6-81eb-acfd343be946 not found in is_blk_device check {{(pid=86964) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 04:29:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cfacd700-ba28-4300-95e4-a645a1498240 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e3bf3b61-4e96-41c6-81eb-acfd343be946 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:21 devstack sudo[93865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e3bf3b61-4e96-41c6-81eb-acfd343be946 Jul 11 04:29:21 devstack sudo[93865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:27 devstack sudo[93865]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cfacd700-ba28-4300-95e4-a645a1498240 tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e3bf3b61-4e96-41c6-81eb-acfd343be946" returned: 0 in 6.430s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:27 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[171b0176-5c95-45b6-ae83-41ae3716b956]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:29:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cfacd700-ba28-4300-95e4-a645a1498240 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:27 devstack sudo[93883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6 Jul 11 04:29:28 devstack sudo[93883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:28 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=77,cinder:UPDATE=75,cinder:DELETE=7,cinder:INSERT=22 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:29:29 devstack sudo[93883]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cfacd700-ba28-4300-95e4-a645a1498240 tempest-GroupSnapshotsTest-1799390916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6" returned: 0 in 1.201s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:29 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-cfacd700-ba28-4300-95e4-a645a1498240 tempest-GroupSnapshotsTest-1799390916 None] Image conversion details: src /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6, size 1024.00 MB, duration 6.43 sec, destination /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e3bf3b61-4e96-41c6-81eb-acfd343be946 {{(pid=86964) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 04:29:29 devstack cinder-volume[86964]: INFO cinder.image.image_utils [None req-cfacd700-ba28-4300-95e4-a645a1498240 tempest-GroupSnapshotsTest-1799390916 None] Converted 1024.00 MB image at 159.20 MB/s Jul 11 04:29:29 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-cfacd700-ba28-4300-95e4-a645a1498240 tempest-GroupSnapshotsTest-1799390916 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e3bf3b61-4e96-41c6-81eb-acfd343be946 is being set with open permissions: ugo+rw: NotImplementedError Jul 11 04:29:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cfacd700-ba28-4300-95e4-a645a1498240 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e3bf3b61-4e96-41c6-81eb-acfd343be946 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:29 devstack sudo[93906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e3bf3b61-4e96-41c6-81eb-acfd343be946 Jul 11 04:29:29 devstack sudo[93906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:29 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=70,cinder:INSERT=17,cinder:UPDATE=83,cinder:DELETE=6 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:29:29 devstack sudo[93906]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cfacd700-ba28-4300-95e4-a645a1498240 tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e3bf3b61-4e96-41c6-81eb-acfd343be946" returned: 0 in 0.769s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:29 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-cfacd700-ba28-4300-95e4-a645a1498240 tempest-GroupSnapshotsTest-1799390916 None] Lock "cinder-quobyte-e3bf3b61-4e96-41c6-81eb-acfd343be946" released by "_copy_volume_from_snapshot" :: held 10.878s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:29:29 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-cfacd700-ba28-4300-95e4-a645a1498240 tempest-GroupSnapshotsTest-1799390916 None] Lock "cinder-quobyte-d4f1985b-e7be-46b7-b35e-246e36b55ce5-e3bf3b61-4e96-41c6-81eb-acfd343be946" released by "_create_volume_from_snapshot" :: held 10.918s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:29:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-cfacd700-ba28-4300-95e4-a645a1498240 tempest-GroupSnapshotsTest-1799390916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.954s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:29:30 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-cfacd700-ba28-4300-95e4-a645a1498240 tempest-GroupSnapshotsTest-1799390916 None] Create group from source-snapshot-e8c37436-c431-49e0-9e96-1e1383fb9ae1 completed successfully. Jul 11 04:29:30 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-0807a3b0-d499-4fd7-82d7-0243a6ae1eb3 tempest-GroupSnapshotsTest-1799390916 None] Acquiring lock "cinder-quobyte-e3bf3b61-4e96-41c6-81eb-acfd343be946" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:29:30 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-0807a3b0-d499-4fd7-82d7-0243a6ae1eb3 tempest-GroupSnapshotsTest-1799390916 None] Lock "cinder-quobyte-e3bf3b61-4e96-41c6-81eb-acfd343be946" acquired by "delete_volume" :: waited 0.026s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:29:30 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[6763fd55-9f06-4d17-9222-eb6d40704c41]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:29:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-0807a3b0-d499-4fd7-82d7-0243a6ae1eb3 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e3bf3b61-4e96-41c6-81eb-acfd343be946 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:30 devstack sudo[93910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e3bf3b61-4e96-41c6-81eb-acfd343be946 Jul 11 04:29:30 devstack sudo[93910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:31 devstack sudo[93910]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-0807a3b0-d499-4fd7-82d7-0243a6ae1eb3 tempest-GroupSnapshotsTest-1799390916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e3bf3b61-4e96-41c6-81eb-acfd343be946" returned: 0 in 0.987s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-0807a3b0-d499-4fd7-82d7-0243a6ae1eb3 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e3bf3b61-4e96-41c6-81eb-acfd343be946 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:31 devstack sudo[93915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e3bf3b61-4e96-41c6-81eb-acfd343be946 Jul 11 04:29:31 devstack sudo[93915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:32 devstack sudo[93915]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-0807a3b0-d499-4fd7-82d7-0243a6ae1eb3 tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e3bf3b61-4e96-41c6-81eb-acfd343be946" returned: 0 in 0.727s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:32 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-0807a3b0-d499-4fd7-82d7-0243a6ae1eb3 tempest-GroupSnapshotsTest-1799390916 None] Lock "cinder-quobyte-e3bf3b61-4e96-41c6-81eb-acfd343be946" released by "delete_volume" :: held 1.763s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:29:32 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-0807a3b0-d499-4fd7-82d7-0243a6ae1eb3 tempest-GroupSnapshotsTest-1799390916 None] Created reservations ['543b5dc8-f0e5-4738-b9e1-777d8634127c'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:29:32 devstack cinder-volume[86964]: WARNING cinder.quota [None req-0807a3b0-d499-4fd7-82d7-0243a6ae1eb3 tempest-GroupSnapshotsTest-1799390916 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-237315024 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-237315024, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:29:32 devstack cinder-volume[86964]: WARNING cinder.quota [None req-0807a3b0-d499-4fd7-82d7-0243a6ae1eb3 tempest-GroupSnapshotsTest-1799390916 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-237315024 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-237315024, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:29:32 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-0807a3b0-d499-4fd7-82d7-0243a6ae1eb3 tempest-GroupSnapshotsTest-1799390916 None] Created reservations ['3d3bcb43-4452-4f02-a6e1-84f2e3b2bf10', 'bd2e1760-58b0-4885-83a8-e83c30b5adea', '5604a101-c293-4cd2-951d-5f97d0b28dc9', 'acf020fc-acb6-4c3d-8f52-0782a85ba250'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:29:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-0807a3b0-d499-4fd7-82d7-0243a6ae1eb3 tempest-GroupSnapshotsTest-1799390916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:29:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-0807a3b0-d499-4fd7-82d7-0243a6ae1eb3 tempest-GroupSnapshotsTest-1799390916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:29:32 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-0807a3b0-d499-4fd7-82d7-0243a6ae1eb3 tempest-GroupSnapshotsTest-1799390916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:29:32 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-0807a3b0-d499-4fd7-82d7-0243a6ae1eb3 tempest-GroupSnapshotsTest-1799390916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:29:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-0807a3b0-d499-4fd7-82d7-0243a6ae1eb3 tempest-GroupSnapshotsTest-1799390916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:29:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-0807a3b0-d499-4fd7-82d7-0243a6ae1eb3 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:32 devstack sudo[93918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:29:32 devstack sudo[93918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:33 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-1a2d69a4-3cac-41a0-80d6-24d30aa2eacc tempest-GroupSnapshotsTest-1799390916 None] group_snapshot e8c37436-c431-49e0-9e96-1e1383fb9ae1: deleting Jul 11 04:29:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1a2d69a4-3cac-41a0-80d6-24d30aa2eacc tempest-GroupSnapshotsTest-1799390916 None] group_snapshot e8c37436-c431-49e0-9e96-1e1383fb9ae1: deleting {{(pid=86964) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 11 04:29:33 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1a2d69a4-3cac-41a0-80d6-24d30aa2eacc tempest-GroupSnapshotsTest-1799390916 None] Acquiring lock "cinder-quobyte-59596506-64f3-4c9b-9dab-00e75bb1ddb6" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:29:33 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1a2d69a4-3cac-41a0-80d6-24d30aa2eacc tempest-GroupSnapshotsTest-1799390916 None] Lock "cinder-quobyte-59596506-64f3-4c9b-9dab-00e75bb1ddb6" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:29:33 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1a2d69a4-3cac-41a0-80d6-24d30aa2eacc tempest-GroupSnapshotsTest-1799390916 None] Acquiring lock "cinder-quobyte-d4f1985b-e7be-46b7-b35e-246e36b55ce5" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:29:33 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1a2d69a4-3cac-41a0-80d6-24d30aa2eacc tempest-GroupSnapshotsTest-1799390916 None] Lock "cinder-quobyte-d4f1985b-e7be-46b7-b35e-246e36b55ce5" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:29:33 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-1a2d69a4-3cac-41a0-80d6-24d30aa2eacc tempest-GroupSnapshotsTest-1799390916 None] Deleting offline snapshot d4f1985b-e7be-46b7-b35e-246e36b55ce5 of volume 59596506-64f3-4c9b-9dab-00e75bb1ddb6 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:29:33 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-1a2d69a4-3cac-41a0-80d6-24d30aa2eacc tempest-GroupSnapshotsTest-1799390916 None] snapshot_file for this snap is: volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6.d4f1985b-e7be-46b7-b35e-246e36b55ce5 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:29:33 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf967d4-42b5-4cb5-9019-f1892f61ea65]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:29:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1a2d69a4-3cac-41a0-80d6-24d30aa2eacc tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6.d4f1985b-e7be-46b7-b35e-246e36b55ce5 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:33 devstack sudo[93922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6.d4f1985b-e7be-46b7-b35e-246e36b55ce5 Jul 11 04:29:33 devstack sudo[93922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:33 devstack sudo[93918]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-0807a3b0-d499-4fd7-82d7-0243a6ae1eb3 tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 1.075s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:33 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-0807a3b0-d499-4fd7-82d7-0243a6ae1eb3 tempest-GroupSnapshotsTest-1799390916 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:29:33 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-0807a3b0-d499-4fd7-82d7-0243a6ae1eb3 tempest-GroupSnapshotsTest-1799390916 None] Delete group completed successfully. Jul 11 04:29:34 devstack sudo[93922]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1a2d69a4-3cac-41a0-80d6-24d30aa2eacc tempest-GroupSnapshotsTest-1799390916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6.d4f1985b-e7be-46b7-b35e-246e36b55ce5" returned: 0 in 1.176s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:34 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-1a2d69a4-3cac-41a0-80d6-24d30aa2eacc tempest-GroupSnapshotsTest-1799390916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:29:34 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[710af4c6-8170-453f-bd1c-fca2a1f1f651]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:29:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1a2d69a4-3cac-41a0-80d6-24d30aa2eacc tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:34 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-e0290444-bb22-477b-81bd-4f5e38da1a6b req-6d6b9bf7-dc81-4fa1-9fcb-58eb58dcf7df tempest-AttachVolumeShelveTestJSON-291210436 None] No connector for attachment ddb4a4ec-fce6-482a-88c3-bdff28a2b637; skipping storage backend terminate_connection call. {{(pid=86964) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 11 04:29:34 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-e0290444-bb22-477b-81bd-4f5e38da1a6b req-6d6b9bf7-dc81-4fa1-9fcb-58eb58dcf7df tempest-AttachVolumeShelveTestJSON-291210436 None] Deleting attachment ddb4a4ec-fce6-482a-88c3-bdff28a2b637. {{(pid=86964) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 04:29:34 devstack sudo[93928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6 Jul 11 04:29:34 devstack sudo[93928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:35 devstack sudo[93928]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1a2d69a4-3cac-41a0-80d6-24d30aa2eacc tempest-GroupSnapshotsTest-1799390916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6" returned: 0 in 0.917s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1a2d69a4-3cac-41a0-80d6-24d30aa2eacc tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6.d4f1985b-e7be-46b7-b35e-246e36b55ce5 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:35 devstack sudo[93934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6.d4f1985b-e7be-46b7-b35e-246e36b55ce5 Jul 11 04:29:35 devstack sudo[93934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:36 devstack sudo[93934]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1a2d69a4-3cac-41a0-80d6-24d30aa2eacc tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6.d4f1985b-e7be-46b7-b35e-246e36b55ce5" returned: 0 in 1.092s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1a2d69a4-3cac-41a0-80d6-24d30aa2eacc tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6.d4f1985b-e7be-46b7-b35e-246e36b55ce5 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:36 devstack sudo[93945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6.d4f1985b-e7be-46b7-b35e-246e36b55ce5 Jul 11 04:29:36 devstack sudo[93945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:37 devstack sudo[93945]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1a2d69a4-3cac-41a0-80d6-24d30aa2eacc tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6.d4f1985b-e7be-46b7-b35e-246e36b55ce5" returned: 0 in 1.072s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:37 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1a2d69a4-3cac-41a0-80d6-24d30aa2eacc tempest-GroupSnapshotsTest-1799390916 None] Lock "cinder-quobyte-d4f1985b-e7be-46b7-b35e-246e36b55ce5" released by "_delete_snapshot" :: held 4.435s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:29:37 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1a2d69a4-3cac-41a0-80d6-24d30aa2eacc tempest-GroupSnapshotsTest-1799390916 None] Lock "cinder-quobyte-59596506-64f3-4c9b-9dab-00e75bb1ddb6" released by "delete_snapshot" :: held 4.474s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:29:37 devstack cinder-volume[86964]: WARNING cinder.quota [None req-1a2d69a4-3cac-41a0-80d6-24d30aa2eacc tempest-GroupSnapshotsTest-1799390916 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-237315024 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-237315024, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:29:37 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-1a2d69a4-3cac-41a0-80d6-24d30aa2eacc tempest-GroupSnapshotsTest-1799390916 None] Created reservations ['01cd75ed-7f64-46d2-8ae8-3dcff625b6de', '6c307035-cf18-45a2-87b6-6092713468fd', '0bec851b-f1d8-4dc9-94e9-24b10130b408', 'ff8017f8-e5c5-4541-ad3c-aa7371d5acb5'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:29:38 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-1a2d69a4-3cac-41a0-80d6-24d30aa2eacc tempest-GroupSnapshotsTest-1799390916 None] group_snapshot e8c37436-c431-49e0-9e96-1e1383fb9ae1: deleted successfully Jul 11 04:29:38 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a673c48-37dd-4b54-a3b4-4c4f1eb8d1ff tempest-TestInstancesWithCinderVolumes-1584482579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:29:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2a673c48-37dd-4b54-a3b4-4c4f1eb8d1ff tempest-TestInstancesWithCinderVolumes-1584482579 None] Flow 'volume_create_manager' (3cab8250-3f85-4d76-accb-cbbd17f407ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:29:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2a673c48-37dd-4b54-a3b4-4c4f1eb8d1ff tempest-TestInstancesWithCinderVolumes-1584482579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15ec7d87-7b1f-4fee-8287-f3916bddbc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2a673c48-37dd-4b54-a3b4-4c4f1eb8d1ff tempest-TestInstancesWithCinderVolumes-1584482579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15ec7d87-7b1f-4fee-8287-f3916bddbc57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1510042844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24061528-da9f-4b35-abc7-63fcb9272923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c7556ff11374960adc5d8b86e5a55a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:29:39Z,use_quota=True,user_id='b960ea4402fc4c4ea158d9c2eec6fd1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6310c8-9091-4606-84c3-2c29ba3667c8),volume_type_id=1e6310c8-9091-4606-84c3-2c29ba3667c8)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:29:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2a673c48-37dd-4b54-a3b4-4c4f1eb8d1ff tempest-TestInstancesWithCinderVolumes-1584482579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f97f449d-d383-4872-9106-1ff24884b086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2a673c48-37dd-4b54-a3b4-4c4f1eb8d1ff tempest-TestInstancesWithCinderVolumes-1584482579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f97f449d-d383-4872-9106-1ff24884b086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:29:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2a673c48-37dd-4b54-a3b4-4c4f1eb8d1ff tempest-TestInstancesWithCinderVolumes-1584482579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e61f705-9dcd-49f1-8ff7-5297e79ff0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2a673c48-37dd-4b54-a3b4-4c4f1eb8d1ff tempest-TestInstancesWithCinderVolumes-1584482579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e61f705-9dcd-49f1-8ff7-5297e79ff0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24061528-da9f-4b35-abc7-63fcb9272923', 'volume_name': 'volume-24061528-da9f-4b35-abc7-63fcb9272923', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:29:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2a673c48-37dd-4b54-a3b4-4c4f1eb8d1ff tempest-TestInstancesWithCinderVolumes-1584482579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de122bde-3dd7-43d1-a7de-6b3b1200f388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2a673c48-37dd-4b54-a3b4-4c4f1eb8d1ff tempest-TestInstancesWithCinderVolumes-1584482579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de122bde-3dd7-43d1-a7de-6b3b1200f388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:29:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2a673c48-37dd-4b54-a3b4-4c4f1eb8d1ff tempest-TestInstancesWithCinderVolumes-1584482579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17b44ea5-ea8d-4172-9c64-57ee42b713f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:39 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-2a673c48-37dd-4b54-a3b4-4c4f1eb8d1ff tempest-TestInstancesWithCinderVolumes-1584482579 None] Volume 24061528-da9f-4b35-abc7-63fcb9272923: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24061528-da9f-4b35-abc7-63fcb9272923', 'volume_size': 1} Jul 11 04:29:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2a673c48-37dd-4b54-a3b4-4c4f1eb8d1ff tempest-TestInstancesWithCinderVolumes-1584482579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:29:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2a673c48-37dd-4b54-a3b4-4c4f1eb8d1ff tempest-TestInstancesWithCinderVolumes-1584482579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:29:39 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2a673c48-37dd-4b54-a3b4-4c4f1eb8d1ff tempest-TestInstancesWithCinderVolumes-1584482579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1510042844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24061528-da9f-4b35-abc7-63fcb9272923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c7556ff11374960adc5d8b86e5a55a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:29:39Z,use_quota=True,user_id='b960ea4402fc4c4ea158d9c2eec6fd1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e6310c8-9091-4606-84c3-2c29ba3667c8),volume_type_id=1e6310c8-9091-4606-84c3-2c29ba3667c8)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:29:39 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-2a673c48-37dd-4b54-a3b4-4c4f1eb8d1ff tempest-TestInstancesWithCinderVolumes-1584482579 None] Creating volume 24061528-da9f-4b35-abc7-63fcb9272923 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:29:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2a673c48-37dd-4b54-a3b4-4c4f1eb8d1ff tempest-TestInstancesWithCinderVolumes-1584482579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:29:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2a673c48-37dd-4b54-a3b4-4c4f1eb8d1ff tempest-TestInstancesWithCinderVolumes-1584482579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:29:39 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2a673c48-37dd-4b54-a3b4-4c4f1eb8d1ff tempest-TestInstancesWithCinderVolumes-1584482579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:29:39 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2a673c48-37dd-4b54-a3b4-4c4f1eb8d1ff tempest-TestInstancesWithCinderVolumes-1584482579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:29:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2a673c48-37dd-4b54-a3b4-4c4f1eb8d1ff tempest-TestInstancesWithCinderVolumes-1584482579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:29:39 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2a673c48-37dd-4b54-a3b4-4c4f1eb8d1ff tempest-TestInstancesWithCinderVolumes-1584482579 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:29:39 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-2a673c48-37dd-4b54-a3b4-4c4f1eb8d1ff tempest-TestInstancesWithCinderVolumes-1584482579 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:29:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2a673c48-37dd-4b54-a3b4-4c4f1eb8d1ff tempest-TestInstancesWithCinderVolumes-1584482579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-24061528-da9f-4b35-abc7-63fcb9272923 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:39 devstack sudo[93950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-24061528-da9f-4b35-abc7-63fcb9272923 1073741824 Jul 11 04:29:39 devstack sudo[93950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:39 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-144e2e5d-f656-4646-9c78-fb2eb0bee781 tempest-GroupSnapshotsTest-1799390916 None] Acquiring lock "cinder-quobyte-59596506-64f3-4c9b-9dab-00e75bb1ddb6" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:29:39 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-01522711-6d6a-4f19-badd-1a67030cc1df tempest-TestInstancesWithCinderVolumes-1584482579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:29:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-01522711-6d6a-4f19-badd-1a67030cc1df tempest-TestInstancesWithCinderVolumes-1584482579 None] Flow 'volume_create_manager' (ff7d3a87-55d6-41b0-92a2-05cc4a3ab407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:29:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-01522711-6d6a-4f19-badd-1a67030cc1df tempest-TestInstancesWithCinderVolumes-1584482579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b56ea635-4200-482e-a8bb-8dbc33dcccd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:39 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-144e2e5d-f656-4646-9c78-fb2eb0bee781 tempest-GroupSnapshotsTest-1799390916 None] Lock "cinder-quobyte-59596506-64f3-4c9b-9dab-00e75bb1ddb6" acquired by "delete_volume" :: waited 0.109s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:29:39 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1581bb-0be4-4758-b0a7-7e834958005f]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:29:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-144e2e5d-f656-4646-9c78-fb2eb0bee781 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-01522711-6d6a-4f19-badd-1a67030cc1df tempest-TestInstancesWithCinderVolumes-1584482579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b56ea635-4200-482e-a8bb-8dbc33dcccd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-939375016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f0287ea-82f4-435e-96a5-dca064e0e7d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c7556ff11374960adc5d8b86e5a55a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:29:40Z,use_quota=True,user_id='b960ea4402fc4c4ea158d9c2eec6fd1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8c01f30-78f3-4fbe-a1f7-08c521fa78c5),volume_type_id=a8c01f30-78f3-4fbe-a1f7-08c521fa78c5)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:29:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-01522711-6d6a-4f19-badd-1a67030cc1df tempest-TestInstancesWithCinderVolumes-1584482579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f261314d-9394-4d12-8ea6-b2c0898a7be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-01522711-6d6a-4f19-badd-1a67030cc1df tempest-TestInstancesWithCinderVolumes-1584482579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f261314d-9394-4d12-8ea6-b2c0898a7be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:29:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-01522711-6d6a-4f19-badd-1a67030cc1df tempest-TestInstancesWithCinderVolumes-1584482579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b3b6e7-55e6-4eca-be23-d25f466ec08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-01522711-6d6a-4f19-badd-1a67030cc1df tempest-TestInstancesWithCinderVolumes-1584482579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b3b6e7-55e6-4eca-be23-d25f466ec08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f0287ea-82f4-435e-96a5-dca064e0e7d0', 'volume_name': 'volume-9f0287ea-82f4-435e-96a5-dca064e0e7d0', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:29:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-01522711-6d6a-4f19-badd-1a67030cc1df tempest-TestInstancesWithCinderVolumes-1584482579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aae00e4-0e87-4bb5-a199-95defa93399d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-01522711-6d6a-4f19-badd-1a67030cc1df tempest-TestInstancesWithCinderVolumes-1584482579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aae00e4-0e87-4bb5-a199-95defa93399d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:29:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-01522711-6d6a-4f19-badd-1a67030cc1df tempest-TestInstancesWithCinderVolumes-1584482579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fa22190-a3de-4edd-abff-41fdcf607e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:39 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-01522711-6d6a-4f19-badd-1a67030cc1df tempest-TestInstancesWithCinderVolumes-1584482579 None] Volume 9f0287ea-82f4-435e-96a5-dca064e0e7d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f0287ea-82f4-435e-96a5-dca064e0e7d0', 'volume_size': 1} Jul 11 04:29:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-01522711-6d6a-4f19-badd-1a67030cc1df tempest-TestInstancesWithCinderVolumes-1584482579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:29:39 devstack sudo[93952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6 Jul 11 04:29:39 devstack sudo[93952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:40 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:29:40 devstack sudo[93950]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Flow 'volume_create_manager' (1c3cef23-5bf9-4344-bd13-b859a21c4bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:29:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ef7198b-6df3-485b-9337-9f10e3992348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2a673c48-37dd-4b54-a3b4-4c4f1eb8d1ff tempest-TestInstancesWithCinderVolumes-1584482579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-24061528-da9f-4b35-abc7-63fcb9272923 1073741824" returned: 0 in 1.909s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ef7198b-6df3-485b-9337-9f10e3992348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1818099573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f61301cd-e7f6-4abe-82f4-7c87428bff50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c7556ff11374960adc5d8b86e5a55a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:29:41Z,use_quota=True,user_id='b960ea4402fc4c4ea158d9c2eec6fd1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0be72a32-fa86-45ed-ae7c-6f7f2c19ba1e),volume_type_id=0be72a32-fa86-45ed-ae7c-6f7f2c19ba1e)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:29:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0edc352f-9887-4aa7-bc04-f08114557c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0edc352f-9887-4aa7-bc04-f08114557c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:29:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461680a5-065f-435b-a4b6-b9d05eb0b14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:40 devstack cinder-volume[86964]: DEBUG cinder.image.glance [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Creating Keystone auth plugin from conf {{(pid=86964) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 04:29:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2a673c48-37dd-4b54-a3b4-4c4f1eb8d1ff tempest-TestInstancesWithCinderVolumes-1584482579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-24061528-da9f-4b35-abc7-63fcb9272923 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:41 devstack sudo[93952]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-144e2e5d-f656-4646-9c78-fb2eb0bee781 tempest-GroupSnapshotsTest-1799390916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6" returned: 0 in 1.328s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-144e2e5d-f656-4646-9c78-fb2eb0bee781 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:41 devstack sudo[93963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-24061528-da9f-4b35-abc7-63fcb9272923 Jul 11 04:29:41 devstack sudo[93963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:41 devstack sudo[93964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6 Jul 11 04:29:41 devstack sudo[93964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:41 devstack sudo[93963]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2a673c48-37dd-4b54-a3b4-4c4f1eb8d1ff tempest-TestInstancesWithCinderVolumes-1584482579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-24061528-da9f-4b35-abc7-63fcb9272923" returned: 0 in 0.798s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:41 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2a673c48-37dd-4b54-a3b4-4c4f1eb8d1ff tempest-TestInstancesWithCinderVolumes-1584482579 None] <== create_volume: return (2864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:29:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2a673c48-37dd-4b54-a3b4-4c4f1eb8d1ff tempest-TestInstancesWithCinderVolumes-1584482579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.868s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:29:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-01522711-6d6a-4f19-badd-1a67030cc1df tempest-TestInstancesWithCinderVolumes-1584482579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:29:41 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-01522711-6d6a-4f19-badd-1a67030cc1df tempest-TestInstancesWithCinderVolumes-1584482579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-939375016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f0287ea-82f4-435e-96a5-dca064e0e7d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c7556ff11374960adc5d8b86e5a55a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:29:40Z,use_quota=True,user_id='b960ea4402fc4c4ea158d9c2eec6fd1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8c01f30-78f3-4fbe-a1f7-08c521fa78c5),volume_type_id=a8c01f30-78f3-4fbe-a1f7-08c521fa78c5)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:29:41 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-01522711-6d6a-4f19-badd-1a67030cc1df tempest-TestInstancesWithCinderVolumes-1584482579 None] Creating volume 9f0287ea-82f4-435e-96a5-dca064e0e7d0 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:29:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-01522711-6d6a-4f19-badd-1a67030cc1df tempest-TestInstancesWithCinderVolumes-1584482579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:29:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-01522711-6d6a-4f19-badd-1a67030cc1df tempest-TestInstancesWithCinderVolumes-1584482579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:29:41 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-01522711-6d6a-4f19-badd-1a67030cc1df tempest-TestInstancesWithCinderVolumes-1584482579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:29:41 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-01522711-6d6a-4f19-badd-1a67030cc1df tempest-TestInstancesWithCinderVolumes-1584482579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:29:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-01522711-6d6a-4f19-badd-1a67030cc1df tempest-TestInstancesWithCinderVolumes-1584482579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:29:41 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-01522711-6d6a-4f19-badd-1a67030cc1df tempest-TestInstancesWithCinderVolumes-1584482579 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:29:41 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-01522711-6d6a-4f19-badd-1a67030cc1df tempest-TestInstancesWithCinderVolumes-1584482579 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:29:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-01522711-6d6a-4f19-badd-1a67030cc1df tempest-TestInstancesWithCinderVolumes-1584482579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f0287ea-82f4-435e-96a5-dca064e0e7d0 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:41 devstack sudo[93969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f0287ea-82f4-435e-96a5-dca064e0e7d0 1073741824 Jul 11 04:29:41 devstack sudo[93969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:41 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2a673c48-37dd-4b54-a3b4-4c4f1eb8d1ff tempest-TestInstancesWithCinderVolumes-1584482579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17b44ea5-ea8d-4172-9c64-57ee42b713f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24061528-da9f-4b35-abc7-63fcb9272923', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:29:41 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2a673c48-37dd-4b54-a3b4-4c4f1eb8d1ff tempest-TestInstancesWithCinderVolumes-1584482579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc0f97fd-d10b-40de-a2af-8a2840b3f498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:41 devstack sudo[93964]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-144e2e5d-f656-4646-9c78-fb2eb0bee781 tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-59596506-64f3-4c9b-9dab-00e75bb1ddb6" returned: 0 in 0.890s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:42 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-144e2e5d-f656-4646-9c78-fb2eb0bee781 tempest-GroupSnapshotsTest-1799390916 None] Lock "cinder-quobyte-59596506-64f3-4c9b-9dab-00e75bb1ddb6" released by "delete_volume" :: held 2.324s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:29:42 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-2a673c48-37dd-4b54-a3b4-4c4f1eb8d1ff tempest-TestInstancesWithCinderVolumes-1584482579 None] Volume volume-24061528-da9f-4b35-abc7-63fcb9272923 (24061528-da9f-4b35-abc7-63fcb9272923): created successfully Jul 11 04:29:42 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2a673c48-37dd-4b54-a3b4-4c4f1eb8d1ff tempest-TestInstancesWithCinderVolumes-1584482579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc0f97fd-d10b-40de-a2af-8a2840b3f498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:29:42 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2a673c48-37dd-4b54-a3b4-4c4f1eb8d1ff tempest-TestInstancesWithCinderVolumes-1584482579 None] Flow 'volume_create_manager' (3cab8250-3f85-4d76-accb-cbbd17f407ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:29:42 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461680a5-065f-435b-a4b6-b9d05eb0b14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f61301cd-e7f6-4abe-82f4-7c87428bff50', 'volume_name': 'volume-f61301cd-e7f6-4abe-82f4-7c87428bff50', 'volume_size': 1, 'image_id': '5c04070f-f517-416f-9e5e-47e9830fed3a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5c04070f-f517-416f-9e5e-47e9830fed3a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1439806127', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c7556ff11374960adc5d8b86e5a55a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5c04070f-f517-416f-9e5e-47e9830fed3a', 'created_at': datetime.datetime(2026, 7, 11, 2, 29, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 29, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c04070f-f517-416f-9e5e-47e9830fed3a/file', 'properties': {}}, 'image_service': }' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:29:42 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a93ce8-5e14-4649-ad65-db7832c5d97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:42 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a93ce8-5e14-4649-ad65-db7832c5d97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:29:42 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bbe69f4-ed48-40d8-b773-cf0b10ebbee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:42 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Volume f61301cd-e7f6-4abe-82f4-7c87428bff50: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f61301cd-e7f6-4abe-82f4-7c87428bff50', 'volume_size': 1, 'image_id': '5c04070f-f517-416f-9e5e-47e9830fed3a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5c04070f-f517-416f-9e5e-47e9830fed3a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1439806127', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c7556ff11374960adc5d8b86e5a55a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5c04070f-f517-416f-9e5e-47e9830fed3a', 'created_at': datetime.datetime(2026, 7, 11, 2, 29, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 29, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c04070f-f517-416f-9e5e-47e9830fed3a/file', 'properties': {}}, 'image_service': } Jul 11 04:29:42 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Trying to clone f61301cd-e7f6-4abe-82f4-7c87428bff50 from image 5c04070f-f517-416f-9e5e-47e9830fed3a at location (None, [{'url': 'file:///opt/stack/data/glance/images/5c04070f-f517-416f-9e5e-47e9830fed3a', 'metadata': {}}]). {{(pid=86964) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 04:29:42 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-2a673c48-37dd-4b54-a3b4-4c4f1eb8d1ff tempest-TestInstancesWithCinderVolumes-1584482579 None] Created volume successfully. Jul 11 04:29:42 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-144e2e5d-f656-4646-9c78-fb2eb0bee781 tempest-GroupSnapshotsTest-1799390916 None] Created reservations ['420d369d-c43c-4297-9865-ceab66178d45'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:29:42 devstack cinder-volume[86964]: WARNING cinder.db.api [None req-144e2e5d-f656-4646-9c78-fb2eb0bee781 tempest-GroupSnapshotsTest-1799390916 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-237315024'] Jul 11 04:29:42 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-144e2e5d-f656-4646-9c78-fb2eb0bee781 tempest-GroupSnapshotsTest-1799390916 None] Created reservations ['7cc278c8-3197-468a-b17f-d2745fe44607', '246a9e09-e5ab-4dcf-b81e-6505426664ab', 'f0f44d5c-bea5-4b09-987f-55b4604934d9', '516fc7d4-e406-46ef-8981-d89bef4b7430'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:29:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-144e2e5d-f656-4646-9c78-fb2eb0bee781 tempest-GroupSnapshotsTest-1799390916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:29:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-144e2e5d-f656-4646-9c78-fb2eb0bee781 tempest-GroupSnapshotsTest-1799390916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:29:42 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-144e2e5d-f656-4646-9c78-fb2eb0bee781 tempest-GroupSnapshotsTest-1799390916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:29:42 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-144e2e5d-f656-4646-9c78-fb2eb0bee781 tempest-GroupSnapshotsTest-1799390916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:29:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-144e2e5d-f656-4646-9c78-fb2eb0bee781 tempest-GroupSnapshotsTest-1799390916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:29:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-144e2e5d-f656-4646-9c78-fb2eb0bee781 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:42 devstack sudo[93991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:29:42 devstack sudo[93991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:43 devstack sudo[93969]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-01522711-6d6a-4f19-badd-1a67030cc1df tempest-TestInstancesWithCinderVolumes-1584482579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f0287ea-82f4-435e-96a5-dca064e0e7d0 1073741824" returned: 0 in 1.379s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-01522711-6d6a-4f19-badd-1a67030cc1df tempest-TestInstancesWithCinderVolumes-1584482579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f0287ea-82f4-435e-96a5-dca064e0e7d0 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:43 devstack sudo[93997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f0287ea-82f4-435e-96a5-dca064e0e7d0 Jul 11 04:29:43 devstack sudo[93997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:43 devstack sudo[93991]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-144e2e5d-f656-4646-9c78-fb2eb0bee781 tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.900s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:43 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-144e2e5d-f656-4646-9c78-fb2eb0bee781 tempest-GroupSnapshotsTest-1799390916 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:29:43 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-144e2e5d-f656-4646-9c78-fb2eb0bee781 tempest-GroupSnapshotsTest-1799390916 None] Delete group completed successfully. Jul 11 04:29:44 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-bfe1fa61-15d8-44c6-bd1f-e2914a93be6e tempest-GroupSnapshotsTest-1799390916 None] Group tempest-GroupSnapshotsTest-Group-1951701012: creating Jul 11 04:29:44 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-bfe1fa61-15d8-44c6-bd1f-e2914a93be6e tempest-GroupSnapshotsTest-1799390916 None] Group tempest-GroupSnapshotsTest-Group-1951701012: created successfully Jul 11 04:29:44 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-bfe1fa61-15d8-44c6-bd1f-e2914a93be6e tempest-GroupSnapshotsTest-1799390916 None] Create group completed successfully. Jul 11 04:29:44 devstack sudo[93997]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-01522711-6d6a-4f19-badd-1a67030cc1df tempest-TestInstancesWithCinderVolumes-1584482579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f0287ea-82f4-435e-96a5-dca064e0e7d0" returned: 0 in 1.192s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:44 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-01522711-6d6a-4f19-badd-1a67030cc1df tempest-TestInstancesWithCinderVolumes-1584482579 None] <== create_volume: return (2633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:29:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-01522711-6d6a-4f19-badd-1a67030cc1df tempest-TestInstancesWithCinderVolumes-1584482579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.641s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:29:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-01522711-6d6a-4f19-badd-1a67030cc1df tempest-TestInstancesWithCinderVolumes-1584482579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fa22190-a3de-4edd-abff-41fdcf607e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f0287ea-82f4-435e-96a5-dca064e0e7d0', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:29:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-01522711-6d6a-4f19-badd-1a67030cc1df tempest-TestInstancesWithCinderVolumes-1584482579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fb81084-4e04-48fd-a8d2-9e31c52f1e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:44 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-01522711-6d6a-4f19-badd-1a67030cc1df tempest-TestInstancesWithCinderVolumes-1584482579 None] Volume volume-9f0287ea-82f4-435e-96a5-dca064e0e7d0 (9f0287ea-82f4-435e-96a5-dca064e0e7d0): created successfully Jul 11 04:29:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-01522711-6d6a-4f19-badd-1a67030cc1df tempest-TestInstancesWithCinderVolumes-1584482579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fb81084-4e04-48fd-a8d2-9e31c52f1e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:29:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-01522711-6d6a-4f19-badd-1a67030cc1df tempest-TestInstancesWithCinderVolumes-1584482579 None] Flow 'volume_create_manager' (ff7d3a87-55d6-41b0-92a2-05cc4a3ab407) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:29:44 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-01522711-6d6a-4f19-badd-1a67030cc1df tempest-TestInstancesWithCinderVolumes-1584482579 None] Created volume successfully. Jul 11 04:29:46 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4763784-b098-490a-953f-0e7fb913b9b0 tempest-GroupSnapshotsTest-1799390916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:29:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b4763784-b098-490a-953f-0e7fb913b9b0 tempest-GroupSnapshotsTest-1799390916 None] Flow 'volume_create_manager' (16f02eed-fbf2-4a7a-85de-7c20209335af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:29:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b4763784-b098-490a-953f-0e7fb913b9b0 tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8102b2d2-3415-4f9c-9fcc-0de37e3edf6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b4763784-b098-490a-953f-0e7fb913b9b0 tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8102b2d2-3415-4f9c-9fcc-0de37e3edf6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1686132942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5d20930d-7536-41d6-9776-50e6df74f5d6,host='devstack@QuobyteHD#QuobyteHD',id=f793694e-fa0c-4d9c-a05b-688d5b064b12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58be74b0ee43492bb1037c8c48daf403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:29:46Z,use_quota=True,user_id='a6072455344c4e1b88ff5a6efb3f2113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a336d00-4058-400b-bc7e-f51398e1455c),volume_type_id=3a336d00-4058-400b-bc7e-f51398e1455c)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:29:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b4763784-b098-490a-953f-0e7fb913b9b0 tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c9e3cb4-1310-4b41-a6ae-8ffc2bac8178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b4763784-b098-490a-953f-0e7fb913b9b0 tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c9e3cb4-1310-4b41-a6ae-8ffc2bac8178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:29:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b4763784-b098-490a-953f-0e7fb913b9b0 tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a18c75f2-13f3-498d-8176-63090b8ae208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b4763784-b098-490a-953f-0e7fb913b9b0 tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a18c75f2-13f3-498d-8176-63090b8ae208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f793694e-fa0c-4d9c-a05b-688d5b064b12', 'volume_name': 'volume-f793694e-fa0c-4d9c-a05b-688d5b064b12', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:29:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b4763784-b098-490a-953f-0e7fb913b9b0 tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ff7032f-14a7-47e4-8323-6ec29fd190bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b4763784-b098-490a-953f-0e7fb913b9b0 tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ff7032f-14a7-47e4-8323-6ec29fd190bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:29:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b4763784-b098-490a-953f-0e7fb913b9b0 tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32cf8bb1-2d64-4cc9-8f53-7e1b0d99f203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:46 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-b4763784-b098-490a-953f-0e7fb913b9b0 tempest-GroupSnapshotsTest-1799390916 None] Volume f793694e-fa0c-4d9c-a05b-688d5b064b12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f793694e-fa0c-4d9c-a05b-688d5b064b12', 'volume_size': 1} Jul 11 04:29:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b4763784-b098-490a-953f-0e7fb913b9b0 tempest-GroupSnapshotsTest-1799390916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:29:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b4763784-b098-490a-953f-0e7fb913b9b0 tempest-GroupSnapshotsTest-1799390916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:29:46 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b4763784-b098-490a-953f-0e7fb913b9b0 tempest-GroupSnapshotsTest-1799390916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5d20930d-7536-41d6-9776-50e6df74f5d6,created_at=2026-07-11T02:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1686132942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5d20930d-7536-41d6-9776-50e6df74f5d6,host='devstack@QuobyteHD#QuobyteHD',id=f793694e-fa0c-4d9c-a05b-688d5b064b12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58be74b0ee43492bb1037c8c48daf403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:29:46Z,use_quota=True,user_id='a6072455344c4e1b88ff5a6efb3f2113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a336d00-4058-400b-bc7e-f51398e1455c),volume_type_id=3a336d00-4058-400b-bc7e-f51398e1455c)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:29:46 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-b4763784-b098-490a-953f-0e7fb913b9b0 tempest-GroupSnapshotsTest-1799390916 None] Creating volume f793694e-fa0c-4d9c-a05b-688d5b064b12 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:29:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b4763784-b098-490a-953f-0e7fb913b9b0 tempest-GroupSnapshotsTest-1799390916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:29:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b4763784-b098-490a-953f-0e7fb913b9b0 tempest-GroupSnapshotsTest-1799390916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:29:46 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b4763784-b098-490a-953f-0e7fb913b9b0 tempest-GroupSnapshotsTest-1799390916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:29:46 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b4763784-b098-490a-953f-0e7fb913b9b0 tempest-GroupSnapshotsTest-1799390916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:29:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b4763784-b098-490a-953f-0e7fb913b9b0 tempest-GroupSnapshotsTest-1799390916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:29:46 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b4763784-b098-490a-953f-0e7fb913b9b0 tempest-GroupSnapshotsTest-1799390916 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:29:46 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-b4763784-b098-490a-953f-0e7fb913b9b0 tempest-GroupSnapshotsTest-1799390916 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:29:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b4763784-b098-490a-953f-0e7fb913b9b0 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:46 devstack sudo[94004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12 1073741824 Jul 11 04:29:46 devstack sudo[94004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:47 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5c04070f-f517-416f-9e5e-47e9830fed3a_pp3c1x1edevstack@QuobyteHD, size 20.69 MB, duration 5.15 sec {{(pid=86964) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 11 04:29:47 devstack cinder-volume[86964]: INFO cinder.image.image_utils [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Image download 20.69 MB at 4.02 MB/s Jul 11 04:29:47 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6126aa-5bed-411d-8103-333ad9cee80a]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:29:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c04070f-f517-416f-9e5e-47e9830fed3a_pp3c1x1edevstack@QuobyteHD {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:47 devstack sudo[94010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c04070f-f517-416f-9e5e-47e9830fed3a_pp3c1x1edevstack@QuobyteHD Jul 11 04:29:47 devstack sudo[94010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:47 devstack sudo[94004]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b4763784-b098-490a-953f-0e7fb913b9b0 tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12 1073741824" returned: 0 in 1.508s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b4763784-b098-490a-953f-0e7fb913b9b0 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:48 devstack sudo[94012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12 Jul 11 04:29:48 devstack sudo[94012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:48 devstack sudo[94010]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c04070f-f517-416f-9e5e-47e9830fed3a_pp3c1x1edevstack@QuobyteHD" returned: 0 in 1.132s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:48 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Temporary image 5c04070f-f517-416f-9e5e-47e9830fed3a is fetched for user b960ea4402fc4c4ea158d9c2eec6fd1a. {{(pid=86964) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 11 04:29:48 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa484248-3d37-4f96-8b8f-cb734accc70e]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:29:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c04070f-f517-416f-9e5e-47e9830fed3a_pp3c1x1edevstack@QuobyteHD {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:48 devstack sudo[94017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c04070f-f517-416f-9e5e-47e9830fed3a_pp3c1x1edevstack@QuobyteHD Jul 11 04:29:48 devstack sudo[94017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:48 devstack sudo[94012]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b4763784-b098-490a-953f-0e7fb913b9b0 tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12" returned: 0 in 0.830s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:48 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b4763784-b098-490a-953f-0e7fb913b9b0 tempest-GroupSnapshotsTest-1799390916 None] <== create_volume: return (2430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:29:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b4763784-b098-490a-953f-0e7fb913b9b0 tempest-GroupSnapshotsTest-1799390916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.433s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:29:48 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b4763784-b098-490a-953f-0e7fb913b9b0 tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32cf8bb1-2d64-4cc9-8f53-7e1b0d99f203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f793694e-fa0c-4d9c-a05b-688d5b064b12', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:29:48 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b4763784-b098-490a-953f-0e7fb913b9b0 tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f3426f9-34be-4906-9762-854507f473c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:48 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-b4763784-b098-490a-953f-0e7fb913b9b0 tempest-GroupSnapshotsTest-1799390916 None] Volume volume-f793694e-fa0c-4d9c-a05b-688d5b064b12 (f793694e-fa0c-4d9c-a05b-688d5b064b12): created successfully Jul 11 04:29:48 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b4763784-b098-490a-953f-0e7fb913b9b0 tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f3426f9-34be-4906-9762-854507f473c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:29:48 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b4763784-b098-490a-953f-0e7fb913b9b0 tempest-GroupSnapshotsTest-1799390916 None] Flow 'volume_create_manager' (16f02eed-fbf2-4a7a-85de-7c20209335af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:29:48 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-b4763784-b098-490a-953f-0e7fb913b9b0 tempest-GroupSnapshotsTest-1799390916 None] Created volume successfully. Jul 11 04:29:49 devstack sudo[94017]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c04070f-f517-416f-9e5e-47e9830fed3a_pp3c1x1edevstack@QuobyteHD" returned: 0 in 0.901s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:29:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:29:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1818099573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f61301cd-e7f6-4abe-82f4-7c87428bff50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c7556ff11374960adc5d8b86e5a55a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:29:41Z,use_quota=True,user_id='b960ea4402fc4c4ea158d9c2eec6fd1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0be72a32-fa86-45ed-ae7c-6f7f2c19ba1e),volume_type_id=0be72a32-fa86-45ed-ae7c-6f7f2c19ba1e)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:29:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Creating volume f61301cd-e7f6-4abe-82f4-7c87428bff50 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:29:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:29:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:29:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:29:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:29:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:29:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:29:49 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:29:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f61301cd-e7f6-4abe-82f4-7c87428bff50 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:49 devstack sudo[94037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f61301cd-e7f6-4abe-82f4-7c87428bff50 1073741824 Jul 11 04:29:49 devstack sudo[94037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:50 devstack sudo[94037]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f61301cd-e7f6-4abe-82f4-7c87428bff50 1073741824" returned: 0 in 1.130s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f61301cd-e7f6-4abe-82f4-7c87428bff50 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:50 devstack sudo[94056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f61301cd-e7f6-4abe-82f4-7c87428bff50 Jul 11 04:29:50 devstack sudo[94056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:51 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-71fe643d-3220-4f2b-bf63-729a8776061d tempest-GroupSnapshotsTest-1799390916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:29:51 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-71fe643d-3220-4f2b-bf63-729a8776061d tempest-GroupSnapshotsTest-1799390916 None] Flow 'volume_create_manager' (8a101764-f6e1-415b-bd4a-c4cb95162ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:29:51 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-71fe643d-3220-4f2b-bf63-729a8776061d tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dead293-3542-4168-a217-a1eed0b99e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:51 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-71fe643d-3220-4f2b-bf63-729a8776061d tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dead293-3542-4168-a217-a1eed0b99e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-133537851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5d20930d-7536-41d6-9776-50e6df74f5d6,host='devstack@QuobyteHD#QuobyteHD',id=86f55b9e-0b07-437f-811d-a30822ab8273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58be74b0ee43492bb1037c8c48daf403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:29:51Z,use_quota=True,user_id='a6072455344c4e1b88ff5a6efb3f2113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a336d00-4058-400b-bc7e-f51398e1455c),volume_type_id=3a336d00-4058-400b-bc7e-f51398e1455c)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:29:51 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-71fe643d-3220-4f2b-bf63-729a8776061d tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be329059-7784-46fb-9169-96875dabdf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:51 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-71fe643d-3220-4f2b-bf63-729a8776061d tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be329059-7784-46fb-9169-96875dabdf16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:29:51 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-71fe643d-3220-4f2b-bf63-729a8776061d tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0293393-f11b-409c-bcbb-239ab874680f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:51 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-71fe643d-3220-4f2b-bf63-729a8776061d tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0293393-f11b-409c-bcbb-239ab874680f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86f55b9e-0b07-437f-811d-a30822ab8273', 'volume_name': 'volume-86f55b9e-0b07-437f-811d-a30822ab8273', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:29:51 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-71fe643d-3220-4f2b-bf63-729a8776061d tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3915ee05-7e65-49b9-8347-32edf9f0820a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:51 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-71fe643d-3220-4f2b-bf63-729a8776061d tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3915ee05-7e65-49b9-8347-32edf9f0820a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:29:51 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-71fe643d-3220-4f2b-bf63-729a8776061d tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1528e7b0-6d33-4b23-bdc2-2813a5a2fd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:51 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-71fe643d-3220-4f2b-bf63-729a8776061d tempest-GroupSnapshotsTest-1799390916 None] Volume 86f55b9e-0b07-437f-811d-a30822ab8273: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86f55b9e-0b07-437f-811d-a30822ab8273', 'volume_size': 1} Jul 11 04:29:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-71fe643d-3220-4f2b-bf63-729a8776061d tempest-GroupSnapshotsTest-1799390916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:29:51 devstack sudo[94056]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f61301cd-e7f6-4abe-82f4-7c87428bff50" returned: 0 in 0.866s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:51 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] <== create_volume: return (2078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:29:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.082s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:29:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-71fe643d-3220-4f2b-bf63-729a8776061d tempest-GroupSnapshotsTest-1799390916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.230s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:29:51 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-71fe643d-3220-4f2b-bf63-729a8776061d tempest-GroupSnapshotsTest-1799390916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5d20930d-7536-41d6-9776-50e6df74f5d6,created_at=2026-07-11T02:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-133537851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5d20930d-7536-41d6-9776-50e6df74f5d6,host='devstack@QuobyteHD#QuobyteHD',id=86f55b9e-0b07-437f-811d-a30822ab8273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58be74b0ee43492bb1037c8c48daf403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:29:51Z,use_quota=True,user_id='a6072455344c4e1b88ff5a6efb3f2113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a336d00-4058-400b-bc7e-f51398e1455c),volume_type_id=3a336d00-4058-400b-bc7e-f51398e1455c)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:29:51 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-71fe643d-3220-4f2b-bf63-729a8776061d tempest-GroupSnapshotsTest-1799390916 None] Creating volume 86f55b9e-0b07-437f-811d-a30822ab8273 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:29:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-71fe643d-3220-4f2b-bf63-729a8776061d tempest-GroupSnapshotsTest-1799390916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:29:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-71fe643d-3220-4f2b-bf63-729a8776061d tempest-GroupSnapshotsTest-1799390916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:29:51 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-71fe643d-3220-4f2b-bf63-729a8776061d tempest-GroupSnapshotsTest-1799390916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:29:51 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-71fe643d-3220-4f2b-bf63-729a8776061d tempest-GroupSnapshotsTest-1799390916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:29:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-71fe643d-3220-4f2b-bf63-729a8776061d tempest-GroupSnapshotsTest-1799390916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:29:51 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-71fe643d-3220-4f2b-bf63-729a8776061d tempest-GroupSnapshotsTest-1799390916 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:29:51 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-71fe643d-3220-4f2b-bf63-729a8776061d tempest-GroupSnapshotsTest-1799390916 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:29:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-71fe643d-3220-4f2b-bf63-729a8776061d tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:51 devstack sudo[94062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273 1073741824 Jul 11 04:29:51 devstack sudo[94062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:51 devstack cinder-volume[86964]: DEBUG cinder.volume.volume_utils [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Attempting download of 5c04070f-f517-416f-9e5e-47e9830fed3a ((None, [{'url': 'file:///opt/stack/data/glance/images/5c04070f-f517-416f-9e5e-47e9830fed3a', 'metadata': {}}])) to volume f61301cd-e7f6-4abe-82f4-7c87428bff50. {{(pid=86964) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 04:29:51 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e76ef84-3f65-46b0-a008-47180201882e]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:29:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5c04070f-f517-416f-9e5e-47e9830fed3a_0nu9y6yf {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:51 devstack sudo[94064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5c04070f-f517-416f-9e5e-47e9830fed3a_0nu9y6yf Jul 11 04:29:51 devstack sudo[94064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:52 devstack sudo[94064]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5c04070f-f517-416f-9e5e-47e9830fed3a_0nu9y6yf" returned: 0 in 0.862s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5c04070f-f517-416f-9e5e-47e9830fed3a_0nu9y6yf {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:52 devstack sudo[94076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5c04070f-f517-416f-9e5e-47e9830fed3a_0nu9y6yf Jul 11 04:29:52 devstack sudo[94076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:52 devstack sudo[94062]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-71fe643d-3220-4f2b-bf63-729a8776061d tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273 1073741824" returned: 0 in 1.225s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-71fe643d-3220-4f2b-bf63-729a8776061d tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:52 devstack sudo[94078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273 Jul 11 04:29:52 devstack sudo[94078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:53 devstack sudo[94076]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5c04070f-f517-416f-9e5e-47e9830fed3a_0nu9y6yf" returned: 1 in 0.943s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5c04070f-f517-416f-9e5e-47e9830fed3a_0nu9y6yf' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:29:53 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[401d256e-2eec-4891-9200-96e55ba8901b]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:29:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c04070f-f517-416f-9e5e-47e9830fed3a_pp3c1x1edevstack@QuobyteHD {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:53 devstack sudo[94078]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-71fe643d-3220-4f2b-bf63-729a8776061d tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273" returned: 0 in 0.764s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:53 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-71fe643d-3220-4f2b-bf63-729a8776061d tempest-GroupSnapshotsTest-1799390916 None] <== create_volume: return (2051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:29:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-71fe643d-3220-4f2b-bf63-729a8776061d tempest-GroupSnapshotsTest-1799390916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.053s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:29:53 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-71fe643d-3220-4f2b-bf63-729a8776061d tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1528e7b0-6d33-4b23-bdc2-2813a5a2fd47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86f55b9e-0b07-437f-811d-a30822ab8273', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:29:53 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-71fe643d-3220-4f2b-bf63-729a8776061d tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af03b9e6-353b-49f6-aa16-255f55173728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:29:53 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-71fe643d-3220-4f2b-bf63-729a8776061d tempest-GroupSnapshotsTest-1799390916 None] Volume volume-86f55b9e-0b07-437f-811d-a30822ab8273 (86f55b9e-0b07-437f-811d-a30822ab8273): created successfully Jul 11 04:29:53 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-71fe643d-3220-4f2b-bf63-729a8776061d tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af03b9e6-353b-49f6-aa16-255f55173728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:29:53 devstack sudo[94083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c04070f-f517-416f-9e5e-47e9830fed3a_pp3c1x1edevstack@QuobyteHD Jul 11 04:29:53 devstack sudo[94083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:53 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-71fe643d-3220-4f2b-bf63-729a8776061d tempest-GroupSnapshotsTest-1799390916 None] Flow 'volume_create_manager' (8a101764-f6e1-415b-bd4a-c4cb95162ea7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:29:53 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-71fe643d-3220-4f2b-bf63-729a8776061d tempest-GroupSnapshotsTest-1799390916 None] Created volume successfully. Jul 11 04:29:54 devstack sudo[94083]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c04070f-f517-416f-9e5e-47e9830fed3a_pp3c1x1edevstack@QuobyteHD" returned: 0 in 1.165s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:54 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] 5c04070f-f517-416f-9e5e-47e9830fed3a was qcow2, converting to raw {{(pid=86964) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 11 04:29:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5c04070f-f517-416f-9e5e-47e9830fed3a_pp3c1x1edevstack@QuobyteHD /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f61301cd-e7f6-4abe-82f4-7c87428bff50 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:54 devstack sudo[94118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5c04070f-f517-416f-9e5e-47e9830fed3a_pp3c1x1edevstack@QuobyteHD /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f61301cd-e7f6-4abe-82f4-7c87428bff50 Jul 11 04:29:54 devstack sudo[94118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:55 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-99c0a926-e9fb-4b49-bd73-644dd43455f0 tempest-GroupSnapshotsTest-1799390916 None] Update group completed successfully. Jul 11 04:29:56 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-f966ac56-4acf-4ef5-aa72-d6bdd54c4c6e tempest-GroupSnapshotsTest-1799390916 None] Update group completed successfully. Jul 11 04:29:57 devstack sudo[94118]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5c04070f-f517-416f-9e5e-47e9830fed3a_pp3c1x1edevstack@QuobyteHD /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f61301cd-e7f6-4abe-82f4-7c87428bff50" returned: 0 in 2.978s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:57 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5c04070f-f517-416f-9e5e-47e9830fed3a_pp3c1x1edevstack@QuobyteHD, size 112.00 MB, duration 2.98 sec, destination /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f61301cd-e7f6-4abe-82f4-7c87428bff50 {{(pid=86964) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 04:29:57 devstack cinder-volume[86964]: INFO cinder.image.image_utils [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Converted 112.00 MB image at 37.60 MB/s Jul 11 04:29:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f61301cd-e7f6-4abe-82f4-7c87428bff50 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:57 devstack sudo[94166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f61301cd-e7f6-4abe-82f4-7c87428bff50 1G Jul 11 04:29:57 devstack sudo[94166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:58 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-82097f78-7485-465a-9a25-377a6bb8567c tempest-GroupSnapshotsTest-1799390916 None] Update group completed successfully. Jul 11 04:29:58 devstack sudo[94166]: pam_unix(sudo:session): session closed for user root Jul 11 04:29:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f61301cd-e7f6-4abe-82f4-7c87428bff50 1G" returned: 0 in 1.179s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:29:58 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9fa61b-cdd2-4dde-8212-994ed811c2f9]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:29:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f61301cd-e7f6-4abe-82f4-7c87428bff50 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:59 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:29:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:29:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:29:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:29:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:29:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:29:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:29:59 devstack sudo[94172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f61301cd-e7f6-4abe-82f4-7c87428bff50 Jul 11 04:29:59 devstack sudo[94172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:59 devstack sudo[94174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:29:59 devstack sudo[94174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:29:59 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-eaa5d81f-e248-4163-b643-e1610c229a9d tempest-GroupSnapshotsTest-1799390916 None] Update group completed successfully. Jul 11 04:30:00 devstack sudo[94172]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f61301cd-e7f6-4abe-82f4-7c87428bff50" returned: 0 in 1.209s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f61301cd-e7f6-4abe-82f4-7c87428bff50 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:00 devstack sudo[94174]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 1.142s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:00 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:30:00 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager._thread_info {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:30:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread count: 28 {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:30:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread info: [<_MainThread(MainThread, started 124675027595392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:30:00 devstack sudo[94182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f61301cd-e7f6-4abe-82f4-7c87428bff50 Jul 11 04:30:00 devstack sudo[94182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:01 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-fb85e533-1101-47bb-bc88-c61a7f689376 tempest-GroupSnapshotsTest-1799390916 None] GroupSnapshot bcbbee4d-9c8d-4e1e-ae5a-87838752b90d: creating. Jul 11 04:30:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fb85e533-1101-47bb-bc88-c61a7f689376 tempest-GroupSnapshotsTest-1799390916 None] Group snapshot bcbbee4d-9c8d-4e1e-ae5a-87838752b90d: creating. {{(pid=86964) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 11 04:30:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fb85e533-1101-47bb-bc88-c61a7f689376 tempest-GroupSnapshotsTest-1799390916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:30:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fb85e533-1101-47bb-bc88-c61a7f689376 tempest-GroupSnapshotsTest-1799390916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:30:01 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-fb85e533-1101-47bb-bc88-c61a7f689376 tempest-GroupSnapshotsTest-1799390916 None] Creating offline snapshot 1198237a-3bea-408b-a4c2-8c2a96d3f50a of volume f793694e-fa0c-4d9c-a05b-688d5b064b12 {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:30:01 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e5b6c7-fefd-4e64-a263-2f966d8f83a0]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:30:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb85e533-1101-47bb-bc88-c61a7f689376 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:01 devstack sudo[94182]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f61301cd-e7f6-4abe-82f4-7c87428bff50" returned: 1 in 1.150s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f61301cd-e7f6-4abe-82f4-7c87428bff50' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:30:01 devstack cinder-volume[86964]: DEBUG cinder.volume.volume_utils [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Downloaded image 5c04070f-f517-416f-9e5e-47e9830fed3a ((None, [{'url': 'file:///opt/stack/data/glance/images/5c04070f-f517-416f-9e5e-47e9830fed3a', 'metadata': {}}])) to volume f61301cd-e7f6-4abe-82f4-7c87428bff50 successfully. {{(pid=86964) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 04:30:01 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Temporary image 5c04070f-f517-416f-9e5e-47e9830fed3a for user b960ea4402fc4c4ea158d9c2eec6fd1a is deleted. {{(pid=86964) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 11 04:30:01 devstack cinder-volume[86964]: DEBUG cinder.volume.volume_utils [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Marking volume f61301cd-e7f6-4abe-82f4-7c87428bff50 as bootable. {{(pid=86964) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 04:30:01 devstack sudo[94225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12 Jul 11 04:30:01 devstack sudo[94225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:01 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Copying metadata from image 5c04070f-f517-416f-9e5e-47e9830fed3a to f61301cd-e7f6-4abe-82f4-7c87428bff50. {{(pid=86964) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 04:30:01 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Creating volume glance metadata for volume f61301cd-e7f6-4abe-82f4-7c87428bff50 backed by image 5c04070f-f517-416f-9e5e-47e9830fed3a with: {'image_id': '5c04070f-f517-416f-9e5e-47e9830fed3a', 'image_name': 'tempest-scenario-img--1439806127', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86964) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 04:30:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bbe69f4-ed48-40d8-b773-cf0b10ebbee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f61301cd-e7f6-4abe-82f4-7c87428bff50', 'volume_size': 1, 'image_id': '5c04070f-f517-416f-9e5e-47e9830fed3a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5c04070f-f517-416f-9e5e-47e9830fed3a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1439806127', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c7556ff11374960adc5d8b86e5a55a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5c04070f-f517-416f-9e5e-47e9830fed3a', 'created_at': datetime.datetime(2026, 7, 11, 2, 29, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 29, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c04070f-f517-416f-9e5e-47e9830fed3a/file', 'properties': {}}, 'image_service': }' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:30:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8f8cb5b-b801-474f-9d69-75b6849378e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:30:01 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Volume volume-f61301cd-e7f6-4abe-82f4-7c87428bff50 (f61301cd-e7f6-4abe-82f4-7c87428bff50): created successfully Jul 11 04:30:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8f8cb5b-b801-474f-9d69-75b6849378e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:30:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Flow 'volume_create_manager' (1c3cef23-5bf9-4344-bd13-b859a21c4bb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:30:01 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-18c66b53-cfcd-4701-a50e-a374ef10fa3b tempest-TestInstancesWithCinderVolumes-1584482579 None] Created volume successfully. Jul 11 04:30:02 devstack sudo[94225]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb85e533-1101-47bb-bc88-c61a7f689376 tempest-GroupSnapshotsTest-1799390916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12" returned: 0 in 1.178s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb85e533-1101-47bb-bc88-c61a7f689376 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12.1198237a-3bea-408b-a4c2-8c2a96d3f50a 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:02 devstack sudo[94234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12.1198237a-3bea-408b-a4c2-8c2a96d3f50a 1G Jul 11 04:30:02 devstack sudo[94234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:03 devstack sudo[94234]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb85e533-1101-47bb-bc88-c61a7f689376 tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12.1198237a-3bea-408b-a4c2-8c2a96d3f50a 1G" returned: 0 in 1.152s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb85e533-1101-47bb-bc88-c61a7f689376 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f793694e-fa0c-4d9c-a05b-688d5b064b12 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12.1198237a-3bea-408b-a4c2-8c2a96d3f50a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:03 devstack sudo[94244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f793694e-fa0c-4d9c-a05b-688d5b064b12 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12.1198237a-3bea-408b-a4c2-8c2a96d3f50a Jul 11 04:30:03 devstack sudo[94244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:04 devstack sudo[94244]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb85e533-1101-47bb-bc88-c61a7f689376 tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f793694e-fa0c-4d9c-a05b-688d5b064b12 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12.1198237a-3bea-408b-a4c2-8c2a96d3f50a" returned: 0 in 0.773s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:04 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-fb85e533-1101-47bb-bc88-c61a7f689376 tempest-GroupSnapshotsTest-1799390916 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12.1198237a-3bea-408b-a4c2-8c2a96d3f50a is being set with open permissions: ugo+rw: NotImplementedError Jul 11 04:30:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb85e533-1101-47bb-bc88-c61a7f689376 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12.1198237a-3bea-408b-a4c2-8c2a96d3f50a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:04 devstack sudo[94250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12.1198237a-3bea-408b-a4c2-8c2a96d3f50a Jul 11 04:30:04 devstack sudo[94250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:05 devstack sudo[94250]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb85e533-1101-47bb-bc88-c61a7f689376 tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12.1198237a-3bea-408b-a4c2-8c2a96d3f50a" returned: 0 in 0.706s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb85e533-1101-47bb-bc88-c61a7f689376 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:05 devstack sudo[94253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12.info Jul 11 04:30:05 devstack sudo[94253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:05 devstack sudo[94253]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb85e533-1101-47bb-bc88-c61a7f689376 tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12.info" returned: 0 in 0.753s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:05 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-fb85e533-1101-47bb-bc88-c61a7f689376 tempest-GroupSnapshotsTest-1799390916 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12.info is being set with open permissions: ugo+rw: NotImplementedError Jul 11 04:30:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb85e533-1101-47bb-bc88-c61a7f689376 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:05 devstack sudo[94257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12.info Jul 11 04:30:05 devstack sudo[94257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:06 devstack sudo[94257]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb85e533-1101-47bb-bc88-c61a7f689376 tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12.info" returned: 0 in 0.872s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fb85e533-1101-47bb-bc88-c61a7f689376 tempest-GroupSnapshotsTest-1799390916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.558s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:30:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fb85e533-1101-47bb-bc88-c61a7f689376 tempest-GroupSnapshotsTest-1799390916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:30:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fb85e533-1101-47bb-bc88-c61a7f689376 tempest-GroupSnapshotsTest-1799390916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:30:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-fb85e533-1101-47bb-bc88-c61a7f689376 tempest-GroupSnapshotsTest-1799390916 None] Creating offline snapshot d37d8e4a-61c8-49db-8fc4-859b92fbff61 of volume 86f55b9e-0b07-437f-811d-a30822ab8273 {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:30:06 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31c9a8d-210f-49eb-b139-a08cb13be99f]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:30:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb85e533-1101-47bb-bc88-c61a7f689376 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:06 devstack sudo[94260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273 Jul 11 04:30:06 devstack sudo[94260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:07 devstack sudo[94260]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb85e533-1101-47bb-bc88-c61a7f689376 tempest-GroupSnapshotsTest-1799390916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273" returned: 0 in 0.943s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb85e533-1101-47bb-bc88-c61a7f689376 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273.d37d8e4a-61c8-49db-8fc4-859b92fbff61 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:07 devstack sudo[94266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273.d37d8e4a-61c8-49db-8fc4-859b92fbff61 1G Jul 11 04:30:07 devstack sudo[94266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:09 devstack sudo[94266]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb85e533-1101-47bb-bc88-c61a7f689376 tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273.d37d8e4a-61c8-49db-8fc4-859b92fbff61 1G" returned: 0 in 1.552s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb85e533-1101-47bb-bc88-c61a7f689376 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86f55b9e-0b07-437f-811d-a30822ab8273 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273.d37d8e4a-61c8-49db-8fc4-859b92fbff61 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:09 devstack sudo[94290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86f55b9e-0b07-437f-811d-a30822ab8273 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273.d37d8e4a-61c8-49db-8fc4-859b92fbff61 Jul 11 04:30:09 devstack sudo[94290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:10 devstack sudo[94290]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb85e533-1101-47bb-bc88-c61a7f689376 tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86f55b9e-0b07-437f-811d-a30822ab8273 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273.d37d8e4a-61c8-49db-8fc4-859b92fbff61" returned: 0 in 1.003s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:10 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-fb85e533-1101-47bb-bc88-c61a7f689376 tempest-GroupSnapshotsTest-1799390916 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273.d37d8e4a-61c8-49db-8fc4-859b92fbff61 is being set with open permissions: ugo+rw: NotImplementedError Jul 11 04:30:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb85e533-1101-47bb-bc88-c61a7f689376 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273.d37d8e4a-61c8-49db-8fc4-859b92fbff61 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:10 devstack sudo[94299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273.d37d8e4a-61c8-49db-8fc4-859b92fbff61 Jul 11 04:30:10 devstack sudo[94299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:11 devstack sudo[94299]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb85e533-1101-47bb-bc88-c61a7f689376 tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273.d37d8e4a-61c8-49db-8fc4-859b92fbff61" returned: 0 in 0.790s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb85e533-1101-47bb-bc88-c61a7f689376 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:11 devstack sudo[94319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273.info Jul 11 04:30:11 devstack sudo[94319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:12 devstack sudo[94319]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb85e533-1101-47bb-bc88-c61a7f689376 tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273.info" returned: 0 in 0.853s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:12 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-fb85e533-1101-47bb-bc88-c61a7f689376 tempest-GroupSnapshotsTest-1799390916 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273.info is being set with open permissions: ugo+rw: NotImplementedError Jul 11 04:30:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb85e533-1101-47bb-bc88-c61a7f689376 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:12 devstack sudo[94329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273.info Jul 11 04:30:12 devstack sudo[94329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-8f263958-b86f-4d53-8c21-39ac4a5c8b6e req-46039c37-c1d7-42a2-8c9d-fa0b3a54cbda tempest-TestInstancesWithCinderVolumes-1584482579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:30:12 devstack sudo[94329]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb85e533-1101-47bb-bc88-c61a7f689376 tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273.info" returned: 0 in 0.752s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fb85e533-1101-47bb-bc88-c61a7f689376 tempest-GroupSnapshotsTest-1799390916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.043s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:30:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-8f263958-b86f-4d53-8c21-39ac4a5c8b6e req-46039c37-c1d7-42a2-8c9d-fa0b3a54cbda tempest-TestInstancesWithCinderVolumes-1584482579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.441s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:30:12 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[db77b0a2-4b99-40fc-bcba-348c3ee44831]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:30:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-8f263958-b86f-4d53-8c21-39ac4a5c8b6e req-46039c37-c1d7-42a2-8c9d-fa0b3a54cbda tempest-TestInstancesWithCinderVolumes-1584482579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f61301cd-e7f6-4abe-82f4-7c87428bff50 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:13 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-fb85e533-1101-47bb-bc88-c61a7f689376 tempest-GroupSnapshotsTest-1799390916 None] group_snapshot bcbbee4d-9c8d-4e1e-ae5a-87838752b90d: created successfully Jul 11 04:30:13 devstack sudo[94340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f61301cd-e7f6-4abe-82f4-7c87428bff50 Jul 11 04:30:13 devstack sudo[94340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:13 devstack sudo[94340]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-8f263958-b86f-4d53-8c21-39ac4a5c8b6e req-46039c37-c1d7-42a2-8c9d-fa0b3a54cbda tempest-TestInstancesWithCinderVolumes-1584482579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f61301cd-e7f6-4abe-82f4-7c87428bff50" returned: 0 in 1.079s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-8f263958-b86f-4d53-8c21-39ac4a5c8b6e req-46039c37-c1d7-42a2-8c9d-fa0b3a54cbda tempest-TestInstancesWithCinderVolumes-1584482579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f61301cd-e7f6-4abe-82f4-7c87428bff50 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:14 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] group_snapshot bcbbee4d-9c8d-4e1e-ae5a-87838752b90d: deleting Jul 11 04:30:14 devstack sudo[94385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f61301cd-e7f6-4abe-82f4-7c87428bff50 Jul 11 04:30:14 devstack sudo[94385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:14 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] group_snapshot bcbbee4d-9c8d-4e1e-ae5a-87838752b90d: deleting {{(pid=86964) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 11 04:30:14 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] Acquiring lock "cinder-quobyte-f793694e-fa0c-4d9c-a05b-688d5b064b12" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:30:14 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] Lock "cinder-quobyte-f793694e-fa0c-4d9c-a05b-688d5b064b12" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:30:14 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] Acquiring lock "cinder-quobyte-1198237a-3bea-408b-a4c2-8c2a96d3f50a" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:30:14 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] Lock "cinder-quobyte-1198237a-3bea-408b-a4c2-8c2a96d3f50a" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:30:14 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] Deleting offline snapshot 1198237a-3bea-408b-a4c2-8c2a96d3f50a of volume f793694e-fa0c-4d9c-a05b-688d5b064b12 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:30:14 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] snapshot_file for this snap is: volume-f793694e-fa0c-4d9c-a05b-688d5b064b12.1198237a-3bea-408b-a4c2-8c2a96d3f50a {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:30:14 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[2834659a-b7f0-4268-88f0-5ab1d1c205f5]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:30:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12.1198237a-3bea-408b-a4c2-8c2a96d3f50a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:14 devstack sudo[94392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12.1198237a-3bea-408b-a4c2-8c2a96d3f50a Jul 11 04:30:14 devstack sudo[94392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:15 devstack sudo[94385]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-8f263958-b86f-4d53-8c21-39ac4a5c8b6e req-46039c37-c1d7-42a2-8c9d-fa0b3a54cbda tempest-TestInstancesWithCinderVolumes-1584482579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f61301cd-e7f6-4abe-82f4-7c87428bff50" returned: 1 in 1.085s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-8f263958-b86f-4d53-8c21-39ac4a5c8b6e req-46039c37-c1d7-42a2-8c9d-fa0b3a54cbda tempest-TestInstancesWithCinderVolumes-1584482579 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f61301cd-e7f6-4abe-82f4-7c87428bff50' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:30:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-8f263958-b86f-4d53-8c21-39ac4a5c8b6e req-46039c37-c1d7-42a2-8c9d-fa0b3a54cbda tempest-TestInstancesWithCinderVolumes-1584482579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.230s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:30:15 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-8f263958-b86f-4d53-8c21-39ac4a5c8b6e req-46039c37-c1d7-42a2-8c9d-fa0b3a54cbda tempest-TestInstancesWithCinderVolumes-1584482579 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95', 'name': 'volume-f61301cd-e7f6-4abe-82f4-7c87428bff50', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '57e6e56c-f68e-457c-a9ef-9fd6bf58db44', 'enforce_multipath': True} {{(pid=86964) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 04:30:15 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-8f263958-b86f-4d53-8c21-39ac4a5c8b6e req-46039c37-c1d7-42a2-8c9d-fa0b3a54cbda tempest-TestInstancesWithCinderVolumes-1584482579 None] attachment_update completed successfully. Jul 11 04:30:15 devstack sudo[94392]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12.1198237a-3bea-408b-a4c2-8c2a96d3f50a" returned: 0 in 1.200s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:15 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f793694e-fa0c-4d9c-a05b-688d5b064b12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:30:15 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee77c8d-134d-4ea4-9fdd-b58dbf2b0f77]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:30:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:15 devstack sudo[94439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12 Jul 11 04:30:15 devstack sudo[94439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:16 devstack sudo[94439]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12" returned: 0 in 1.067s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12.1198237a-3bea-408b-a4c2-8c2a96d3f50a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:16 devstack sudo[94449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12.1198237a-3bea-408b-a4c2-8c2a96d3f50a Jul 11 04:30:16 devstack sudo[94449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:18 devstack sudo[94449]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12.1198237a-3bea-408b-a4c2-8c2a96d3f50a" returned: 0 in 1.493s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12.1198237a-3bea-408b-a4c2-8c2a96d3f50a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:18 devstack sudo[94547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12.1198237a-3bea-408b-a4c2-8c2a96d3f50a Jul 11 04:30:18 devstack sudo[94547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:19 devstack sudo[94547]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12.1198237a-3bea-408b-a4c2-8c2a96d3f50a" returned: 0 in 1.165s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:19 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] Lock "cinder-quobyte-1198237a-3bea-408b-a4c2-8c2a96d3f50a" released by "_delete_snapshot" :: held 5.150s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:30:19 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] Lock "cinder-quobyte-f793694e-fa0c-4d9c-a05b-688d5b064b12" released by "delete_snapshot" :: held 5.189s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:30:19 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] Acquiring lock "cinder-quobyte-86f55b9e-0b07-437f-811d-a30822ab8273" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:30:19 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] Lock "cinder-quobyte-86f55b9e-0b07-437f-811d-a30822ab8273" acquired by "delete_snapshot" :: waited 0.058s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:30:19 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] Acquiring lock "cinder-quobyte-d37d8e4a-61c8-49db-8fc4-859b92fbff61" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:30:19 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] Lock "cinder-quobyte-d37d8e4a-61c8-49db-8fc4-859b92fbff61" acquired by "_delete_snapshot" :: waited 0.079s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:30:19 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] Deleting offline snapshot d37d8e4a-61c8-49db-8fc4-859b92fbff61 of volume 86f55b9e-0b07-437f-811d-a30822ab8273 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:30:19 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] snapshot_file for this snap is: volume-86f55b9e-0b07-437f-811d-a30822ab8273.d37d8e4a-61c8-49db-8fc4-859b92fbff61 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:30:19 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[32375d48-ee1a-42d2-b397-eeee1501802b]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:30:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273.d37d8e4a-61c8-49db-8fc4-859b92fbff61 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:20 devstack sudo[94579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273.d37d8e4a-61c8-49db-8fc4-859b92fbff61 Jul 11 04:30:20 devstack sudo[94579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:21 devstack sudo[94579]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273.d37d8e4a-61c8-49db-8fc4-859b92fbff61" returned: 0 in 1.947s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:21 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86f55b9e-0b07-437f-811d-a30822ab8273(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:30:21 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a3ca8a-f621-4963-a05b-ce753de49b06]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:30:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:22 devstack sudo[94930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273 Jul 11 04:30:22 devstack sudo[94930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:23 devstack sudo[94930]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273" returned: 0 in 2.126s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273.d37d8e4a-61c8-49db-8fc4-859b92fbff61 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:24 devstack sudo[94957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273.d37d8e4a-61c8-49db-8fc4-859b92fbff61 Jul 11 04:30:24 devstack sudo[94957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:25 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=74,cinder:UPDATE=55,cinder:INSERT=14,cinder:DELETE=3 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:30:25 devstack sudo[94957]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273.d37d8e4a-61c8-49db-8fc4-859b92fbff61" returned: 0 in 1.711s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273.d37d8e4a-61c8-49db-8fc4-859b92fbff61 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:25 devstack sudo[94965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273.d37d8e4a-61c8-49db-8fc4-859b92fbff61 Jul 11 04:30:25 devstack sudo[94965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:27 devstack sudo[94965]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273.d37d8e4a-61c8-49db-8fc4-859b92fbff61" returned: 0 in 1.481s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:27 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] Lock "cinder-quobyte-d37d8e4a-61c8-49db-8fc4-859b92fbff61" released by "_delete_snapshot" :: held 7.475s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:30:27 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] Lock "cinder-quobyte-86f55b9e-0b07-437f-811d-a30822ab8273" released by "delete_snapshot" :: held 7.568s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:30:27 devstack cinder-volume[86964]: WARNING cinder.quota [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1826192045 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1826192045, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:30:27 devstack cinder-volume[86964]: WARNING cinder.quota [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1826192045 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1826192045, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:30:27 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] Created reservations ['90c174fd-eee4-4c28-a9ff-b879bf5da01a', '8a67d2d6-ba72-42c8-8df6-3c04a4ce5a59', '9edd8838-1972-4c8b-839e-6e8890459c3e', '72d66969-ecff-491a-b641-602b608e70b3'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:30:27 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] Created reservations ['bb108671-8bb7-4d99-8c11-fbf4e1517b4d', '394c8faf-ef16-4d29-974c-882a0c44be7b', '6b4a6628-46ff-4baa-b3a7-1f1efdff2b8b', '3e2f2d1f-2455-42ce-84a3-d4069747efe7'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:30:27 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-176e0d07-62a6-4bba-bc91-3b734d0f1b56 tempest-GroupSnapshotsTest-1799390916 None] group_snapshot bcbbee4d-9c8d-4e1e-ae5a-87838752b90d: deleted successfully Jul 11 04:30:29 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-76af1ba7-69a4-4544-a0c9-586a7d8cae39 tempest-GroupSnapshotsTest-1799390916 None] Acquiring lock "cinder-quobyte-86f55b9e-0b07-437f-811d-a30822ab8273" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:30:29 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-76af1ba7-69a4-4544-a0c9-586a7d8cae39 tempest-GroupSnapshotsTest-1799390916 None] Lock "cinder-quobyte-86f55b9e-0b07-437f-811d-a30822ab8273" acquired by "delete_volume" :: waited 0.068s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:30:29 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc5192c-8368-4aeb-a416-9a13524dc18b]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:30:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-76af1ba7-69a4-4544-a0c9-586a7d8cae39 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:30 devstack sudo[94981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273 Jul 11 04:30:30 devstack sudo[94981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:30 devstack sudo[94981]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-76af1ba7-69a4-4544-a0c9-586a7d8cae39 tempest-GroupSnapshotsTest-1799390916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273" returned: 0 in 1.126s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-76af1ba7-69a4-4544-a0c9-586a7d8cae39 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:31 devstack sudo[94988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273 Jul 11 04:30:31 devstack sudo[94988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:32 devstack sudo[94988]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-76af1ba7-69a4-4544-a0c9-586a7d8cae39 tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-86f55b9e-0b07-437f-811d-a30822ab8273" returned: 0 in 1.393s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:32 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-76af1ba7-69a4-4544-a0c9-586a7d8cae39 tempest-GroupSnapshotsTest-1799390916 None] Lock "cinder-quobyte-86f55b9e-0b07-437f-811d-a30822ab8273" released by "delete_volume" :: held 2.714s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:30:32 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-76af1ba7-69a4-4544-a0c9-586a7d8cae39 tempest-GroupSnapshotsTest-1799390916 None] Acquiring lock "cinder-quobyte-f793694e-fa0c-4d9c-a05b-688d5b064b12" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:30:32 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-76af1ba7-69a4-4544-a0c9-586a7d8cae39 tempest-GroupSnapshotsTest-1799390916 None] Lock "cinder-quobyte-f793694e-fa0c-4d9c-a05b-688d5b064b12" acquired by "delete_volume" :: waited 0.041s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:30:32 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[5164a72e-9130-482f-a870-7cf5a6049f5a]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:30:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-76af1ba7-69a4-4544-a0c9-586a7d8cae39 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:32 devstack sudo[95018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12 Jul 11 04:30:32 devstack sudo[95018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:33 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-113f9e87-d66c-4243-ac84-30eb2ba68494 tempest-AttachVolumeShelveTestJSON-291210436 None] Acquiring lock "cinder-ceee026f-89f5-4fe7-b36c-79348522657d-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:30:33 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-113f9e87-d66c-4243-ac84-30eb2ba68494 tempest-AttachVolumeShelveTestJSON-291210436 None] Lock "cinder-ceee026f-89f5-4fe7-b36c-79348522657d-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:30:33 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:UPDATE=67,cinder:SELECT=72,cinder:INSERT=21,cinder:DELETE=2 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:30:33 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-113f9e87-d66c-4243-ac84-30eb2ba68494 tempest-AttachVolumeShelveTestJSON-291210436 None] Acquiring lock "cinder-quobyte-ceee026f-89f5-4fe7-b36c-79348522657d" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:30:33 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-113f9e87-d66c-4243-ac84-30eb2ba68494 tempest-AttachVolumeShelveTestJSON-291210436 None] Lock "cinder-quobyte-ceee026f-89f5-4fe7-b36c-79348522657d" acquired by "delete_volume" :: waited 0.024s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:30:33 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[c224d7db-02a0-4f08-8de4-97088b47256f]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:30:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-113f9e87-d66c-4243-ac84-30eb2ba68494 tempest-AttachVolumeShelveTestJSON-291210436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ceee026f-89f5-4fe7-b36c-79348522657d {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:33 devstack sudo[95045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ceee026f-89f5-4fe7-b36c-79348522657d Jul 11 04:30:33 devstack sudo[95045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:33 devstack sudo[95018]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-76af1ba7-69a4-4544-a0c9-586a7d8cae39 tempest-GroupSnapshotsTest-1799390916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12" returned: 0 in 1.438s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-76af1ba7-69a4-4544-a0c9-586a7d8cae39 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:34 devstack sudo[95049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12 Jul 11 04:30:34 devstack sudo[95049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:35 devstack sudo[95045]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-113f9e87-d66c-4243-ac84-30eb2ba68494 tempest-AttachVolumeShelveTestJSON-291210436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ceee026f-89f5-4fe7-b36c-79348522657d" returned: 0 in 1.590s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-113f9e87-d66c-4243-ac84-30eb2ba68494 tempest-AttachVolumeShelveTestJSON-291210436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ceee026f-89f5-4fe7-b36c-79348522657d {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:35 devstack sudo[95049]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-76af1ba7-69a4-4544-a0c9-586a7d8cae39 tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f793694e-fa0c-4d9c-a05b-688d5b064b12" returned: 0 in 1.325s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:35 devstack sudo[95058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ceee026f-89f5-4fe7-b36c-79348522657d Jul 11 04:30:35 devstack sudo[95058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:35 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-76af1ba7-69a4-4544-a0c9-586a7d8cae39 tempest-GroupSnapshotsTest-1799390916 None] Lock "cinder-quobyte-f793694e-fa0c-4d9c-a05b-688d5b064b12" released by "delete_volume" :: held 2.900s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:30:35 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-76af1ba7-69a4-4544-a0c9-586a7d8cae39 tempest-GroupSnapshotsTest-1799390916 None] Created reservations ['dd0b2610-088c-4e70-a487-e63dd327bcb9'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:30:35 devstack cinder-volume[86964]: WARNING cinder.quota [None req-76af1ba7-69a4-4544-a0c9-586a7d8cae39 tempest-GroupSnapshotsTest-1799390916 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1826192045 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1826192045, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:30:35 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-76af1ba7-69a4-4544-a0c9-586a7d8cae39 tempest-GroupSnapshotsTest-1799390916 None] Created reservations ['94aaabef-e019-4bd3-842a-6849ccd8faba', 'd8ef3f9b-43b3-4a62-96da-56765936ccb9', '8810fac9-a6ab-43c4-be3a-584431d1a171', 'b15fe6f0-1481-4e6c-b311-813e64c2512e'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:30:35 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-76af1ba7-69a4-4544-a0c9-586a7d8cae39 tempest-GroupSnapshotsTest-1799390916 None] Created reservations ['ebc55f9e-fbc8-494f-93ab-155f2abf739a', 'd8b5e8e5-8ff3-4a5e-947a-28e2b9c39edb', '07558853-2978-4f84-90e7-35e61661a6aa', 'e6d26d43-2ec7-4585-a767-3cbe908744fb'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:30:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-76af1ba7-69a4-4544-a0c9-586a7d8cae39 tempest-GroupSnapshotsTest-1799390916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:30:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-76af1ba7-69a4-4544-a0c9-586a7d8cae39 tempest-GroupSnapshotsTest-1799390916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:30:35 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-76af1ba7-69a4-4544-a0c9-586a7d8cae39 tempest-GroupSnapshotsTest-1799390916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:30:35 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-76af1ba7-69a4-4544-a0c9-586a7d8cae39 tempest-GroupSnapshotsTest-1799390916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:30:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-76af1ba7-69a4-4544-a0c9-586a7d8cae39 tempest-GroupSnapshotsTest-1799390916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:30:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-76af1ba7-69a4-4544-a0c9-586a7d8cae39 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:36 devstack sudo[95060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:30:36 devstack sudo[95060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:36 devstack sudo[95058]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-113f9e87-d66c-4243-ac84-30eb2ba68494 tempest-AttachVolumeShelveTestJSON-291210436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ceee026f-89f5-4fe7-b36c-79348522657d" returned: 0 in 1.502s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:36 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-113f9e87-d66c-4243-ac84-30eb2ba68494 tempest-AttachVolumeShelveTestJSON-291210436 None] Lock "cinder-quobyte-ceee026f-89f5-4fe7-b36c-79348522657d" released by "delete_volume" :: held 3.183s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:30:36 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-113f9e87-d66c-4243-ac84-30eb2ba68494 tempest-AttachVolumeShelveTestJSON-291210436 None] Created reservations ['f61fe0ea-d5b7-42dc-bcdd-1dad7b1bb190', '4987607c-2fe9-484f-828c-637beaf6475b', '6f599266-a92c-4c2f-b7b7-43ef8ef3ea86', '29cf1da0-a54e-4593-9540-2308c16532c0'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:30:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-113f9e87-d66c-4243-ac84-30eb2ba68494 tempest-AttachVolumeShelveTestJSON-291210436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:30:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-113f9e87-d66c-4243-ac84-30eb2ba68494 tempest-AttachVolumeShelveTestJSON-291210436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:30:37 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-113f9e87-d66c-4243-ac84-30eb2ba68494 tempest-AttachVolumeShelveTestJSON-291210436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:30:37 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-113f9e87-d66c-4243-ac84-30eb2ba68494 tempest-AttachVolumeShelveTestJSON-291210436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:30:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-113f9e87-d66c-4243-ac84-30eb2ba68494 tempest-AttachVolumeShelveTestJSON-291210436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:30:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-113f9e87-d66c-4243-ac84-30eb2ba68494 tempest-AttachVolumeShelveTestJSON-291210436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:37 devstack sudo[95066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:30:37 devstack sudo[95066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:37 devstack sudo[95060]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-76af1ba7-69a4-4544-a0c9-586a7d8cae39 tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 1.379s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:37 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-76af1ba7-69a4-4544-a0c9-586a7d8cae39 tempest-GroupSnapshotsTest-1799390916 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:30:37 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-76af1ba7-69a4-4544-a0c9-586a7d8cae39 tempest-GroupSnapshotsTest-1799390916 None] Delete group completed successfully. Jul 11 04:30:38 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-bf44a0f4-6054-449b-b6cb-0da34922f704 tempest-GroupSnapshotsTest-1799390916 None] Group tempest-GroupSnapshotsTest-Group-1352371448: creating Jul 11 04:30:38 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-bf44a0f4-6054-449b-b6cb-0da34922f704 tempest-GroupSnapshotsTest-1799390916 None] Group tempest-GroupSnapshotsTest-Group-1352371448: created successfully Jul 11 04:30:38 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-bf44a0f4-6054-449b-b6cb-0da34922f704 tempest-GroupSnapshotsTest-1799390916 None] Create group completed successfully. Jul 11 04:30:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-113f9e87-d66c-4243-ac84-30eb2ba68494 tempest-AttachVolumeShelveTestJSON-291210436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 1.575s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:38 devstack sudo[95066]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:38 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-113f9e87-d66c-4243-ac84-30eb2ba68494 tempest-AttachVolumeShelveTestJSON-291210436 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:30:38 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-113f9e87-d66c-4243-ac84-30eb2ba68494 tempest-AttachVolumeShelveTestJSON-291210436 None] Deleted volume successfully. Jul 11 04:30:38 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-113f9e87-d66c-4243-ac84-30eb2ba68494 tempest-AttachVolumeShelveTestJSON-291210436 None] Lock "cinder-ceee026f-89f5-4fe7-b36c-79348522657d-delete_volume" released by "delete_volume" :: held 5.316s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:30:38 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0f6f5b9-07f9-4380-96cd-b39914994991 tempest-ServerRescueNegativeTestJSON-50574844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:30:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a0f6f5b9-07f9-4380-96cd-b39914994991 tempest-ServerRescueNegativeTestJSON-50574844 None] Flow 'volume_create_manager' (fc74c779-60e3-42a4-b4e4-3d5bcac127d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:30:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a0f6f5b9-07f9-4380-96cd-b39914994991 tempest-ServerRescueNegativeTestJSON-50574844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4696ef96-4a43-4aeb-b411-df6c38309a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:30:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a0f6f5b9-07f9-4380-96cd-b39914994991 tempest-ServerRescueNegativeTestJSON-50574844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4696ef96-4a43-4aeb-b411-df6c38309a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1149638376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=448cbd8a-e869-47df-9c15-bc2df160a6ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b0e5477a0154c57a2c6c1998dd90b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:30:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:30:39Z,use_quota=True,user_id='eb8e243557f04bdeb527aeb4ac9031ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:30:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a0f6f5b9-07f9-4380-96cd-b39914994991 tempest-ServerRescueNegativeTestJSON-50574844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (243b4f64-db8f-4cb7-adaf-00cedcad1817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:30:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a0f6f5b9-07f9-4380-96cd-b39914994991 tempest-ServerRescueNegativeTestJSON-50574844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (243b4f64-db8f-4cb7-adaf-00cedcad1817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:30:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a0f6f5b9-07f9-4380-96cd-b39914994991 tempest-ServerRescueNegativeTestJSON-50574844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26f9c171-a057-4161-a56c-f030d27061cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:30:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a0f6f5b9-07f9-4380-96cd-b39914994991 tempest-ServerRescueNegativeTestJSON-50574844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26f9c171-a057-4161-a56c-f030d27061cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '448cbd8a-e869-47df-9c15-bc2df160a6ea', 'volume_name': 'volume-448cbd8a-e869-47df-9c15-bc2df160a6ea', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:30:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a0f6f5b9-07f9-4380-96cd-b39914994991 tempest-ServerRescueNegativeTestJSON-50574844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bafb247c-08dc-4b33-91d1-7c7e2757f725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:30:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a0f6f5b9-07f9-4380-96cd-b39914994991 tempest-ServerRescueNegativeTestJSON-50574844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bafb247c-08dc-4b33-91d1-7c7e2757f725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:30:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a0f6f5b9-07f9-4380-96cd-b39914994991 tempest-ServerRescueNegativeTestJSON-50574844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (428876a7-154e-45fc-b224-6c703e06fc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:30:39 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-a0f6f5b9-07f9-4380-96cd-b39914994991 tempest-ServerRescueNegativeTestJSON-50574844 None] Volume 448cbd8a-e869-47df-9c15-bc2df160a6ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-448cbd8a-e869-47df-9c15-bc2df160a6ea', 'volume_size': 1} Jul 11 04:30:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a0f6f5b9-07f9-4380-96cd-b39914994991 tempest-ServerRescueNegativeTestJSON-50574844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:30:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a0f6f5b9-07f9-4380-96cd-b39914994991 tempest-ServerRescueNegativeTestJSON-50574844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:30:39 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-a0f6f5b9-07f9-4380-96cd-b39914994991 tempest-ServerRescueNegativeTestJSON-50574844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1149638376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=448cbd8a-e869-47df-9c15-bc2df160a6ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b0e5477a0154c57a2c6c1998dd90b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:30:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:30:39Z,use_quota=True,user_id='eb8e243557f04bdeb527aeb4ac9031ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:30:39 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-a0f6f5b9-07f9-4380-96cd-b39914994991 tempest-ServerRescueNegativeTestJSON-50574844 None] Creating volume 448cbd8a-e869-47df-9c15-bc2df160a6ea {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:30:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a0f6f5b9-07f9-4380-96cd-b39914994991 tempest-ServerRescueNegativeTestJSON-50574844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:30:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a0f6f5b9-07f9-4380-96cd-b39914994991 tempest-ServerRescueNegativeTestJSON-50574844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:30:39 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-a0f6f5b9-07f9-4380-96cd-b39914994991 tempest-ServerRescueNegativeTestJSON-50574844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:30:39 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-a0f6f5b9-07f9-4380-96cd-b39914994991 tempest-ServerRescueNegativeTestJSON-50574844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:30:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a0f6f5b9-07f9-4380-96cd-b39914994991 tempest-ServerRescueNegativeTestJSON-50574844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:30:39 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-a0f6f5b9-07f9-4380-96cd-b39914994991 tempest-ServerRescueNegativeTestJSON-50574844 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:30:39 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-a0f6f5b9-07f9-4380-96cd-b39914994991 tempest-ServerRescueNegativeTestJSON-50574844 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:30:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a0f6f5b9-07f9-4380-96cd-b39914994991 tempest-ServerRescueNegativeTestJSON-50574844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-448cbd8a-e869-47df-9c15-bc2df160a6ea 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:39 devstack sudo[95094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-448cbd8a-e869-47df-9c15-bc2df160a6ea 1073741824 Jul 11 04:30:39 devstack sudo[95094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:41 devstack sudo[95094]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a0f6f5b9-07f9-4380-96cd-b39914994991 tempest-ServerRescueNegativeTestJSON-50574844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-448cbd8a-e869-47df-9c15-bc2df160a6ea 1073741824" returned: 0 in 2.058s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a0f6f5b9-07f9-4380-96cd-b39914994991 tempest-ServerRescueNegativeTestJSON-50574844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-448cbd8a-e869-47df-9c15-bc2df160a6ea {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:41 devstack sudo[95100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-448cbd8a-e869-47df-9c15-bc2df160a6ea Jul 11 04:30:41 devstack sudo[95100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:41 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5421a53-1164-491f-ba3e-33e2cfda498b tempest-GroupSnapshotsTest-1799390916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:30:41 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c5421a53-1164-491f-ba3e-33e2cfda498b tempest-GroupSnapshotsTest-1799390916 None] Flow 'volume_create_manager' (c0580405-69b4-4629-b5ea-d02620086642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:30:41 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c5421a53-1164-491f-ba3e-33e2cfda498b tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e372b1fa-7f02-495e-8d0e-ab31b260124f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:30:41 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c5421a53-1164-491f-ba3e-33e2cfda498b tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e372b1fa-7f02-495e-8d0e-ab31b260124f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1945039285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=699eb262-54e3-4c05-9f67-0ff5620ebb3e,host='devstack@QuobyteHD#QuobyteHD',id=ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58be74b0ee43492bb1037c8c48daf403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:30:41Z,use_quota=True,user_id='a6072455344c4e1b88ff5a6efb3f2113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(daca860e-bb7b-4df5-b781-ae400d7de868),volume_type_id=daca860e-bb7b-4df5-b781-ae400d7de868)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:30:41 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c5421a53-1164-491f-ba3e-33e2cfda498b tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8690b3a1-0d18-43d0-ae51-451211f6387e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:30:41 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c5421a53-1164-491f-ba3e-33e2cfda498b tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8690b3a1-0d18-43d0-ae51-451211f6387e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:30:41 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c5421a53-1164-491f-ba3e-33e2cfda498b tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad120043-b995-49d3-b794-5e83f49c0563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:30:41 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c5421a53-1164-491f-ba3e-33e2cfda498b tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad120043-b995-49d3-b794-5e83f49c0563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1', 'volume_name': 'volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:30:41 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c5421a53-1164-491f-ba3e-33e2cfda498b tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38e56232-f143-46d0-a780-981fe074b990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:30:41 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c5421a53-1164-491f-ba3e-33e2cfda498b tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38e56232-f143-46d0-a780-981fe074b990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:30:41 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c5421a53-1164-491f-ba3e-33e2cfda498b tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd372215-a52c-4eb6-8d78-2265414a24c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:30:41 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-c5421a53-1164-491f-ba3e-33e2cfda498b tempest-GroupSnapshotsTest-1799390916 None] Volume ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1', 'volume_size': 1} Jul 11 04:30:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c5421a53-1164-491f-ba3e-33e2cfda498b tempest-GroupSnapshotsTest-1799390916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:30:42 devstack sudo[95100]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a0f6f5b9-07f9-4380-96cd-b39914994991 tempest-ServerRescueNegativeTestJSON-50574844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-448cbd8a-e869-47df-9c15-bc2df160a6ea" returned: 0 in 0.942s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:42 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-a0f6f5b9-07f9-4380-96cd-b39914994991 tempest-ServerRescueNegativeTestJSON-50574844 None] <== create_volume: return (3121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:30:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a0f6f5b9-07f9-4380-96cd-b39914994991 tempest-ServerRescueNegativeTestJSON-50574844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.123s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:30:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c5421a53-1164-491f-ba3e-33e2cfda498b tempest-GroupSnapshotsTest-1799390916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.625s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:30:42 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c5421a53-1164-491f-ba3e-33e2cfda498b tempest-GroupSnapshotsTest-1799390916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=699eb262-54e3-4c05-9f67-0ff5620ebb3e,created_at=2026-07-11T02:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1945039285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=699eb262-54e3-4c05-9f67-0ff5620ebb3e,host='devstack@QuobyteHD#QuobyteHD',id=ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58be74b0ee43492bb1037c8c48daf403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:30:41Z,use_quota=True,user_id='a6072455344c4e1b88ff5a6efb3f2113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(daca860e-bb7b-4df5-b781-ae400d7de868),volume_type_id=daca860e-bb7b-4df5-b781-ae400d7de868)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:30:42 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-c5421a53-1164-491f-ba3e-33e2cfda498b tempest-GroupSnapshotsTest-1799390916 None] Creating volume ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:30:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c5421a53-1164-491f-ba3e-33e2cfda498b tempest-GroupSnapshotsTest-1799390916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:30:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c5421a53-1164-491f-ba3e-33e2cfda498b tempest-GroupSnapshotsTest-1799390916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:30:42 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c5421a53-1164-491f-ba3e-33e2cfda498b tempest-GroupSnapshotsTest-1799390916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:30:42 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c5421a53-1164-491f-ba3e-33e2cfda498b tempest-GroupSnapshotsTest-1799390916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:30:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c5421a53-1164-491f-ba3e-33e2cfda498b tempest-GroupSnapshotsTest-1799390916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:30:42 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c5421a53-1164-491f-ba3e-33e2cfda498b tempest-GroupSnapshotsTest-1799390916 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:30:42 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-c5421a53-1164-491f-ba3e-33e2cfda498b tempest-GroupSnapshotsTest-1799390916 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:30:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c5421a53-1164-491f-ba3e-33e2cfda498b tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:42 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a0f6f5b9-07f9-4380-96cd-b39914994991 tempest-ServerRescueNegativeTestJSON-50574844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (428876a7-154e-45fc-b224-6c703e06fc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-448cbd8a-e869-47df-9c15-bc2df160a6ea', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:30:42 devstack sudo[95103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1 1073741824 Jul 11 04:30:42 devstack sudo[95103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:42 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a0f6f5b9-07f9-4380-96cd-b39914994991 tempest-ServerRescueNegativeTestJSON-50574844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1c2a74b-842c-4bb8-9e5b-4998ddd1186a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:30:42 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-a0f6f5b9-07f9-4380-96cd-b39914994991 tempest-ServerRescueNegativeTestJSON-50574844 None] Volume volume-448cbd8a-e869-47df-9c15-bc2df160a6ea (448cbd8a-e869-47df-9c15-bc2df160a6ea): created successfully Jul 11 04:30:42 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a0f6f5b9-07f9-4380-96cd-b39914994991 tempest-ServerRescueNegativeTestJSON-50574844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1c2a74b-842c-4bb8-9e5b-4998ddd1186a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:30:42 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a0f6f5b9-07f9-4380-96cd-b39914994991 tempest-ServerRescueNegativeTestJSON-50574844 None] Flow 'volume_create_manager' (fc74c779-60e3-42a4-b4e4-3d5bcac127d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:30:42 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-a0f6f5b9-07f9-4380-96cd-b39914994991 tempest-ServerRescueNegativeTestJSON-50574844 None] Created volume successfully. Jul 11 04:30:43 devstack sudo[95103]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c5421a53-1164-491f-ba3e-33e2cfda498b tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1 1073741824" returned: 0 in 1.558s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c5421a53-1164-491f-ba3e-33e2cfda498b tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:43 devstack sudo[95170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1 Jul 11 04:30:43 devstack sudo[95170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:44 devstack sudo[95170]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c5421a53-1164-491f-ba3e-33e2cfda498b tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1" returned: 0 in 1.056s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:44 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c5421a53-1164-491f-ba3e-33e2cfda498b tempest-GroupSnapshotsTest-1799390916 None] <== create_volume: return (2745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:30:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c5421a53-1164-491f-ba3e-33e2cfda498b tempest-GroupSnapshotsTest-1799390916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.752s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:30:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c5421a53-1164-491f-ba3e-33e2cfda498b tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd372215-a52c-4eb6-8d78-2265414a24c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:30:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c5421a53-1164-491f-ba3e-33e2cfda498b tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (387d500a-dccc-406d-8f36-da6580f3e825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:30:45 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-c5421a53-1164-491f-ba3e-33e2cfda498b tempest-GroupSnapshotsTest-1799390916 None] Volume volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1 (ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1): created successfully Jul 11 04:30:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c5421a53-1164-491f-ba3e-33e2cfda498b tempest-GroupSnapshotsTest-1799390916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (387d500a-dccc-406d-8f36-da6580f3e825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:30:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c5421a53-1164-491f-ba3e-33e2cfda498b tempest-GroupSnapshotsTest-1799390916 None] Flow 'volume_create_manager' (c0580405-69b4-4629-b5ea-d02620086642) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:30:45 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-c5421a53-1164-491f-ba3e-33e2cfda498b tempest-GroupSnapshotsTest-1799390916 None] Created volume successfully. Jul 11 04:30:46 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-b29b151e-f571-4be0-bda1-155a7b0245a8 tempest-GroupSnapshotsTest-1799390916 None] GroupSnapshot 683c7c9a-2d71-474d-96d9-f3a8d90a463e: creating. Jul 11 04:30:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b29b151e-f571-4be0-bda1-155a7b0245a8 tempest-GroupSnapshotsTest-1799390916 None] Group snapshot 683c7c9a-2d71-474d-96d9-f3a8d90a463e: creating. {{(pid=86964) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 11 04:30:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b29b151e-f571-4be0-bda1-155a7b0245a8 tempest-GroupSnapshotsTest-1799390916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:30:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b29b151e-f571-4be0-bda1-155a7b0245a8 tempest-GroupSnapshotsTest-1799390916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:30:46 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-b29b151e-f571-4be0-bda1-155a7b0245a8 tempest-GroupSnapshotsTest-1799390916 None] Creating offline snapshot 6685048c-991a-4f31-96c4-d64cfbd263e9 of volume ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1 {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:30:46 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[276905a6-4c87-4ca8-92c4-a80d5b3fafe9]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:30:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b29b151e-f571-4be0-bda1-155a7b0245a8 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:46 devstack sudo[95175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1 Jul 11 04:30:46 devstack sudo[95175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:47 devstack sudo[95175]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b29b151e-f571-4be0-bda1-155a7b0245a8 tempest-GroupSnapshotsTest-1799390916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1" returned: 0 in 0.907s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b29b151e-f571-4be0-bda1-155a7b0245a8 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1.6685048c-991a-4f31-96c4-d64cfbd263e9 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:47 devstack sudo[95182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1.6685048c-991a-4f31-96c4-d64cfbd263e9 1G Jul 11 04:30:47 devstack sudo[95182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:48 devstack sudo[95182]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b29b151e-f571-4be0-bda1-155a7b0245a8 tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1.6685048c-991a-4f31-96c4-d64cfbd263e9 1G" returned: 0 in 0.938s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b29b151e-f571-4be0-bda1-155a7b0245a8 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1.6685048c-991a-4f31-96c4-d64cfbd263e9 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:48 devstack sudo[95192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1.6685048c-991a-4f31-96c4-d64cfbd263e9 Jul 11 04:30:48 devstack sudo[95192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:49 devstack sudo[95192]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b29b151e-f571-4be0-bda1-155a7b0245a8 tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1.6685048c-991a-4f31-96c4-d64cfbd263e9" returned: 0 in 0.901s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:49 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-b29b151e-f571-4be0-bda1-155a7b0245a8 tempest-GroupSnapshotsTest-1799390916 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1.6685048c-991a-4f31-96c4-d64cfbd263e9 is being set with open permissions: ugo+rw: NotImplementedError Jul 11 04:30:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b29b151e-f571-4be0-bda1-155a7b0245a8 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1.6685048c-991a-4f31-96c4-d64cfbd263e9 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:49 devstack sudo[95204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1.6685048c-991a-4f31-96c4-d64cfbd263e9 Jul 11 04:30:49 devstack sudo[95204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:50 devstack sudo[95204]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b29b151e-f571-4be0-bda1-155a7b0245a8 tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1.6685048c-991a-4f31-96c4-d64cfbd263e9" returned: 0 in 0.699s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b29b151e-f571-4be0-bda1-155a7b0245a8 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:50 devstack sudo[95225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1.info Jul 11 04:30:50 devstack sudo[95225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:50 devstack sudo[95225]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b29b151e-f571-4be0-bda1-155a7b0245a8 tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1.info" returned: 0 in 0.736s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:50 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-b29b151e-f571-4be0-bda1-155a7b0245a8 tempest-GroupSnapshotsTest-1799390916 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1.info is being set with open permissions: ugo+rw: NotImplementedError Jul 11 04:30:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b29b151e-f571-4be0-bda1-155a7b0245a8 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:51 devstack sudo[95228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1.info Jul 11 04:30:51 devstack sudo[95228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:51 devstack sudo[95228]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b29b151e-f571-4be0-bda1-155a7b0245a8 tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1.info" returned: 0 in 0.659s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b29b151e-f571-4be0-bda1-155a7b0245a8 tempest-GroupSnapshotsTest-1799390916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.958s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:30:51 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-b29b151e-f571-4be0-bda1-155a7b0245a8 tempest-GroupSnapshotsTest-1799390916 None] group_snapshot 683c7c9a-2d71-474d-96d9-f3a8d90a463e: created successfully Jul 11 04:30:52 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-ea6e8896-21e1-497c-8b35-7432a6e0c1c6 tempest-GroupSnapshotsTest-1799390916 None] group_snapshot 683c7c9a-2d71-474d-96d9-f3a8d90a463e: deleting Jul 11 04:30:52 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ea6e8896-21e1-497c-8b35-7432a6e0c1c6 tempest-GroupSnapshotsTest-1799390916 None] group_snapshot 683c7c9a-2d71-474d-96d9-f3a8d90a463e: deleting {{(pid=86964) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 11 04:30:52 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ea6e8896-21e1-497c-8b35-7432a6e0c1c6 tempest-GroupSnapshotsTest-1799390916 None] Acquiring lock "cinder-quobyte-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:30:52 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ea6e8896-21e1-497c-8b35-7432a6e0c1c6 tempest-GroupSnapshotsTest-1799390916 None] Lock "cinder-quobyte-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:30:52 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ea6e8896-21e1-497c-8b35-7432a6e0c1c6 tempest-GroupSnapshotsTest-1799390916 None] Acquiring lock "cinder-quobyte-6685048c-991a-4f31-96c4-d64cfbd263e9" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:30:52 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ea6e8896-21e1-497c-8b35-7432a6e0c1c6 tempest-GroupSnapshotsTest-1799390916 None] Lock "cinder-quobyte-6685048c-991a-4f31-96c4-d64cfbd263e9" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:30:52 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-ea6e8896-21e1-497c-8b35-7432a6e0c1c6 tempest-GroupSnapshotsTest-1799390916 None] Deleting offline snapshot 6685048c-991a-4f31-96c4-d64cfbd263e9 of volume ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:30:52 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-ea6e8896-21e1-497c-8b35-7432a6e0c1c6 tempest-GroupSnapshotsTest-1799390916 None] snapshot_file for this snap is: volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1.6685048c-991a-4f31-96c4-d64cfbd263e9 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:30:52 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[923126ef-ac13-41e7-ba92-ae75dba570e5]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:30:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ea6e8896-21e1-497c-8b35-7432a6e0c1c6 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1.6685048c-991a-4f31-96c4-d64cfbd263e9 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:52 devstack sudo[95233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1.6685048c-991a-4f31-96c4-d64cfbd263e9 Jul 11 04:30:52 devstack sudo[95233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:53 devstack sudo[95233]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ea6e8896-21e1-497c-8b35-7432a6e0c1c6 tempest-GroupSnapshotsTest-1799390916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1.6685048c-991a-4f31-96c4-d64cfbd263e9" returned: 0 in 1.086s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:53 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-ea6e8896-21e1-497c-8b35-7432a6e0c1c6 tempest-GroupSnapshotsTest-1799390916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:30:53 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a32a996-58b3-4c12-80e1-e894b695e4a9]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:30:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ea6e8896-21e1-497c-8b35-7432a6e0c1c6 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:53 devstack sudo[95262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1 Jul 11 04:30:53 devstack sudo[95262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:54 devstack sudo[95262]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ea6e8896-21e1-497c-8b35-7432a6e0c1c6 tempest-GroupSnapshotsTest-1799390916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1" returned: 0 in 1.274s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ea6e8896-21e1-497c-8b35-7432a6e0c1c6 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1.6685048c-991a-4f31-96c4-d64cfbd263e9 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:55 devstack sudo[95268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1.6685048c-991a-4f31-96c4-d64cfbd263e9 Jul 11 04:30:55 devstack sudo[95268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:56 devstack sudo[95268]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ea6e8896-21e1-497c-8b35-7432a6e0c1c6 tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1.6685048c-991a-4f31-96c4-d64cfbd263e9" returned: 0 in 1.376s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ea6e8896-21e1-497c-8b35-7432a6e0c1c6 tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1.6685048c-991a-4f31-96c4-d64cfbd263e9 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:56 devstack sudo[95276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1.6685048c-991a-4f31-96c4-d64cfbd263e9 Jul 11 04:30:56 devstack sudo[95276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:57 devstack sudo[95276]: pam_unix(sudo:session): session closed for user root Jul 11 04:30:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ea6e8896-21e1-497c-8b35-7432a6e0c1c6 tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1.6685048c-991a-4f31-96c4-d64cfbd263e9" returned: 0 in 1.067s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:30:57 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ea6e8896-21e1-497c-8b35-7432a6e0c1c6 tempest-GroupSnapshotsTest-1799390916 None] Lock "cinder-quobyte-6685048c-991a-4f31-96c4-d64cfbd263e9" released by "_delete_snapshot" :: held 5.004s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:30:57 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ea6e8896-21e1-497c-8b35-7432a6e0c1c6 tempest-GroupSnapshotsTest-1799390916 None] Lock "cinder-quobyte-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1" released by "delete_snapshot" :: held 5.036s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:30:57 devstack cinder-volume[86964]: WARNING cinder.quota [None req-ea6e8896-21e1-497c-8b35-7432a6e0c1c6 tempest-GroupSnapshotsTest-1799390916 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-518689394 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-518689394, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:30:57 devstack cinder-volume[86964]: WARNING cinder.quota [None req-ea6e8896-21e1-497c-8b35-7432a6e0c1c6 tempest-GroupSnapshotsTest-1799390916 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-518689394 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-518689394, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:30:57 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-ea6e8896-21e1-497c-8b35-7432a6e0c1c6 tempest-GroupSnapshotsTest-1799390916 None] Created reservations ['470f8f86-cf0f-47cd-a82a-57742cf6a758', 'fead190f-0af7-4e90-9fff-58f9764ffa05', 'b3f9112c-0f0b-4322-9166-76af97210853', '4ca86cfd-ff94-428b-90a3-8b6d90e4214c'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:30:57 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-ea6e8896-21e1-497c-8b35-7432a6e0c1c6 tempest-GroupSnapshotsTest-1799390916 None] group_snapshot 683c7c9a-2d71-474d-96d9-f3a8d90a463e: deleted successfully Jul 11 04:30:58 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-54b2e79d-5b9f-4480-b6a6-43c71068d37d tempest-GroupSnapshotsTest-1799390916 None] Acquiring lock "cinder-quobyte-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:30:58 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-54b2e79d-5b9f-4480-b6a6-43c71068d37d tempest-GroupSnapshotsTest-1799390916 None] Lock "cinder-quobyte-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1" acquired by "delete_volume" :: waited 0.068s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:30:58 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5f1447-bc66-4b08-ad48-dcf8aee90e27]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:30:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-54b2e79d-5b9f-4480-b6a6-43c71068d37d tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:59 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:30:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:30:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:30:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:30:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:30:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:30:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:30:59 devstack sudo[95283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1 Jul 11 04:30:59 devstack sudo[95283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:30:59 devstack sudo[95288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:30:59 devstack sudo[95288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:00 devstack sudo[95288]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 1.178s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:00 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:31:00 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager._thread_info {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:31:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread count: 28 {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:31:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread info: [<_MainThread(MainThread, started 124675027595392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:31:00 devstack sudo[95283]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-54b2e79d-5b9f-4480-b6a6-43c71068d37d tempest-GroupSnapshotsTest-1799390916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1" returned: 0 in 1.794s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-54b2e79d-5b9f-4480-b6a6-43c71068d37d tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:00 devstack sudo[95304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1 Jul 11 04:31:00 devstack sudo[95304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:01 devstack sudo[95304]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-54b2e79d-5b9f-4480-b6a6-43c71068d37d tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1" returned: 0 in 0.808s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:01 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-54b2e79d-5b9f-4480-b6a6-43c71068d37d tempest-GroupSnapshotsTest-1799390916 None] Lock "cinder-quobyte-ef7a7f4a-2ac3-4d20-8913-51e3b11a17a1" released by "delete_volume" :: held 2.722s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:31:01 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-54b2e79d-5b9f-4480-b6a6-43c71068d37d tempest-GroupSnapshotsTest-1799390916 None] Created reservations ['85e1ce56-4d9d-4e5c-b955-d8007c55adf5'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:31:01 devstack cinder-volume[86964]: WARNING cinder.quota [None req-54b2e79d-5b9f-4480-b6a6-43c71068d37d tempest-GroupSnapshotsTest-1799390916 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-518689394 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-518689394, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:31:01 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-54b2e79d-5b9f-4480-b6a6-43c71068d37d tempest-GroupSnapshotsTest-1799390916 None] Created reservations ['1b2b38d5-dd4a-4fb4-9205-229f9186d1b6', '21343dd8-0cc1-44d5-be56-ea7b5d89fb8e', '9c1141ad-767a-4fe3-bdf3-50b66193cf13', '0cd599c8-2e8b-4292-b1c9-85dde0d81835'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:31:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-54b2e79d-5b9f-4480-b6a6-43c71068d37d tempest-GroupSnapshotsTest-1799390916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:31:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-54b2e79d-5b9f-4480-b6a6-43c71068d37d tempest-GroupSnapshotsTest-1799390916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:31:01 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-54b2e79d-5b9f-4480-b6a6-43c71068d37d tempest-GroupSnapshotsTest-1799390916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:31:01 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-54b2e79d-5b9f-4480-b6a6-43c71068d37d tempest-GroupSnapshotsTest-1799390916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:31:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-54b2e79d-5b9f-4480-b6a6-43c71068d37d tempest-GroupSnapshotsTest-1799390916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:31:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-54b2e79d-5b9f-4480-b6a6-43c71068d37d tempest-GroupSnapshotsTest-1799390916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:01 devstack sudo[95361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:31:01 devstack sudo[95361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:02 devstack sudo[95361]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-54b2e79d-5b9f-4480-b6a6-43c71068d37d tempest-GroupSnapshotsTest-1799390916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.931s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:02 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-54b2e79d-5b9f-4480-b6a6-43c71068d37d tempest-GroupSnapshotsTest-1799390916 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:31:02 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-54b2e79d-5b9f-4480-b6a6-43c71068d37d tempest-GroupSnapshotsTest-1799390916 None] Delete group completed successfully. Jul 11 04:31:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-31b085e3-015b-48b1-b335-7b1f61eeb5da req-c2b9e106-c86f-46c8-8a81-0ab2a4076cc1 tempest-TestInstancesWithCinderVolumes-1584482579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:31:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-31b085e3-015b-48b1-b335-7b1f61eeb5da req-c2b9e106-c86f-46c8-8a81-0ab2a4076cc1 tempest-TestInstancesWithCinderVolumes-1584482579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:31:03 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[4022ad43-7b80-4b2c-aacd-3e1519fbf2fe]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:31:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-31b085e3-015b-48b1-b335-7b1f61eeb5da req-c2b9e106-c86f-46c8-8a81-0ab2a4076cc1 tempest-TestInstancesWithCinderVolumes-1584482579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-24061528-da9f-4b35-abc7-63fcb9272923 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:03 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-532f3c78-f14d-46be-be0a-26b7782de508 tempest-ServerRescueNegativeTestJSON-50574844 None] Acquiring lock "cinder-448cbd8a-e869-47df-9c15-bc2df160a6ea-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:31:03 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-532f3c78-f14d-46be-be0a-26b7782de508 tempest-ServerRescueNegativeTestJSON-50574844 None] Lock "cinder-448cbd8a-e869-47df-9c15-bc2df160a6ea-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:31:03 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-532f3c78-f14d-46be-be0a-26b7782de508 tempest-ServerRescueNegativeTestJSON-50574844 None] Acquiring lock "cinder-quobyte-448cbd8a-e869-47df-9c15-bc2df160a6ea" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:31:03 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-532f3c78-f14d-46be-be0a-26b7782de508 tempest-ServerRescueNegativeTestJSON-50574844 None] Lock "cinder-quobyte-448cbd8a-e869-47df-9c15-bc2df160a6ea" acquired by "delete_volume" :: waited 0.022s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:31:03 devstack sudo[95375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-24061528-da9f-4b35-abc7-63fcb9272923 Jul 11 04:31:03 devstack sudo[95375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:03 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[674e8545-341b-4f0f-a761-ccce61fb6490]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:31:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-532f3c78-f14d-46be-be0a-26b7782de508 tempest-ServerRescueNegativeTestJSON-50574844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-448cbd8a-e869-47df-9c15-bc2df160a6ea {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:03 devstack sudo[95377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-448cbd8a-e869-47df-9c15-bc2df160a6ea Jul 11 04:31:03 devstack sudo[95377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:04 devstack sudo[95375]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-31b085e3-015b-48b1-b335-7b1f61eeb5da req-c2b9e106-c86f-46c8-8a81-0ab2a4076cc1 tempest-TestInstancesWithCinderVolumes-1584482579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-24061528-da9f-4b35-abc7-63fcb9272923" returned: 0 in 1.366s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-31b085e3-015b-48b1-b335-7b1f61eeb5da req-c2b9e106-c86f-46c8-8a81-0ab2a4076cc1 tempest-TestInstancesWithCinderVolumes-1584482579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.410s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:31:04 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-31b085e3-015b-48b1-b335-7b1f61eeb5da req-c2b9e106-c86f-46c8-8a81-0ab2a4076cc1 tempest-TestInstancesWithCinderVolumes-1584482579 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95', 'name': 'volume-24061528-da9f-4b35-abc7-63fcb9272923', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ea32b654-5872-4d0b-b411-d34fe7d58894', 'enforce_multipath': True} {{(pid=86964) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 04:31:04 devstack sudo[95377]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-532f3c78-f14d-46be-be0a-26b7782de508 tempest-ServerRescueNegativeTestJSON-50574844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-448cbd8a-e869-47df-9c15-bc2df160a6ea" returned: 0 in 1.331s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-532f3c78-f14d-46be-be0a-26b7782de508 tempest-ServerRescueNegativeTestJSON-50574844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-448cbd8a-e869-47df-9c15-bc2df160a6ea {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:04 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-31b085e3-015b-48b1-b335-7b1f61eeb5da req-c2b9e106-c86f-46c8-8a81-0ab2a4076cc1 tempest-TestInstancesWithCinderVolumes-1584482579 None] attachment_update completed successfully. Jul 11 04:31:04 devstack sudo[95386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-448cbd8a-e869-47df-9c15-bc2df160a6ea Jul 11 04:31:04 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:05 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-532f3c78-f14d-46be-be0a-26b7782de508 tempest-ServerRescueNegativeTestJSON-50574844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-448cbd8a-e869-47df-9c15-bc2df160a6ea" returned: 0 in 0.942s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:05 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-532f3c78-f14d-46be-be0a-26b7782de508 tempest-ServerRescueNegativeTestJSON-50574844 None] Lock "cinder-quobyte-448cbd8a-e869-47df-9c15-bc2df160a6ea" released by "delete_volume" :: held 2.373s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:31:05 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-532f3c78-f14d-46be-be0a-26b7782de508 tempest-ServerRescueNegativeTestJSON-50574844 None] Created reservations ['5990695c-6e65-4f05-a3b5-d03a4baff2ad', 'ea8fdab4-e667-4bd0-8cf7-fc25382c38a7', '919a9a85-0fa1-46b2-bc3e-e9470a470a9d', 'b2a3d3d2-107b-417c-9db3-dc61aa9556c9'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:31:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-532f3c78-f14d-46be-be0a-26b7782de508 tempest-ServerRescueNegativeTestJSON-50574844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:31:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-532f3c78-f14d-46be-be0a-26b7782de508 tempest-ServerRescueNegativeTestJSON-50574844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:31:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-532f3c78-f14d-46be-be0a-26b7782de508 tempest-ServerRescueNegativeTestJSON-50574844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:31:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-532f3c78-f14d-46be-be0a-26b7782de508 tempest-ServerRescueNegativeTestJSON-50574844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:31:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-532f3c78-f14d-46be-be0a-26b7782de508 tempest-ServerRescueNegativeTestJSON-50574844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:31:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-532f3c78-f14d-46be-be0a-26b7782de508 tempest-ServerRescueNegativeTestJSON-50574844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:06 devstack sudo[95392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:31:06 devstack sudo[95392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:07 devstack sudo[95392]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-532f3c78-f14d-46be-be0a-26b7782de508 tempest-ServerRescueNegativeTestJSON-50574844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 1.201s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:07 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-532f3c78-f14d-46be-be0a-26b7782de508 tempest-ServerRescueNegativeTestJSON-50574844 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:31:07 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-532f3c78-f14d-46be-be0a-26b7782de508 tempest-ServerRescueNegativeTestJSON-50574844 None] Deleted volume successfully. Jul 11 04:31:07 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-532f3c78-f14d-46be-be0a-26b7782de508 tempest-ServerRescueNegativeTestJSON-50574844 None] Lock "cinder-448cbd8a-e869-47df-9c15-bc2df160a6ea-delete_volume" released by "delete_volume" :: held 3.928s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:31:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-a5500eab-f880-4784-b0e2-cfe470e0a409 req-a1711597-de37-4278-8f80-1a26647898aa tempest-TestInstancesWithCinderVolumes-1584482579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:31:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-a5500eab-f880-4784-b0e2-cfe470e0a409 req-a1711597-de37-4278-8f80-1a26647898aa tempest-TestInstancesWithCinderVolumes-1584482579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:31:14 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f5b496-c911-41e9-a60a-3c63b39fdc63]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:31:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-a5500eab-f880-4784-b0e2-cfe470e0a409 req-a1711597-de37-4278-8f80-1a26647898aa tempest-TestInstancesWithCinderVolumes-1584482579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f0287ea-82f4-435e-96a5-dca064e0e7d0 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:14 devstack sudo[95472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f0287ea-82f4-435e-96a5-dca064e0e7d0 Jul 11 04:31:14 devstack sudo[95472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:15 devstack sudo[95472]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-a5500eab-f880-4784-b0e2-cfe470e0a409 req-a1711597-de37-4278-8f80-1a26647898aa tempest-TestInstancesWithCinderVolumes-1584482579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f0287ea-82f4-435e-96a5-dca064e0e7d0" returned: 0 in 1.467s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-a5500eab-f880-4784-b0e2-cfe470e0a409 req-a1711597-de37-4278-8f80-1a26647898aa tempest-TestInstancesWithCinderVolumes-1584482579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.521s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:31:15 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-a5500eab-f880-4784-b0e2-cfe470e0a409 req-a1711597-de37-4278-8f80-1a26647898aa tempest-TestInstancesWithCinderVolumes-1584482579 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95', 'name': 'volume-9f0287ea-82f4-435e-96a5-dca064e0e7d0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '59d5a292-d545-47d9-99aa-f4d7b2e53622', 'enforce_multipath': True} {{(pid=86964) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 04:31:15 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-a5500eab-f880-4784-b0e2-cfe470e0a409 req-a1711597-de37-4278-8f80-1a26647898aa tempest-TestInstancesWithCinderVolumes-1584482579 None] attachment_update completed successfully. Jul 11 04:31:19 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e04ed36-9e49-4672-99ee-e20badc57928 tempest-SnapshotsActionsTest-1830448284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:31:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2e04ed36-9e49-4672-99ee-e20badc57928 tempest-SnapshotsActionsTest-1830448284 None] Flow 'volume_create_manager' (a3ee89ff-2355-4c34-8a9c-3ea3c2287878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:31:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2e04ed36-9e49-4672-99ee-e20badc57928 tempest-SnapshotsActionsTest-1830448284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e11550-d0d1-4614-b37b-8183326af01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:31:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2e04ed36-9e49-4672-99ee-e20badc57928 tempest-SnapshotsActionsTest-1830448284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e11550-d0d1-4614-b37b-8183326af01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1802036304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8d305ce-c341-4981-a324-0974b0d97923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e61b831f577a4334b5597abd960f6fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:31:19Z,use_quota=True,user_id='5b11436a999347cc83da9dba74f4ed1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:31:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2e04ed36-9e49-4672-99ee-e20badc57928 tempest-SnapshotsActionsTest-1830448284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be7db42-07e3-4a47-a5c5-aed4d6a47998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:31:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2e04ed36-9e49-4672-99ee-e20badc57928 tempest-SnapshotsActionsTest-1830448284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be7db42-07e3-4a47-a5c5-aed4d6a47998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:31:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2e04ed36-9e49-4672-99ee-e20badc57928 tempest-SnapshotsActionsTest-1830448284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b75072c8-5875-4137-a4dd-addea6ff9634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:31:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2e04ed36-9e49-4672-99ee-e20badc57928 tempest-SnapshotsActionsTest-1830448284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b75072c8-5875-4137-a4dd-addea6ff9634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8d305ce-c341-4981-a324-0974b0d97923', 'volume_name': 'volume-f8d305ce-c341-4981-a324-0974b0d97923', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:31:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2e04ed36-9e49-4672-99ee-e20badc57928 tempest-SnapshotsActionsTest-1830448284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee55fc2d-a526-4092-b596-9acbdb8ba52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:31:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2e04ed36-9e49-4672-99ee-e20badc57928 tempest-SnapshotsActionsTest-1830448284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee55fc2d-a526-4092-b596-9acbdb8ba52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:31:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2e04ed36-9e49-4672-99ee-e20badc57928 tempest-SnapshotsActionsTest-1830448284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fddb7e00-62c9-47c0-ae68-44c837043170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:31:19 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-2e04ed36-9e49-4672-99ee-e20badc57928 tempest-SnapshotsActionsTest-1830448284 None] Volume f8d305ce-c341-4981-a324-0974b0d97923: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8d305ce-c341-4981-a324-0974b0d97923', 'volume_size': 1} Jul 11 04:31:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2e04ed36-9e49-4672-99ee-e20badc57928 tempest-SnapshotsActionsTest-1830448284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:31:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2e04ed36-9e49-4672-99ee-e20badc57928 tempest-SnapshotsActionsTest-1830448284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:31:19 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2e04ed36-9e49-4672-99ee-e20badc57928 tempest-SnapshotsActionsTest-1830448284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1802036304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8d305ce-c341-4981-a324-0974b0d97923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e61b831f577a4334b5597abd960f6fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:31:19Z,use_quota=True,user_id='5b11436a999347cc83da9dba74f4ed1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:31:19 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-2e04ed36-9e49-4672-99ee-e20badc57928 tempest-SnapshotsActionsTest-1830448284 None] Creating volume f8d305ce-c341-4981-a324-0974b0d97923 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:31:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2e04ed36-9e49-4672-99ee-e20badc57928 tempest-SnapshotsActionsTest-1830448284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:31:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2e04ed36-9e49-4672-99ee-e20badc57928 tempest-SnapshotsActionsTest-1830448284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:31:19 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2e04ed36-9e49-4672-99ee-e20badc57928 tempest-SnapshotsActionsTest-1830448284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:31:19 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2e04ed36-9e49-4672-99ee-e20badc57928 tempest-SnapshotsActionsTest-1830448284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:31:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2e04ed36-9e49-4672-99ee-e20badc57928 tempest-SnapshotsActionsTest-1830448284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:31:19 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2e04ed36-9e49-4672-99ee-e20badc57928 tempest-SnapshotsActionsTest-1830448284 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:31:19 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-2e04ed36-9e49-4672-99ee-e20badc57928 tempest-SnapshotsActionsTest-1830448284 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:31:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2e04ed36-9e49-4672-99ee-e20badc57928 tempest-SnapshotsActionsTest-1830448284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:19 devstack sudo[95526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923 1073741824 Jul 11 04:31:19 devstack sudo[95526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:20 devstack sudo[95526]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2e04ed36-9e49-4672-99ee-e20badc57928 tempest-SnapshotsActionsTest-1830448284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923 1073741824" returned: 0 in 1.237s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2e04ed36-9e49-4672-99ee-e20badc57928 tempest-SnapshotsActionsTest-1830448284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:20 devstack sudo[95576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923 Jul 11 04:31:20 devstack sudo[95576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:21 devstack sudo[95576]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2e04ed36-9e49-4672-99ee-e20badc57928 tempest-SnapshotsActionsTest-1830448284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923" returned: 0 in 0.816s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:21 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2e04ed36-9e49-4672-99ee-e20badc57928 tempest-SnapshotsActionsTest-1830448284 None] <== create_volume: return (2112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:31:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2e04ed36-9e49-4672-99ee-e20badc57928 tempest-SnapshotsActionsTest-1830448284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.114s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:31:21 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2e04ed36-9e49-4672-99ee-e20badc57928 tempest-SnapshotsActionsTest-1830448284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fddb7e00-62c9-47c0-ae68-44c837043170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8d305ce-c341-4981-a324-0974b0d97923', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:31:21 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2e04ed36-9e49-4672-99ee-e20badc57928 tempest-SnapshotsActionsTest-1830448284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fce1382-d397-4c77-8662-83f553ddb7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:31:21 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-2e04ed36-9e49-4672-99ee-e20badc57928 tempest-SnapshotsActionsTest-1830448284 None] Volume volume-f8d305ce-c341-4981-a324-0974b0d97923 (f8d305ce-c341-4981-a324-0974b0d97923): created successfully Jul 11 04:31:21 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2e04ed36-9e49-4672-99ee-e20badc57928 tempest-SnapshotsActionsTest-1830448284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fce1382-d397-4c77-8662-83f553ddb7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:31:21 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2e04ed36-9e49-4672-99ee-e20badc57928 tempest-SnapshotsActionsTest-1830448284 None] Flow 'volume_create_manager' (a3ee89ff-2355-4c34-8a9c-3ea3c2287878) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:31:21 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-2e04ed36-9e49-4672-99ee-e20badc57928 tempest-SnapshotsActionsTest-1830448284 None] Created volume successfully. Jul 11 04:31:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5dccd1e1-fded-4390-87f9-ddebadf270a9 tempest-SnapshotsActionsTest-1830448284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:31:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5dccd1e1-fded-4390-87f9-ddebadf270a9 tempest-SnapshotsActionsTest-1830448284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:31:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-5dccd1e1-fded-4390-87f9-ddebadf270a9 tempest-SnapshotsActionsTest-1830448284 None] Creating offline snapshot c44d6217-2cbf-428a-889f-3b4cca0ea96c of volume f8d305ce-c341-4981-a324-0974b0d97923 {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:31:22 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[990a1288-4827-401e-b668-cde1305025ab]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:31:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5dccd1e1-fded-4390-87f9-ddebadf270a9 tempest-SnapshotsActionsTest-1830448284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:22 devstack sudo[95613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923 Jul 11 04:31:22 devstack sudo[95613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:23 devstack sudo[95613]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5dccd1e1-fded-4390-87f9-ddebadf270a9 tempest-SnapshotsActionsTest-1830448284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923" returned: 0 in 0.987s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5dccd1e1-fded-4390-87f9-ddebadf270a9 tempest-SnapshotsActionsTest-1830448284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:23 devstack sudo[95634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c 1G Jul 11 04:31:23 devstack sudo[95634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:24 devstack sudo[95634]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5dccd1e1-fded-4390-87f9-ddebadf270a9 tempest-SnapshotsActionsTest-1830448284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c 1G" returned: 0 in 0.921s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5dccd1e1-fded-4390-87f9-ddebadf270a9 tempest-SnapshotsActionsTest-1830448284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8d305ce-c341-4981-a324-0974b0d97923 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:24 devstack sudo[95643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8d305ce-c341-4981-a324-0974b0d97923 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c Jul 11 04:31:24 devstack sudo[95643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:25 devstack sudo[95643]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5dccd1e1-fded-4390-87f9-ddebadf270a9 tempest-SnapshotsActionsTest-1830448284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8d305ce-c341-4981-a324-0974b0d97923 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c" returned: 0 in 0.986s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:25 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-5dccd1e1-fded-4390-87f9-ddebadf270a9 tempest-SnapshotsActionsTest-1830448284 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c is being set with open permissions: ugo+rw Jul 11 04:31:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5dccd1e1-fded-4390-87f9-ddebadf270a9 tempest-SnapshotsActionsTest-1830448284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:25 devstack sudo[95649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c Jul 11 04:31:25 devstack sudo[95649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:25 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:UPDATE=93,cinder:SELECT=70,cinder:INSERT=19,cinder:DELETE=4 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:31:25 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-420b9b6d-29b1-4b14-a938-ec9773c9a762 req-b2d28817-fb4d-4e59-b335-2b29445d1458 tempest-TestInstancesWithCinderVolumes-1584482579 None] Terminate volume connection completed successfully. Jul 11 04:31:25 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-420b9b6d-29b1-4b14-a938-ec9773c9a762 req-b2d28817-fb4d-4e59-b335-2b29445d1458 tempest-TestInstancesWithCinderVolumes-1584482579 None] Deleting attachment ea32b654-5872-4d0b-b411-d34fe7d58894. {{(pid=86964) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 04:31:26 devstack sudo[95649]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5dccd1e1-fded-4390-87f9-ddebadf270a9 tempest-SnapshotsActionsTest-1830448284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c" returned: 0 in 1.094s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5dccd1e1-fded-4390-87f9-ddebadf270a9 tempest-SnapshotsActionsTest-1830448284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:26 devstack sudo[95657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.info Jul 11 04:31:26 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:27 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5dccd1e1-fded-4390-87f9-ddebadf270a9 tempest-SnapshotsActionsTest-1830448284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.info" returned: 0 in 0.731s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:27 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-5dccd1e1-fded-4390-87f9-ddebadf270a9 tempest-SnapshotsActionsTest-1830448284 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.info is being set with open permissions: ugo+rw Jul 11 04:31:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5dccd1e1-fded-4390-87f9-ddebadf270a9 tempest-SnapshotsActionsTest-1830448284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:27 devstack sudo[95660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.info Jul 11 04:31:27 devstack sudo[95660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:27 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-600153de-f68d-478d-86f0-f96923e71d0a tempest-TestInstancesWithCinderVolumes-1584482579 None] Acquiring lock "cinder-24061528-da9f-4b35-abc7-63fcb9272923-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:31:27 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-600153de-f68d-478d-86f0-f96923e71d0a tempest-TestInstancesWithCinderVolumes-1584482579 None] Lock "cinder-24061528-da9f-4b35-abc7-63fcb9272923-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:31:27 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-600153de-f68d-478d-86f0-f96923e71d0a tempest-TestInstancesWithCinderVolumes-1584482579 None] Acquiring lock "cinder-quobyte-24061528-da9f-4b35-abc7-63fcb9272923" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:31:27 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-600153de-f68d-478d-86f0-f96923e71d0a tempest-TestInstancesWithCinderVolumes-1584482579 None] Lock "cinder-quobyte-24061528-da9f-4b35-abc7-63fcb9272923" acquired by "delete_volume" :: waited 0.033s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:31:27 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[488a0190-d124-4f07-88e3-1f35f267359f]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:31:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-600153de-f68d-478d-86f0-f96923e71d0a tempest-TestInstancesWithCinderVolumes-1584482579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-24061528-da9f-4b35-abc7-63fcb9272923 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:28 devstack sudo[95666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-24061528-da9f-4b35-abc7-63fcb9272923 Jul 11 04:31:28 devstack sudo[95666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:28 devstack sudo[95660]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5dccd1e1-fded-4390-87f9-ddebadf270a9 tempest-SnapshotsActionsTest-1830448284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.info" returned: 0 in 0.903s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5dccd1e1-fded-4390-87f9-ddebadf270a9 tempest-SnapshotsActionsTest-1830448284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.760s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:31:28 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-5dccd1e1-fded-4390-87f9-ddebadf270a9 tempest-SnapshotsActionsTest-1830448284 None] Create snapshot completed successfully Jul 11 04:31:29 devstack sudo[95666]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-600153de-f68d-478d-86f0-f96923e71d0a tempest-TestInstancesWithCinderVolumes-1584482579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-24061528-da9f-4b35-abc7-63fcb9272923" returned: 0 in 1.279s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-600153de-f68d-478d-86f0-f96923e71d0a tempest-TestInstancesWithCinderVolumes-1584482579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-24061528-da9f-4b35-abc7-63fcb9272923 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:29 devstack sudo[95673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-24061528-da9f-4b35-abc7-63fcb9272923 Jul 11 04:31:29 devstack sudo[95673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-bdd52f0c-dda1-46cf-8cac-429876154fa6 tempest-SnapshotsActionsTest-1830448284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:31:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-bdd52f0c-dda1-46cf-8cac-429876154fa6 tempest-SnapshotsActionsTest-1830448284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:31:29 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-bdd52f0c-dda1-46cf-8cac-429876154fa6 tempest-SnapshotsActionsTest-1830448284 None] Creating offline snapshot bd0ffbde-af40-4b72-86b3-d8a259e2ff97 of volume f8d305ce-c341-4981-a324-0974b0d97923 {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:31:29 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5c3fb3-3b29-4f31-8c8d-843310b0b423]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:31:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bdd52f0c-dda1-46cf-8cac-429876154fa6 tempest-SnapshotsActionsTest-1830448284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:30 devstack sudo[95676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c Jul 11 04:31:30 devstack sudo[95676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:30 devstack sudo[95673]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-600153de-f68d-478d-86f0-f96923e71d0a tempest-TestInstancesWithCinderVolumes-1584482579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-24061528-da9f-4b35-abc7-63fcb9272923" returned: 0 in 1.172s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:30 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-600153de-f68d-478d-86f0-f96923e71d0a tempest-TestInstancesWithCinderVolumes-1584482579 None] Lock "cinder-quobyte-24061528-da9f-4b35-abc7-63fcb9272923" released by "delete_volume" :: held 2.543s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:31:30 devstack cinder-volume[86964]: WARNING cinder.quota [None req-600153de-f68d-478d-86f0-f96923e71d0a tempest-TestInstancesWithCinderVolumes-1584482579 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-575661019-488400317 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-575661019-488400317, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:31:30 devstack cinder-volume[86964]: WARNING cinder.quota [None req-600153de-f68d-478d-86f0-f96923e71d0a tempest-TestInstancesWithCinderVolumes-1584482579 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-575661019-488400317 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-575661019-488400317, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:31:30 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-600153de-f68d-478d-86f0-f96923e71d0a tempest-TestInstancesWithCinderVolumes-1584482579 None] Created reservations ['a29a9ad7-d652-4f5f-bb22-7d9f0643b4da', '4164584b-e5e2-4012-bfa6-66136f1c445c', '5f936eb8-c492-4c67-bbf4-8aeb4678cb03', '7955ba25-323f-4b72-9edc-36169652b0b1'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:31:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-600153de-f68d-478d-86f0-f96923e71d0a tempest-TestInstancesWithCinderVolumes-1584482579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:31:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-600153de-f68d-478d-86f0-f96923e71d0a tempest-TestInstancesWithCinderVolumes-1584482579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:31:30 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-600153de-f68d-478d-86f0-f96923e71d0a tempest-TestInstancesWithCinderVolumes-1584482579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:31:30 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-600153de-f68d-478d-86f0-f96923e71d0a tempest-TestInstancesWithCinderVolumes-1584482579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:31:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-600153de-f68d-478d-86f0-f96923e71d0a tempest-TestInstancesWithCinderVolumes-1584482579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:31:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-600153de-f68d-478d-86f0-f96923e71d0a tempest-TestInstancesWithCinderVolumes-1584482579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:30 devstack sudo[95683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:31:30 devstack sudo[95683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:30 devstack sudo[95676]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bdd52f0c-dda1-46cf-8cac-429876154fa6 tempest-SnapshotsActionsTest-1830448284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c" returned: 0 in 0.981s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:30 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-bdd52f0c-dda1-46cf-8cac-429876154fa6 tempest-SnapshotsActionsTest-1830448284 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8d305ce-c341-4981-a324-0974b0d97923(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:31:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bdd52f0c-dda1-46cf-8cac-429876154fa6 tempest-SnapshotsActionsTest-1830448284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.bd0ffbde-af40-4b72-86b3-d8a259e2ff97 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:30 devstack sudo[95694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.bd0ffbde-af40-4b72-86b3-d8a259e2ff97 1G Jul 11 04:31:30 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:31 devstack sudo[95683]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-600153de-f68d-478d-86f0-f96923e71d0a tempest-TestInstancesWithCinderVolumes-1584482579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.986s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:31 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-600153de-f68d-478d-86f0-f96923e71d0a tempest-TestInstancesWithCinderVolumes-1584482579 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:31:31 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-600153de-f68d-478d-86f0-f96923e71d0a tempest-TestInstancesWithCinderVolumes-1584482579 None] Deleted volume successfully. Jul 11 04:31:31 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-600153de-f68d-478d-86f0-f96923e71d0a tempest-TestInstancesWithCinderVolumes-1584482579 None] Lock "cinder-24061528-da9f-4b35-abc7-63fcb9272923-delete_volume" released by "delete_volume" :: held 3.965s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:31:31 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bdd52f0c-dda1-46cf-8cac-429876154fa6 tempest-SnapshotsActionsTest-1830448284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.bd0ffbde-af40-4b72-86b3-d8a259e2ff97 1G" returned: 0 in 1.046s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bdd52f0c-dda1-46cf-8cac-429876154fa6 tempest-SnapshotsActionsTest-1830448284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.bd0ffbde-af40-4b72-86b3-d8a259e2ff97 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:31 devstack sudo[95713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.bd0ffbde-af40-4b72-86b3-d8a259e2ff97 Jul 11 04:31:31 devstack sudo[95713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:32 devstack sudo[95713]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bdd52f0c-dda1-46cf-8cac-429876154fa6 tempest-SnapshotsActionsTest-1830448284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.bd0ffbde-af40-4b72-86b3-d8a259e2ff97" returned: 0 in 0.812s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:32 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-bdd52f0c-dda1-46cf-8cac-429876154fa6 tempest-SnapshotsActionsTest-1830448284 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.bd0ffbde-af40-4b72-86b3-d8a259e2ff97 is being set with open permissions: ugo+rw Jul 11 04:31:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bdd52f0c-dda1-46cf-8cac-429876154fa6 tempest-SnapshotsActionsTest-1830448284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.bd0ffbde-af40-4b72-86b3-d8a259e2ff97 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:32 devstack sudo[95719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.bd0ffbde-af40-4b72-86b3-d8a259e2ff97 Jul 11 04:31:32 devstack sudo[95719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:33 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-dc21fa2e-4149-49ad-8102-757ac2c4f33f req-8ce02f94-d4c4-4c28-913f-503eb804f1b7 tempest-TestInstancesWithCinderVolumes-1584482579 None] Terminate volume connection completed successfully. Jul 11 04:31:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-dc21fa2e-4149-49ad-8102-757ac2c4f33f req-8ce02f94-d4c4-4c28-913f-503eb804f1b7 tempest-TestInstancesWithCinderVolumes-1584482579 None] Deleting attachment 59d5a292-d545-47d9-99aa-f4d7b2e53622. {{(pid=86964) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 04:31:33 devstack sudo[95719]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bdd52f0c-dda1-46cf-8cac-429876154fa6 tempest-SnapshotsActionsTest-1830448284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.bd0ffbde-af40-4b72-86b3-d8a259e2ff97" returned: 0 in 0.815s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:33 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=80,cinder:UPDATE=66,cinder:INSERT=16,cinder:DELETE=1 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:31:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-bdd52f0c-dda1-46cf-8cac-429876154fa6 tempest-SnapshotsActionsTest-1830448284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.782s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:31:33 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-bdd52f0c-dda1-46cf-8cac-429876154fa6 tempest-SnapshotsActionsTest-1830448284 None] Create snapshot completed successfully Jul 11 04:31:34 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-36b757f7-138a-462d-8cc9-e8db3c648bd7 tempest-GroupSnapshotsV319Test-596481927 None] Group tempest-GroupSnapshotsV319Test-Group-24091641: creating Jul 11 04:31:34 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-36b757f7-138a-462d-8cc9-e8db3c648bd7 tempest-GroupSnapshotsV319Test-596481927 None] Group tempest-GroupSnapshotsV319Test-Group-24091641: created successfully Jul 11 04:31:34 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-36b757f7-138a-462d-8cc9-e8db3c648bd7 tempest-GroupSnapshotsV319Test-596481927 None] Create group completed successfully. Jul 11 04:31:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-02082241-b17b-4903-8dfb-37082cd4b60a tempest-SnapshotsActionsTest-816521708 None] Acquiring lock "cinder-bd0ffbde-af40-4b72-86b3-d8a259e2ff97-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:31:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-02082241-b17b-4903-8dfb-37082cd4b60a tempest-SnapshotsActionsTest-816521708 None] Lock "cinder-bd0ffbde-af40-4b72-86b3-d8a259e2ff97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:31:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-02082241-b17b-4903-8dfb-37082cd4b60a tempest-SnapshotsActionsTest-816521708 None] Acquiring lock "cinder-quobyte-f8d305ce-c341-4981-a324-0974b0d97923" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:31:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-02082241-b17b-4903-8dfb-37082cd4b60a tempest-SnapshotsActionsTest-816521708 None] Lock "cinder-quobyte-f8d305ce-c341-4981-a324-0974b0d97923" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:31:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-02082241-b17b-4903-8dfb-37082cd4b60a tempest-SnapshotsActionsTest-816521708 None] Acquiring lock "cinder-quobyte-bd0ffbde-af40-4b72-86b3-d8a259e2ff97" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:31:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-02082241-b17b-4903-8dfb-37082cd4b60a tempest-SnapshotsActionsTest-816521708 None] Lock "cinder-quobyte-bd0ffbde-af40-4b72-86b3-d8a259e2ff97" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:31:34 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-02082241-b17b-4903-8dfb-37082cd4b60a tempest-SnapshotsActionsTest-816521708 None] Deleting offline snapshot bd0ffbde-af40-4b72-86b3-d8a259e2ff97 of volume f8d305ce-c341-4981-a324-0974b0d97923 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:31:34 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-02082241-b17b-4903-8dfb-37082cd4b60a tempest-SnapshotsActionsTest-816521708 None] snapshot_file for this snap is: volume-f8d305ce-c341-4981-a324-0974b0d97923.bd0ffbde-af40-4b72-86b3-d8a259e2ff97 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:31:34 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[492bd582-1c88-4914-98f3-ffbefaf564af]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:31:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-02082241-b17b-4903-8dfb-37082cd4b60a tempest-SnapshotsActionsTest-816521708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.bd0ffbde-af40-4b72-86b3-d8a259e2ff97 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:34 devstack sudo[95725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.bd0ffbde-af40-4b72-86b3-d8a259e2ff97 Jul 11 04:31:34 devstack sudo[95725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:35 devstack sudo[95725]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-02082241-b17b-4903-8dfb-37082cd4b60a tempest-SnapshotsActionsTest-816521708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.bd0ffbde-af40-4b72-86b3-d8a259e2ff97" returned: 0 in 0.790s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:35 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-02082241-b17b-4903-8dfb-37082cd4b60a tempest-SnapshotsActionsTest-816521708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8d305ce-c341-4981-a324-0974b0d97923(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:31:35 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c56e0e-11fe-46ea-be2f-d3a758ef78ac]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:31:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-02082241-b17b-4903-8dfb-37082cd4b60a tempest-SnapshotsActionsTest-816521708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:35 devstack sudo[95751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c Jul 11 04:31:35 devstack sudo[95751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:35 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-db9dcece-a489-47c8-b69c-694675d07cb8 tempest-TestInstancesWithCinderVolumes-1584482579 None] Acquiring lock "cinder-9f0287ea-82f4-435e-96a5-dca064e0e7d0-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:31:35 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-db9dcece-a489-47c8-b69c-694675d07cb8 tempest-TestInstancesWithCinderVolumes-1584482579 None] Lock "cinder-9f0287ea-82f4-435e-96a5-dca064e0e7d0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:31:35 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-db9dcece-a489-47c8-b69c-694675d07cb8 tempest-TestInstancesWithCinderVolumes-1584482579 None] Acquiring lock "cinder-quobyte-9f0287ea-82f4-435e-96a5-dca064e0e7d0" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:31:35 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-db9dcece-a489-47c8-b69c-694675d07cb8 tempest-TestInstancesWithCinderVolumes-1584482579 None] Lock "cinder-quobyte-9f0287ea-82f4-435e-96a5-dca064e0e7d0" acquired by "delete_volume" :: waited 0.023s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:31:35 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8da725-9161-4fa6-9897-f0c3c8f19f5f]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:31:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-db9dcece-a489-47c8-b69c-694675d07cb8 tempest-TestInstancesWithCinderVolumes-1584482579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f0287ea-82f4-435e-96a5-dca064e0e7d0 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:35 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c215e50-ed99-4d95-a076-564f31a65b53 tempest-GroupSnapshotsV319Test-596481927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:31:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6c215e50-ed99-4d95-a076-564f31a65b53 tempest-GroupSnapshotsV319Test-596481927 None] Flow 'volume_create_manager' (dc6db6f5-26ba-4727-bd2e-06dc582cd130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:31:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6c215e50-ed99-4d95-a076-564f31a65b53 tempest-GroupSnapshotsV319Test-596481927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5804c8cd-3fca-486f-b687-52e3eeaeb52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:31:35 devstack sudo[95754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f0287ea-82f4-435e-96a5-dca064e0e7d0 Jul 11 04:31:35 devstack sudo[95754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6c215e50-ed99-4d95-a076-564f31a65b53 tempest-GroupSnapshotsV319Test-596481927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5804c8cd-3fca-486f-b687-52e3eeaeb52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1219731851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0b5364a0-877a-456c-9e6f-a34a5f8b2cbe,host='devstack@QuobyteHD#QuobyteHD',id=c5dc9fc5-dbdb-4a30-b813-511ad4ea8363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='240bef9a66ad4d0fb8b4c3df50527b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:31:36Z,use_quota=True,user_id='e847ccb4c0cb49f7b2b2a1414886844a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c811eaf-9325-4650-ad36-658c8e4dbe5b),volume_type_id=0c811eaf-9325-4650-ad36-658c8e4dbe5b)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:31:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6c215e50-ed99-4d95-a076-564f31a65b53 tempest-GroupSnapshotsV319Test-596481927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (324bf624-870b-448f-894c-c4c584f0a4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:31:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6c215e50-ed99-4d95-a076-564f31a65b53 tempest-GroupSnapshotsV319Test-596481927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (324bf624-870b-448f-894c-c4c584f0a4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:31:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6c215e50-ed99-4d95-a076-564f31a65b53 tempest-GroupSnapshotsV319Test-596481927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49bcb2df-d63c-4eda-95ce-d9879df691fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:31:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6c215e50-ed99-4d95-a076-564f31a65b53 tempest-GroupSnapshotsV319Test-596481927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49bcb2df-d63c-4eda-95ce-d9879df691fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5dc9fc5-dbdb-4a30-b813-511ad4ea8363', 'volume_name': 'volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:31:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6c215e50-ed99-4d95-a076-564f31a65b53 tempest-GroupSnapshotsV319Test-596481927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (166e9544-19b1-4f8b-9eb0-25e4739f568b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:31:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6c215e50-ed99-4d95-a076-564f31a65b53 tempest-GroupSnapshotsV319Test-596481927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (166e9544-19b1-4f8b-9eb0-25e4739f568b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:31:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6c215e50-ed99-4d95-a076-564f31a65b53 tempest-GroupSnapshotsV319Test-596481927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b06e2890-b40a-4dc1-9ef6-355bfa4716d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:31:35 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-6c215e50-ed99-4d95-a076-564f31a65b53 tempest-GroupSnapshotsV319Test-596481927 None] Volume c5dc9fc5-dbdb-4a30-b813-511ad4ea8363: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363', 'volume_size': 1} Jul 11 04:31:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6c215e50-ed99-4d95-a076-564f31a65b53 tempest-GroupSnapshotsV319Test-596481927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:31:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6c215e50-ed99-4d95-a076-564f31a65b53 tempest-GroupSnapshotsV319Test-596481927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:31:35 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6c215e50-ed99-4d95-a076-564f31a65b53 tempest-GroupSnapshotsV319Test-596481927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0b5364a0-877a-456c-9e6f-a34a5f8b2cbe,created_at=2026-07-11T02:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1219731851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0b5364a0-877a-456c-9e6f-a34a5f8b2cbe,host='devstack@QuobyteHD#QuobyteHD',id=c5dc9fc5-dbdb-4a30-b813-511ad4ea8363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='240bef9a66ad4d0fb8b4c3df50527b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:31:36Z,use_quota=True,user_id='e847ccb4c0cb49f7b2b2a1414886844a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c811eaf-9325-4650-ad36-658c8e4dbe5b),volume_type_id=0c811eaf-9325-4650-ad36-658c8e4dbe5b)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:31:35 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-6c215e50-ed99-4d95-a076-564f31a65b53 tempest-GroupSnapshotsV319Test-596481927 None] Creating volume c5dc9fc5-dbdb-4a30-b813-511ad4ea8363 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:31:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6c215e50-ed99-4d95-a076-564f31a65b53 tempest-GroupSnapshotsV319Test-596481927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:31:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6c215e50-ed99-4d95-a076-564f31a65b53 tempest-GroupSnapshotsV319Test-596481927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:31:35 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6c215e50-ed99-4d95-a076-564f31a65b53 tempest-GroupSnapshotsV319Test-596481927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:31:35 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6c215e50-ed99-4d95-a076-564f31a65b53 tempest-GroupSnapshotsV319Test-596481927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:31:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6c215e50-ed99-4d95-a076-564f31a65b53 tempest-GroupSnapshotsV319Test-596481927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:31:35 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6c215e50-ed99-4d95-a076-564f31a65b53 tempest-GroupSnapshotsV319Test-596481927 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:31:35 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-6c215e50-ed99-4d95-a076-564f31a65b53 tempest-GroupSnapshotsV319Test-596481927 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:31:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6c215e50-ed99-4d95-a076-564f31a65b53 tempest-GroupSnapshotsV319Test-596481927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:36 devstack sudo[95756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363 1073741824 Jul 11 04:31:36 devstack sudo[95756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:36 devstack sudo[95751]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-02082241-b17b-4903-8dfb-37082cd4b60a tempest-SnapshotsActionsTest-816521708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c" returned: 0 in 1.129s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-02082241-b17b-4903-8dfb-37082cd4b60a tempest-SnapshotsActionsTest-816521708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8d305ce-c341-4981-a324-0974b0d97923(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:31:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-02082241-b17b-4903-8dfb-37082cd4b60a tempest-SnapshotsActionsTest-816521708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.bd0ffbde-af40-4b72-86b3-d8a259e2ff97 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:36 devstack sudo[95761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.bd0ffbde-af40-4b72-86b3-d8a259e2ff97 Jul 11 04:31:36 devstack sudo[95761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:36 devstack sudo[95754]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-db9dcece-a489-47c8-b69c-694675d07cb8 tempest-TestInstancesWithCinderVolumes-1584482579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f0287ea-82f4-435e-96a5-dca064e0e7d0" returned: 0 in 0.931s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-db9dcece-a489-47c8-b69c-694675d07cb8 tempest-TestInstancesWithCinderVolumes-1584482579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f0287ea-82f4-435e-96a5-dca064e0e7d0 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:36 devstack sudo[95773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f0287ea-82f4-435e-96a5-dca064e0e7d0 Jul 11 04:31:36 devstack sudo[95773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:37 devstack sudo[95756]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6c215e50-ed99-4d95-a076-564f31a65b53 tempest-GroupSnapshotsV319Test-596481927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363 1073741824" returned: 0 in 1.142s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6c215e50-ed99-4d95-a076-564f31a65b53 tempest-GroupSnapshotsV319Test-596481927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:37 devstack sudo[95780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363 Jul 11 04:31:37 devstack sudo[95780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:37 devstack sudo[95761]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-02082241-b17b-4903-8dfb-37082cd4b60a tempest-SnapshotsActionsTest-816521708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.bd0ffbde-af40-4b72-86b3-d8a259e2ff97" returned: 0 in 0.973s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-02082241-b17b-4903-8dfb-37082cd4b60a tempest-SnapshotsActionsTest-816521708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.bd0ffbde-af40-4b72-86b3-d8a259e2ff97 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:37 devstack sudo[95783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.bd0ffbde-af40-4b72-86b3-d8a259e2ff97 Jul 11 04:31:37 devstack sudo[95783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:37 devstack sudo[95773]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-db9dcece-a489-47c8-b69c-694675d07cb8 tempest-TestInstancesWithCinderVolumes-1584482579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f0287ea-82f4-435e-96a5-dca064e0e7d0" returned: 0 in 0.714s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:37 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-db9dcece-a489-47c8-b69c-694675d07cb8 tempest-TestInstancesWithCinderVolumes-1584482579 None] Lock "cinder-quobyte-9f0287ea-82f4-435e-96a5-dca064e0e7d0" released by "delete_volume" :: held 1.729s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:31:37 devstack cinder-volume[86964]: WARNING cinder.quota [None req-db9dcece-a489-47c8-b69c-694675d07cb8 tempest-TestInstancesWithCinderVolumes-1584482579 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-552904797-452355604 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-552904797-452355604, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:31:37 devstack cinder-volume[86964]: WARNING cinder.quota [None req-db9dcece-a489-47c8-b69c-694675d07cb8 tempest-TestInstancesWithCinderVolumes-1584482579 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-552904797-452355604 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-552904797-452355604, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:31:37 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-db9dcece-a489-47c8-b69c-694675d07cb8 tempest-TestInstancesWithCinderVolumes-1584482579 None] Created reservations ['81f82016-073c-485e-ae2b-1b7341a44bb0', 'b6ea82ae-9b05-449d-ada4-404ebcc9d901', '5754fae6-0e55-4d7a-b8c8-92f176d8c492', 'ea587e40-e10d-49c7-b588-575efea0a686'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:31:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-db9dcece-a489-47c8-b69c-694675d07cb8 tempest-TestInstancesWithCinderVolumes-1584482579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:31:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-db9dcece-a489-47c8-b69c-694675d07cb8 tempest-TestInstancesWithCinderVolumes-1584482579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:31:37 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-db9dcece-a489-47c8-b69c-694675d07cb8 tempest-TestInstancesWithCinderVolumes-1584482579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:31:37 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-db9dcece-a489-47c8-b69c-694675d07cb8 tempest-TestInstancesWithCinderVolumes-1584482579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:31:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-db9dcece-a489-47c8-b69c-694675d07cb8 tempest-TestInstancesWithCinderVolumes-1584482579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:31:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-db9dcece-a489-47c8-b69c-694675d07cb8 tempest-TestInstancesWithCinderVolumes-1584482579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:37 devstack sudo[95785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:31:37 devstack sudo[95785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:38 devstack sudo[95780]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6c215e50-ed99-4d95-a076-564f31a65b53 tempest-GroupSnapshotsV319Test-596481927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363" returned: 0 in 0.838s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:38 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6c215e50-ed99-4d95-a076-564f31a65b53 tempest-GroupSnapshotsV319Test-596481927 None] <== create_volume: return (2043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:31:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6c215e50-ed99-4d95-a076-564f31a65b53 tempest-GroupSnapshotsV319Test-596481927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.045s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:31:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6c215e50-ed99-4d95-a076-564f31a65b53 tempest-GroupSnapshotsV319Test-596481927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b06e2890-b40a-4dc1-9ef6-355bfa4716d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:31:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6c215e50-ed99-4d95-a076-564f31a65b53 tempest-GroupSnapshotsV319Test-596481927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d97395a-8438-4153-a94a-68229796b12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:31:38 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-6c215e50-ed99-4d95-a076-564f31a65b53 tempest-GroupSnapshotsV319Test-596481927 None] Volume volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363 (c5dc9fc5-dbdb-4a30-b813-511ad4ea8363): created successfully Jul 11 04:31:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6c215e50-ed99-4d95-a076-564f31a65b53 tempest-GroupSnapshotsV319Test-596481927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d97395a-8438-4153-a94a-68229796b12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:31:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6c215e50-ed99-4d95-a076-564f31a65b53 tempest-GroupSnapshotsV319Test-596481927 None] Flow 'volume_create_manager' (dc6db6f5-26ba-4727-bd2e-06dc582cd130) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:31:38 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-6c215e50-ed99-4d95-a076-564f31a65b53 tempest-GroupSnapshotsV319Test-596481927 None] Created volume successfully. Jul 11 04:31:38 devstack sudo[95783]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-02082241-b17b-4903-8dfb-37082cd4b60a tempest-SnapshotsActionsTest-816521708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.bd0ffbde-af40-4b72-86b3-d8a259e2ff97" returned: 0 in 0.956s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:38 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-02082241-b17b-4903-8dfb-37082cd4b60a tempest-SnapshotsActionsTest-816521708 None] Lock "cinder-quobyte-bd0ffbde-af40-4b72-86b3-d8a259e2ff97" released by "_delete_snapshot" :: held 3.974s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:31:38 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-02082241-b17b-4903-8dfb-37082cd4b60a tempest-SnapshotsActionsTest-816521708 None] Lock "cinder-quobyte-f8d305ce-c341-4981-a324-0974b0d97923" released by "delete_snapshot" :: held 4.003s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:31:38 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-02082241-b17b-4903-8dfb-37082cd4b60a tempest-SnapshotsActionsTest-816521708 None] Created reservations ['eba5c5e7-6f6a-47b9-900b-551f1c8d44fc', '69484a7b-8a49-480b-a0ab-41a45f479102', '465fa532-4534-43a9-914a-04bdf96c177f', '12d36673-2efb-4ca9-8681-d96a8d97b9f6'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:31:38 devstack sudo[95785]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-db9dcece-a489-47c8-b69c-694675d07cb8 tempest-TestInstancesWithCinderVolumes-1584482579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.846s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:38 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-db9dcece-a489-47c8-b69c-694675d07cb8 tempest-TestInstancesWithCinderVolumes-1584482579 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:31:38 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-db9dcece-a489-47c8-b69c-694675d07cb8 tempest-TestInstancesWithCinderVolumes-1584482579 None] Deleted volume successfully. Jul 11 04:31:38 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-db9dcece-a489-47c8-b69c-694675d07cb8 tempest-TestInstancesWithCinderVolumes-1584482579 None] Lock "cinder-9f0287ea-82f4-435e-96a5-dca064e0e7d0-delete_volume" released by "delete_volume" :: held 2.901s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:31:38 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-02082241-b17b-4903-8dfb-37082cd4b60a tempest-SnapshotsActionsTest-816521708 None] Delete snapshot completed successfully. Jul 11 04:31:38 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-02082241-b17b-4903-8dfb-37082cd4b60a tempest-SnapshotsActionsTest-816521708 None] Lock "cinder-bd0ffbde-af40-4b72-86b3-d8a259e2ff97-delete_snapshot" released by "delete_snapshot" :: held 4.234s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:31:38 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-55a6719c-5f49-4212-8f48-49d08677b2a7 tempest-GroupSnapshotsV319Test-596481927 None] GroupSnapshot a3145f62-6cdc-4180-8067-3bf63dcff634: creating. Jul 11 04:31:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-55a6719c-5f49-4212-8f48-49d08677b2a7 tempest-GroupSnapshotsV319Test-596481927 None] Group snapshot a3145f62-6cdc-4180-8067-3bf63dcff634: creating. {{(pid=86964) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 11 04:31:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-55a6719c-5f49-4212-8f48-49d08677b2a7 tempest-GroupSnapshotsV319Test-596481927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:31:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-55a6719c-5f49-4212-8f48-49d08677b2a7 tempest-GroupSnapshotsV319Test-596481927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:31:38 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-55a6719c-5f49-4212-8f48-49d08677b2a7 tempest-GroupSnapshotsV319Test-596481927 None] Creating offline snapshot 01be5aad-c04b-4fc1-80c4-28e5cd08f8e4 of volume c5dc9fc5-dbdb-4a30-b813-511ad4ea8363 {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:31:38 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[269b14c5-635c-404f-93da-6dcf0c19a7d2]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:31:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-55a6719c-5f49-4212-8f48-49d08677b2a7 tempest-GroupSnapshotsV319Test-596481927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:38 devstack sudo[95793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363 Jul 11 04:31:38 devstack sudo[95793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e3175308-12ec-465c-9d97-ce1a31a17af4 tempest-SnapshotsActionsTest-1830448284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:31:39 devstack sudo[95793]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-55a6719c-5f49-4212-8f48-49d08677b2a7 tempest-GroupSnapshotsV319Test-596481927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363" returned: 0 in 0.822s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-55a6719c-5f49-4212-8f48-49d08677b2a7 tempest-GroupSnapshotsV319Test-596481927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363.01be5aad-c04b-4fc1-80c4-28e5cd08f8e4 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:39 devstack sudo[95798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363.01be5aad-c04b-4fc1-80c4-28e5cd08f8e4 1G Jul 11 04:31:39 devstack sudo[95798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:40 devstack sudo[95798]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-55a6719c-5f49-4212-8f48-49d08677b2a7 tempest-GroupSnapshotsV319Test-596481927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363.01be5aad-c04b-4fc1-80c4-28e5cd08f8e4 1G" returned: 0 in 0.798s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-55a6719c-5f49-4212-8f48-49d08677b2a7 tempest-GroupSnapshotsV319Test-596481927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363.01be5aad-c04b-4fc1-80c4-28e5cd08f8e4 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:40 devstack sudo[95807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363.01be5aad-c04b-4fc1-80c4-28e5cd08f8e4 Jul 11 04:31:40 devstack sudo[95807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:41 devstack sudo[95807]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-55a6719c-5f49-4212-8f48-49d08677b2a7 tempest-GroupSnapshotsV319Test-596481927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363.01be5aad-c04b-4fc1-80c4-28e5cd08f8e4" returned: 0 in 0.820s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:41 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-55a6719c-5f49-4212-8f48-49d08677b2a7 tempest-GroupSnapshotsV319Test-596481927 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363.01be5aad-c04b-4fc1-80c4-28e5cd08f8e4 is being set with open permissions: ugo+rw: NotImplementedError Jul 11 04:31:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-55a6719c-5f49-4212-8f48-49d08677b2a7 tempest-GroupSnapshotsV319Test-596481927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363.01be5aad-c04b-4fc1-80c4-28e5cd08f8e4 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:41 devstack sudo[95830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363.01be5aad-c04b-4fc1-80c4-28e5cd08f8e4 Jul 11 04:31:41 devstack sudo[95830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:42 devstack sudo[95830]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-55a6719c-5f49-4212-8f48-49d08677b2a7 tempest-GroupSnapshotsV319Test-596481927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363.01be5aad-c04b-4fc1-80c4-28e5cd08f8e4" returned: 0 in 0.737s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-55a6719c-5f49-4212-8f48-49d08677b2a7 tempest-GroupSnapshotsV319Test-596481927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:42 devstack sudo[95836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363.info Jul 11 04:31:42 devstack sudo[95836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:42 devstack sudo[95836]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-55a6719c-5f49-4212-8f48-49d08677b2a7 tempest-GroupSnapshotsV319Test-596481927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363.info" returned: 0 in 0.677s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:42 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-55a6719c-5f49-4212-8f48-49d08677b2a7 tempest-GroupSnapshotsV319Test-596481927 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363.info is being set with open permissions: ugo+rw: NotImplementedError Jul 11 04:31:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-55a6719c-5f49-4212-8f48-49d08677b2a7 tempest-GroupSnapshotsV319Test-596481927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:42 devstack sudo[95839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363.info Jul 11 04:31:42 devstack sudo[95839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:42 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-2713b867-714c-41de-8bb0-cd1dd0eedd3f req-90f32a96-6c0e-4d88-9669-af687077bada tempest-TestInstancesWithCinderVolumes-1584482579 None] Terminate volume connection completed successfully. Jul 11 04:31:42 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-2713b867-714c-41de-8bb0-cd1dd0eedd3f req-90f32a96-6c0e-4d88-9669-af687077bada tempest-TestInstancesWithCinderVolumes-1584482579 None] Deleting attachment 57e6e56c-f68e-457c-a9ef-9fd6bf58db44. {{(pid=86964) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 04:31:43 devstack sudo[95839]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-55a6719c-5f49-4212-8f48-49d08677b2a7 tempest-GroupSnapshotsV319Test-596481927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363.info" returned: 0 in 0.672s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-55a6719c-5f49-4212-8f48-49d08677b2a7 tempest-GroupSnapshotsV319Test-596481927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.623s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:31:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e3175308-12ec-465c-9d97-ce1a31a17af4 tempest-SnapshotsActionsTest-1830448284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.434s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:31:43 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-e3175308-12ec-465c-9d97-ce1a31a17af4 tempest-SnapshotsActionsTest-1830448284 None] Creating offline snapshot f1fb565c-5661-4ce4-b990-db49ff20ef12 of volume f8d305ce-c341-4981-a324-0974b0d97923 {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:31:43 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0666993-dbea-405e-8452-5a90d522fe82]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:31:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e3175308-12ec-465c-9d97-ce1a31a17af4 tempest-SnapshotsActionsTest-1830448284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:43 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-55a6719c-5f49-4212-8f48-49d08677b2a7 tempest-GroupSnapshotsV319Test-596481927 None] group_snapshot a3145f62-6cdc-4180-8067-3bf63dcff634: created successfully Jul 11 04:31:43 devstack sudo[95842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c Jul 11 04:31:43 devstack sudo[95842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:44 devstack sudo[95842]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e3175308-12ec-465c-9d97-ce1a31a17af4 tempest-SnapshotsActionsTest-1830448284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c" returned: 0 in 0.837s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:44 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-e3175308-12ec-465c-9d97-ce1a31a17af4 tempest-SnapshotsActionsTest-1830448284 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8d305ce-c341-4981-a324-0974b0d97923(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:31:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e3175308-12ec-465c-9d97-ce1a31a17af4 tempest-SnapshotsActionsTest-1830448284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.f1fb565c-5661-4ce4-b990-db49ff20ef12 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:44 devstack sudo[95848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.f1fb565c-5661-4ce4-b990-db49ff20ef12 1G Jul 11 04:31:44 devstack sudo[95848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:44 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-f365fe67-124e-4f27-8a43-2711a4ccc885 tempest-GroupSnapshotsV319Test-596481927 None] group_snapshot a3145f62-6cdc-4180-8067-3bf63dcff634: deleting Jul 11 04:31:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-f365fe67-124e-4f27-8a43-2711a4ccc885 tempest-GroupSnapshotsV319Test-596481927 None] group_snapshot a3145f62-6cdc-4180-8067-3bf63dcff634: deleting {{(pid=86964) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 11 04:31:44 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f365fe67-124e-4f27-8a43-2711a4ccc885 tempest-GroupSnapshotsV319Test-596481927 None] Acquiring lock "cinder-quobyte-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:31:44 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f365fe67-124e-4f27-8a43-2711a4ccc885 tempest-GroupSnapshotsV319Test-596481927 None] Lock "cinder-quobyte-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:31:44 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f365fe67-124e-4f27-8a43-2711a4ccc885 tempest-GroupSnapshotsV319Test-596481927 None] Acquiring lock "cinder-quobyte-01be5aad-c04b-4fc1-80c4-28e5cd08f8e4" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:31:44 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f365fe67-124e-4f27-8a43-2711a4ccc885 tempest-GroupSnapshotsV319Test-596481927 None] Lock "cinder-quobyte-01be5aad-c04b-4fc1-80c4-28e5cd08f8e4" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:31:44 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-f365fe67-124e-4f27-8a43-2711a4ccc885 tempest-GroupSnapshotsV319Test-596481927 None] Deleting offline snapshot 01be5aad-c04b-4fc1-80c4-28e5cd08f8e4 of volume c5dc9fc5-dbdb-4a30-b813-511ad4ea8363 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:31:44 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-f365fe67-124e-4f27-8a43-2711a4ccc885 tempest-GroupSnapshotsV319Test-596481927 None] snapshot_file for this snap is: volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363.01be5aad-c04b-4fc1-80c4-28e5cd08f8e4 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:31:44 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[63585a16-4e42-4d29-b1a9-e5b483bed225]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:31:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f365fe67-124e-4f27-8a43-2711a4ccc885 tempest-GroupSnapshotsV319Test-596481927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363.01be5aad-c04b-4fc1-80c4-28e5cd08f8e4 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:44 devstack sudo[95850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363.01be5aad-c04b-4fc1-80c4-28e5cd08f8e4 Jul 11 04:31:44 devstack sudo[95850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:45 devstack sudo[95848]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e3175308-12ec-465c-9d97-ce1a31a17af4 tempest-SnapshotsActionsTest-1830448284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.f1fb565c-5661-4ce4-b990-db49ff20ef12 1G" returned: 0 in 0.901s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e3175308-12ec-465c-9d97-ce1a31a17af4 tempest-SnapshotsActionsTest-1830448284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.f1fb565c-5661-4ce4-b990-db49ff20ef12 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:45 devstack sudo[95856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.f1fb565c-5661-4ce4-b990-db49ff20ef12 Jul 11 04:31:45 devstack sudo[95856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:45 devstack sudo[95850]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f365fe67-124e-4f27-8a43-2711a4ccc885 tempest-GroupSnapshotsV319Test-596481927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363.01be5aad-c04b-4fc1-80c4-28e5cd08f8e4" returned: 0 in 0.784s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-f365fe67-124e-4f27-8a43-2711a4ccc885 tempest-GroupSnapshotsV319Test-596481927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:31:45 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cee3318-deec-47b5-8570-b7470517f2e5]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:31:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f365fe67-124e-4f27-8a43-2711a4ccc885 tempest-GroupSnapshotsV319Test-596481927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:45 devstack sudo[95861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363 Jul 11 04:31:45 devstack sudo[95861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:46 devstack sudo[95856]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e3175308-12ec-465c-9d97-ce1a31a17af4 tempest-SnapshotsActionsTest-1830448284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.f1fb565c-5661-4ce4-b990-db49ff20ef12" returned: 0 in 0.752s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:46 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-e3175308-12ec-465c-9d97-ce1a31a17af4 tempest-SnapshotsActionsTest-1830448284 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.f1fb565c-5661-4ce4-b990-db49ff20ef12 is being set with open permissions: ugo+rw Jul 11 04:31:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e3175308-12ec-465c-9d97-ce1a31a17af4 tempest-SnapshotsActionsTest-1830448284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.f1fb565c-5661-4ce4-b990-db49ff20ef12 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:46 devstack sudo[95868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.f1fb565c-5661-4ce4-b990-db49ff20ef12 Jul 11 04:31:46 devstack sudo[95868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:46 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f3957f7d-0245-42f6-8702-a4d378b53827 tempest-TestInstancesWithCinderVolumes-1584482579 None] Acquiring lock "cinder-f61301cd-e7f6-4abe-82f4-7c87428bff50-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:31:46 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f3957f7d-0245-42f6-8702-a4d378b53827 tempest-TestInstancesWithCinderVolumes-1584482579 None] Lock "cinder-f61301cd-e7f6-4abe-82f4-7c87428bff50-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:31:46 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f3957f7d-0245-42f6-8702-a4d378b53827 tempest-TestInstancesWithCinderVolumes-1584482579 None] Acquiring lock "cinder-quobyte-f61301cd-e7f6-4abe-82f4-7c87428bff50" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:31:46 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f3957f7d-0245-42f6-8702-a4d378b53827 tempest-TestInstancesWithCinderVolumes-1584482579 None] Lock "cinder-quobyte-f61301cd-e7f6-4abe-82f4-7c87428bff50" acquired by "delete_volume" :: waited 0.018s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:31:46 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b2af86-b167-4f14-b538-ca52a7c2526b]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:31:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f3957f7d-0245-42f6-8702-a4d378b53827 tempest-TestInstancesWithCinderVolumes-1584482579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f61301cd-e7f6-4abe-82f4-7c87428bff50 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:46 devstack sudo[95861]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f365fe67-124e-4f27-8a43-2711a4ccc885 tempest-GroupSnapshotsV319Test-596481927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363" returned: 0 in 0.891s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f365fe67-124e-4f27-8a43-2711a4ccc885 tempest-GroupSnapshotsV319Test-596481927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363.01be5aad-c04b-4fc1-80c4-28e5cd08f8e4 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:46 devstack sudo[95873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f61301cd-e7f6-4abe-82f4-7c87428bff50 Jul 11 04:31:46 devstack sudo[95873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:46 devstack sudo[95874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363.01be5aad-c04b-4fc1-80c4-28e5cd08f8e4 Jul 11 04:31:46 devstack sudo[95874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:46 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-99eacfbf-cd44-4301-b948-002bcc116aa2 tempest-AttachVolumeNegativeTest-930293942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:31:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-99eacfbf-cd44-4301-b948-002bcc116aa2 tempest-AttachVolumeNegativeTest-930293942 None] Flow 'volume_create_manager' (26ccdb5e-3f0b-4560-994a-bdb68ad069b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:31:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-99eacfbf-cd44-4301-b948-002bcc116aa2 tempest-AttachVolumeNegativeTest-930293942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd8b32f9-52fd-4ec2-9a20-53e0e8c8ee87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:31:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-99eacfbf-cd44-4301-b948-002bcc116aa2 tempest-AttachVolumeNegativeTest-930293942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd8b32f9-52fd-4ec2-9a20-53e0e8c8ee87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-963865770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90998e1f-6be1-4fda-8630-c1e9abd1f093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44e231901653417dbcb1950f52b0f087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:31:47Z,use_quota=True,user_id='8a13d9d5816e46b2a784648c5f438e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:31:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-99eacfbf-cd44-4301-b948-002bcc116aa2 tempest-AttachVolumeNegativeTest-930293942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8474779d-31e0-4397-8e0c-978e798f3d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:31:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-99eacfbf-cd44-4301-b948-002bcc116aa2 tempest-AttachVolumeNegativeTest-930293942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8474779d-31e0-4397-8e0c-978e798f3d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:31:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-99eacfbf-cd44-4301-b948-002bcc116aa2 tempest-AttachVolumeNegativeTest-930293942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9ff808f-f56f-4ada-9135-d2364633ae3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:31:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-99eacfbf-cd44-4301-b948-002bcc116aa2 tempest-AttachVolumeNegativeTest-930293942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9ff808f-f56f-4ada-9135-d2364633ae3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90998e1f-6be1-4fda-8630-c1e9abd1f093', 'volume_name': 'volume-90998e1f-6be1-4fda-8630-c1e9abd1f093', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:31:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-99eacfbf-cd44-4301-b948-002bcc116aa2 tempest-AttachVolumeNegativeTest-930293942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d09cbf0-f63e-4411-ac83-6ef81b3497db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:31:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-99eacfbf-cd44-4301-b948-002bcc116aa2 tempest-AttachVolumeNegativeTest-930293942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d09cbf0-f63e-4411-ac83-6ef81b3497db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:31:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-99eacfbf-cd44-4301-b948-002bcc116aa2 tempest-AttachVolumeNegativeTest-930293942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e46e8bb-246d-462f-b16b-99a1c14238c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:31:46 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-99eacfbf-cd44-4301-b948-002bcc116aa2 tempest-AttachVolumeNegativeTest-930293942 None] Volume 90998e1f-6be1-4fda-8630-c1e9abd1f093: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90998e1f-6be1-4fda-8630-c1e9abd1f093', 'volume_size': 1} Jul 11 04:31:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-99eacfbf-cd44-4301-b948-002bcc116aa2 tempest-AttachVolumeNegativeTest-930293942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:31:46 devstack sudo[95868]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e3175308-12ec-465c-9d97-ce1a31a17af4 tempest-SnapshotsActionsTest-1830448284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.f1fb565c-5661-4ce4-b990-db49ff20ef12" returned: 0 in 0.891s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e3175308-12ec-465c-9d97-ce1a31a17af4 tempest-SnapshotsActionsTest-1830448284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.521s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:31:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-99eacfbf-cd44-4301-b948-002bcc116aa2 tempest-AttachVolumeNegativeTest-930293942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.190s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:31:46 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-99eacfbf-cd44-4301-b948-002bcc116aa2 tempest-AttachVolumeNegativeTest-930293942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-963865770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90998e1f-6be1-4fda-8630-c1e9abd1f093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44e231901653417dbcb1950f52b0f087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:31:47Z,use_quota=True,user_id='8a13d9d5816e46b2a784648c5f438e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:31:46 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-99eacfbf-cd44-4301-b948-002bcc116aa2 tempest-AttachVolumeNegativeTest-930293942 None] Creating volume 90998e1f-6be1-4fda-8630-c1e9abd1f093 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:31:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-99eacfbf-cd44-4301-b948-002bcc116aa2 tempest-AttachVolumeNegativeTest-930293942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:31:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-99eacfbf-cd44-4301-b948-002bcc116aa2 tempest-AttachVolumeNegativeTest-930293942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:31:46 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-99eacfbf-cd44-4301-b948-002bcc116aa2 tempest-AttachVolumeNegativeTest-930293942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:31:46 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-99eacfbf-cd44-4301-b948-002bcc116aa2 tempest-AttachVolumeNegativeTest-930293942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:31:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-99eacfbf-cd44-4301-b948-002bcc116aa2 tempest-AttachVolumeNegativeTest-930293942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:31:46 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-99eacfbf-cd44-4301-b948-002bcc116aa2 tempest-AttachVolumeNegativeTest-930293942 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:31:46 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-99eacfbf-cd44-4301-b948-002bcc116aa2 tempest-AttachVolumeNegativeTest-930293942 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:31:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-99eacfbf-cd44-4301-b948-002bcc116aa2 tempest-AttachVolumeNegativeTest-930293942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-90998e1f-6be1-4fda-8630-c1e9abd1f093 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:47 devstack sudo[95879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-90998e1f-6be1-4fda-8630-c1e9abd1f093 1073741824 Jul 11 04:31:47 devstack sudo[95879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:47 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-e3175308-12ec-465c-9d97-ce1a31a17af4 tempest-SnapshotsActionsTest-1830448284 None] Create snapshot completed successfully Jul 11 04:31:47 devstack sudo[95873]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f3957f7d-0245-42f6-8702-a4d378b53827 tempest-TestInstancesWithCinderVolumes-1584482579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f61301cd-e7f6-4abe-82f4-7c87428bff50" returned: 0 in 0.871s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f3957f7d-0245-42f6-8702-a4d378b53827 tempest-TestInstancesWithCinderVolumes-1584482579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f61301cd-e7f6-4abe-82f4-7c87428bff50 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:47 devstack sudo[95874]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f365fe67-124e-4f27-8a43-2711a4ccc885 tempest-GroupSnapshotsV319Test-596481927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363.01be5aad-c04b-4fc1-80c4-28e5cd08f8e4" returned: 0 in 0.828s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f365fe67-124e-4f27-8a43-2711a4ccc885 tempest-GroupSnapshotsV319Test-596481927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363.01be5aad-c04b-4fc1-80c4-28e5cd08f8e4 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:47 devstack sudo[95886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363.01be5aad-c04b-4fc1-80c4-28e5cd08f8e4 Jul 11 04:31:47 devstack sudo[95886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:47 devstack sudo[95885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f61301cd-e7f6-4abe-82f4-7c87428bff50 Jul 11 04:31:47 devstack sudo[95885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:47 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c46d1326-6f0c-43b1-a02e-d44314ba1840 tempest-SnapshotsActionsTest-816521708 None] Acquiring lock "cinder-f1fb565c-5661-4ce4-b990-db49ff20ef12-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:31:47 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c46d1326-6f0c-43b1-a02e-d44314ba1840 tempest-SnapshotsActionsTest-816521708 None] Lock "cinder-f1fb565c-5661-4ce4-b990-db49ff20ef12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:31:47 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c46d1326-6f0c-43b1-a02e-d44314ba1840 tempest-SnapshotsActionsTest-816521708 None] Acquiring lock "cinder-quobyte-f8d305ce-c341-4981-a324-0974b0d97923" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:31:47 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c46d1326-6f0c-43b1-a02e-d44314ba1840 tempest-SnapshotsActionsTest-816521708 None] Lock "cinder-quobyte-f8d305ce-c341-4981-a324-0974b0d97923" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:31:47 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c46d1326-6f0c-43b1-a02e-d44314ba1840 tempest-SnapshotsActionsTest-816521708 None] Acquiring lock "cinder-quobyte-f1fb565c-5661-4ce4-b990-db49ff20ef12" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:31:47 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c46d1326-6f0c-43b1-a02e-d44314ba1840 tempest-SnapshotsActionsTest-816521708 None] Lock "cinder-quobyte-f1fb565c-5661-4ce4-b990-db49ff20ef12" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:31:47 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-c46d1326-6f0c-43b1-a02e-d44314ba1840 tempest-SnapshotsActionsTest-816521708 None] Deleting offline snapshot f1fb565c-5661-4ce4-b990-db49ff20ef12 of volume f8d305ce-c341-4981-a324-0974b0d97923 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:31:47 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-c46d1326-6f0c-43b1-a02e-d44314ba1840 tempest-SnapshotsActionsTest-816521708 None] snapshot_file for this snap is: volume-f8d305ce-c341-4981-a324-0974b0d97923.f1fb565c-5661-4ce4-b990-db49ff20ef12 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:31:47 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bd23ae-72bd-4596-bdb8-1d131c468135]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:31:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c46d1326-6f0c-43b1-a02e-d44314ba1840 tempest-SnapshotsActionsTest-816521708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.f1fb565c-5661-4ce4-b990-db49ff20ef12 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:47 devstack sudo[95893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.f1fb565c-5661-4ce4-b990-db49ff20ef12 Jul 11 04:31:47 devstack sudo[95893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:48 devstack sudo[95879]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-99eacfbf-cd44-4301-b948-002bcc116aa2 tempest-AttachVolumeNegativeTest-930293942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-90998e1f-6be1-4fda-8630-c1e9abd1f093 1073741824" returned: 0 in 1.019s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-99eacfbf-cd44-4301-b948-002bcc116aa2 tempest-AttachVolumeNegativeTest-930293942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-90998e1f-6be1-4fda-8630-c1e9abd1f093 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:48 devstack sudo[95886]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f365fe67-124e-4f27-8a43-2711a4ccc885 tempest-GroupSnapshotsV319Test-596481927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363.01be5aad-c04b-4fc1-80c4-28e5cd08f8e4" returned: 0 in 0.829s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:48 devstack sudo[95901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-90998e1f-6be1-4fda-8630-c1e9abd1f093 Jul 11 04:31:48 devstack sudo[95901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:48 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f365fe67-124e-4f27-8a43-2711a4ccc885 tempest-GroupSnapshotsV319Test-596481927 None] Lock "cinder-quobyte-01be5aad-c04b-4fc1-80c4-28e5cd08f8e4" released by "_delete_snapshot" :: held 3.438s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:31:48 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f365fe67-124e-4f27-8a43-2711a4ccc885 tempest-GroupSnapshotsV319Test-596481927 None] Lock "cinder-quobyte-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363" released by "delete_snapshot" :: held 3.482s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:31:48 devstack sudo[95885]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f3957f7d-0245-42f6-8702-a4d378b53827 tempest-TestInstancesWithCinderVolumes-1584482579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f61301cd-e7f6-4abe-82f4-7c87428bff50" returned: 1 in 0.956s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f3957f7d-0245-42f6-8702-a4d378b53827 tempest-TestInstancesWithCinderVolumes-1584482579 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f61301cd-e7f6-4abe-82f4-7c87428bff50' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:31:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f3957f7d-0245-42f6-8702-a4d378b53827 tempest-TestInstancesWithCinderVolumes-1584482579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f61301cd-e7f6-4abe-82f4-7c87428bff50 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:48 devstack sudo[95903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f61301cd-e7f6-4abe-82f4-7c87428bff50 Jul 11 04:31:48 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:48 devstack cinder-volume[86964]: WARNING cinder.quota [None req-f365fe67-124e-4f27-8a43-2711a4ccc885 tempest-GroupSnapshotsV319Test-596481927 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-567854183 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-567854183, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:31:48 devstack cinder-volume[86964]: WARNING cinder.quota [None req-f365fe67-124e-4f27-8a43-2711a4ccc885 tempest-GroupSnapshotsV319Test-596481927 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-567854183 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-567854183, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:31:48 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-f365fe67-124e-4f27-8a43-2711a4ccc885 tempest-GroupSnapshotsV319Test-596481927 None] Created reservations ['7427f2e7-a734-4ac1-a5d6-2edc8d95f377', '353f9d0b-278b-4df6-abd1-5278c996ae74', 'b6ac3aac-8e9d-442e-83f3-603b5150ac6c', 'fa2b5595-a925-4bad-9845-0056dd29ac61'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:31:48 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-f365fe67-124e-4f27-8a43-2711a4ccc885 tempest-GroupSnapshotsV319Test-596481927 None] group_snapshot a3145f62-6cdc-4180-8067-3bf63dcff634: deleted successfully Jul 11 04:31:48 devstack sudo[95893]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c46d1326-6f0c-43b1-a02e-d44314ba1840 tempest-SnapshotsActionsTest-816521708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.f1fb565c-5661-4ce4-b990-db49ff20ef12" returned: 0 in 0.782s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:48 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-c46d1326-6f0c-43b1-a02e-d44314ba1840 tempest-SnapshotsActionsTest-816521708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8d305ce-c341-4981-a324-0974b0d97923(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:31:48 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[5296a461-f0ae-4d3a-8754-cae1879e762a]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:31:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c46d1326-6f0c-43b1-a02e-d44314ba1840 tempest-SnapshotsActionsTest-816521708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:48 devstack sudo[95908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c Jul 11 04:31:48 devstack sudo[95908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:48 devstack sudo[95901]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-99eacfbf-cd44-4301-b948-002bcc116aa2 tempest-AttachVolumeNegativeTest-930293942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-90998e1f-6be1-4fda-8630-c1e9abd1f093" returned: 0 in 0.744s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:48 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-99eacfbf-cd44-4301-b948-002bcc116aa2 tempest-AttachVolumeNegativeTest-930293942 None] <== create_volume: return (1809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:31:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-99eacfbf-cd44-4301-b948-002bcc116aa2 tempest-AttachVolumeNegativeTest-930293942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.814s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:31:48 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-99eacfbf-cd44-4301-b948-002bcc116aa2 tempest-AttachVolumeNegativeTest-930293942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e46e8bb-246d-462f-b16b-99a1c14238c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90998e1f-6be1-4fda-8630-c1e9abd1f093', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:31:48 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-99eacfbf-cd44-4301-b948-002bcc116aa2 tempest-AttachVolumeNegativeTest-930293942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eec3ec0-f466-4eac-ace6-9b939bc3c923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:31:48 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-99eacfbf-cd44-4301-b948-002bcc116aa2 tempest-AttachVolumeNegativeTest-930293942 None] Volume volume-90998e1f-6be1-4fda-8630-c1e9abd1f093 (90998e1f-6be1-4fda-8630-c1e9abd1f093): created successfully Jul 11 04:31:48 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-99eacfbf-cd44-4301-b948-002bcc116aa2 tempest-AttachVolumeNegativeTest-930293942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eec3ec0-f466-4eac-ace6-9b939bc3c923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:31:48 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-99eacfbf-cd44-4301-b948-002bcc116aa2 tempest-AttachVolumeNegativeTest-930293942 None] Flow 'volume_create_manager' (26ccdb5e-3f0b-4560-994a-bdb68ad069b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:31:48 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f3957f7d-0245-42f6-8702-a4d378b53827 tempest-TestInstancesWithCinderVolumes-1584482579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f61301cd-e7f6-4abe-82f4-7c87428bff50" returned: 0 in 0.737s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:48 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f3957f7d-0245-42f6-8702-a4d378b53827 tempest-TestInstancesWithCinderVolumes-1584482579 None] Lock "cinder-quobyte-f61301cd-e7f6-4abe-82f4-7c87428bff50" released by "delete_volume" :: held 2.652s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:31:48 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-99eacfbf-cd44-4301-b948-002bcc116aa2 tempest-AttachVolumeNegativeTest-930293942 None] Created volume successfully. Jul 11 04:31:48 devstack cinder-volume[86964]: WARNING cinder.quota [None req-f3957f7d-0245-42f6-8702-a4d378b53827 tempest-TestInstancesWithCinderVolumes-1584482579 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-206840819-1767763926 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-206840819-1767763926, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:31:48 devstack cinder-volume[86964]: WARNING cinder.quota [None req-f3957f7d-0245-42f6-8702-a4d378b53827 tempest-TestInstancesWithCinderVolumes-1584482579 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-206840819-1767763926 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-206840819-1767763926, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:31:48 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-f3957f7d-0245-42f6-8702-a4d378b53827 tempest-TestInstancesWithCinderVolumes-1584482579 None] Created reservations ['8ba1bbaf-db46-4b8e-8dbd-4b88e01557e6', '33369eaf-f405-4a57-9dd3-89f4a6f41479', 'ea89091f-e769-4857-a316-0e06d0d600b9', 'a27202fc-20d2-4aaa-ade8-50656950aa55'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:31:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f3957f7d-0245-42f6-8702-a4d378b53827 tempest-TestInstancesWithCinderVolumes-1584482579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:31:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f3957f7d-0245-42f6-8702-a4d378b53827 tempest-TestInstancesWithCinderVolumes-1584482579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:31:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-f3957f7d-0245-42f6-8702-a4d378b53827 tempest-TestInstancesWithCinderVolumes-1584482579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:31:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-f3957f7d-0245-42f6-8702-a4d378b53827 tempest-TestInstancesWithCinderVolumes-1584482579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:31:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f3957f7d-0245-42f6-8702-a4d378b53827 tempest-TestInstancesWithCinderVolumes-1584482579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:31:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f3957f7d-0245-42f6-8702-a4d378b53827 tempest-TestInstancesWithCinderVolumes-1584482579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:49 devstack sudo[95912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:31:49 devstack sudo[95912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:49 devstack sudo[95908]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c46d1326-6f0c-43b1-a02e-d44314ba1840 tempest-SnapshotsActionsTest-816521708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c" returned: 0 in 0.787s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-c46d1326-6f0c-43b1-a02e-d44314ba1840 tempest-SnapshotsActionsTest-816521708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8d305ce-c341-4981-a324-0974b0d97923(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:31:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c46d1326-6f0c-43b1-a02e-d44314ba1840 tempest-SnapshotsActionsTest-816521708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.f1fb565c-5661-4ce4-b990-db49ff20ef12 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:49 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6121f9a6-0ad5-4d87-9a91-8515c1544a7e tempest-GroupSnapshotsV319Test-596481927 None] Acquiring lock "cinder-quobyte-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:31:49 devstack sudo[95917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.f1fb565c-5661-4ce4-b990-db49ff20ef12 Jul 11 04:31:49 devstack sudo[95917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:49 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6121f9a6-0ad5-4d87-9a91-8515c1544a7e tempest-GroupSnapshotsV319Test-596481927 None] Lock "cinder-quobyte-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363" acquired by "delete_volume" :: waited 0.015s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:31:49 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[1172af32-9d56-4a72-9cac-8b73b586ca89]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:31:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6121f9a6-0ad5-4d87-9a91-8515c1544a7e tempest-GroupSnapshotsV319Test-596481927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:49 devstack sudo[95919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363 Jul 11 04:31:49 devstack sudo[95919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:49 devstack sudo[95912]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f3957f7d-0245-42f6-8702-a4d378b53827 tempest-TestInstancesWithCinderVolumes-1584482579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.702s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:49 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-f3957f7d-0245-42f6-8702-a4d378b53827 tempest-TestInstancesWithCinderVolumes-1584482579 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:31:49 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-f3957f7d-0245-42f6-8702-a4d378b53827 tempest-TestInstancesWithCinderVolumes-1584482579 None] Deleted volume successfully. Jul 11 04:31:49 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f3957f7d-0245-42f6-8702-a4d378b53827 tempest-TestInstancesWithCinderVolumes-1584482579 None] Lock "cinder-f61301cd-e7f6-4abe-82f4-7c87428bff50-delete_volume" released by "delete_volume" :: held 3.603s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:31:50 devstack sudo[95917]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c46d1326-6f0c-43b1-a02e-d44314ba1840 tempest-SnapshotsActionsTest-816521708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.f1fb565c-5661-4ce4-b990-db49ff20ef12" returned: 0 in 1.007s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c46d1326-6f0c-43b1-a02e-d44314ba1840 tempest-SnapshotsActionsTest-816521708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.f1fb565c-5661-4ce4-b990-db49ff20ef12 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:50 devstack sudo[95933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.f1fb565c-5661-4ce4-b990-db49ff20ef12 Jul 11 04:31:50 devstack sudo[95933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:50 devstack sudo[95919]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6121f9a6-0ad5-4d87-9a91-8515c1544a7e tempest-GroupSnapshotsV319Test-596481927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363" returned: 0 in 0.974s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6121f9a6-0ad5-4d87-9a91-8515c1544a7e tempest-GroupSnapshotsV319Test-596481927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:50 devstack sudo[95935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363 Jul 11 04:31:50 devstack sudo[95935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:51 devstack sudo[95933]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c46d1326-6f0c-43b1-a02e-d44314ba1840 tempest-SnapshotsActionsTest-816521708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.f1fb565c-5661-4ce4-b990-db49ff20ef12" returned: 0 in 0.768s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c46d1326-6f0c-43b1-a02e-d44314ba1840 tempest-SnapshotsActionsTest-816521708 None] Lock "cinder-quobyte-f1fb565c-5661-4ce4-b990-db49ff20ef12" released by "_delete_snapshot" :: held 3.484s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:31:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c46d1326-6f0c-43b1-a02e-d44314ba1840 tempest-SnapshotsActionsTest-816521708 None] Lock "cinder-quobyte-f8d305ce-c341-4981-a324-0974b0d97923" released by "delete_snapshot" :: held 3.526s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:31:51 devstack sudo[95935]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6121f9a6-0ad5-4d87-9a91-8515c1544a7e tempest-GroupSnapshotsV319Test-596481927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363" returned: 0 in 0.805s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6121f9a6-0ad5-4d87-9a91-8515c1544a7e tempest-GroupSnapshotsV319Test-596481927 None] Lock "cinder-quobyte-c5dc9fc5-dbdb-4a30-b813-511ad4ea8363" released by "delete_volume" :: held 1.883s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:31:51 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-c46d1326-6f0c-43b1-a02e-d44314ba1840 tempest-SnapshotsActionsTest-816521708 None] Created reservations ['0392564e-12b0-4c2f-987e-a59253b83970', '2a4d9052-9971-4013-9f38-a7d2e6b98f77', '308105d2-7085-45e4-acd8-94d2e9c048e7', 'f244bc5b-a6f2-46a8-abaf-248740bdb11b'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:31:51 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-6121f9a6-0ad5-4d87-9a91-8515c1544a7e tempest-GroupSnapshotsV319Test-596481927 None] Created reservations ['0c831d3b-d66c-416d-9c22-3bd37bad9e41'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:31:51 devstack cinder-volume[86964]: WARNING cinder.quota [None req-6121f9a6-0ad5-4d87-9a91-8515c1544a7e tempest-GroupSnapshotsV319Test-596481927 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-567854183 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-567854183, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:31:51 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-c46d1326-6f0c-43b1-a02e-d44314ba1840 tempest-SnapshotsActionsTest-816521708 None] Delete snapshot completed successfully. Jul 11 04:31:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c46d1326-6f0c-43b1-a02e-d44314ba1840 tempest-SnapshotsActionsTest-816521708 None] Lock "cinder-f1fb565c-5661-4ce4-b990-db49ff20ef12-delete_snapshot" released by "delete_snapshot" :: held 3.771s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:31:51 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-6121f9a6-0ad5-4d87-9a91-8515c1544a7e tempest-GroupSnapshotsV319Test-596481927 None] Created reservations ['85b75c2b-22d2-4655-9dec-6711249b0ea3', '375a97b4-c8b8-4779-a88e-d35e4f51f910', '490d5a92-bae5-4d59-b2dd-08ccc067eb4a', 'c8f3b6d3-2933-446d-9547-1a1485a14f3e'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:31:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6121f9a6-0ad5-4d87-9a91-8515c1544a7e tempest-GroupSnapshotsV319Test-596481927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:31:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6121f9a6-0ad5-4d87-9a91-8515c1544a7e tempest-GroupSnapshotsV319Test-596481927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:31:51 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6121f9a6-0ad5-4d87-9a91-8515c1544a7e tempest-GroupSnapshotsV319Test-596481927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:31:51 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6121f9a6-0ad5-4d87-9a91-8515c1544a7e tempest-GroupSnapshotsV319Test-596481927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:31:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6121f9a6-0ad5-4d87-9a91-8515c1544a7e tempest-GroupSnapshotsV319Test-596481927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:31:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6121f9a6-0ad5-4d87-9a91-8515c1544a7e tempest-GroupSnapshotsV319Test-596481927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:51 devstack sudo[95939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:31:51 devstack sudo[95939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fa68eac2-3915-4fce-a759-1abcebd782e6 tempest-SnapshotsActionsTest-1830448284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:31:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fa68eac2-3915-4fce-a759-1abcebd782e6 tempest-SnapshotsActionsTest-1830448284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:31:52 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-fa68eac2-3915-4fce-a759-1abcebd782e6 tempest-SnapshotsActionsTest-1830448284 None] Creating offline snapshot 024b28c7-213e-451d-b150-1b35a361eb39 of volume f8d305ce-c341-4981-a324-0974b0d97923 {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:31:52 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f77625-b5d0-4ba3-8707-0e8f8cce1f7b]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:31:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fa68eac2-3915-4fce-a759-1abcebd782e6 tempest-SnapshotsActionsTest-1830448284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:52 devstack sudo[95939]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6121f9a6-0ad5-4d87-9a91-8515c1544a7e tempest-GroupSnapshotsV319Test-596481927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 1.086s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:52 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-6121f9a6-0ad5-4d87-9a91-8515c1544a7e tempest-GroupSnapshotsV319Test-596481927 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:31:52 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-6121f9a6-0ad5-4d87-9a91-8515c1544a7e tempest-GroupSnapshotsV319Test-596481927 None] Delete group completed successfully. Jul 11 04:31:52 devstack sudo[95943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c Jul 11 04:31:52 devstack sudo[95943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:53 devstack sudo[95943]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fa68eac2-3915-4fce-a759-1abcebd782e6 tempest-SnapshotsActionsTest-1830448284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c" returned: 0 in 1.089s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:53 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-fa68eac2-3915-4fce-a759-1abcebd782e6 tempest-SnapshotsActionsTest-1830448284 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8d305ce-c341-4981-a324-0974b0d97923(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:31:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fa68eac2-3915-4fce-a759-1abcebd782e6 tempest-SnapshotsActionsTest-1830448284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.024b28c7-213e-451d-b150-1b35a361eb39 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:53 devstack sudo[95957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.024b28c7-213e-451d-b150-1b35a361eb39 1G Jul 11 04:31:53 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-3120998b-504b-4b98-9cfa-c384b346ffdb req-ec6b6b9a-feff-4309-ade6-e4dea5dd3667 tempest-AttachVolumeNegativeTest-930293942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:31:54 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fa68eac2-3915-4fce-a759-1abcebd782e6 tempest-SnapshotsActionsTest-1830448284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.024b28c7-213e-451d-b150-1b35a361eb39 1G" returned: 0 in 1.094s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fa68eac2-3915-4fce-a759-1abcebd782e6 tempest-SnapshotsActionsTest-1830448284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.024b28c7-213e-451d-b150-1b35a361eb39 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:54 devstack sudo[95963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.024b28c7-213e-451d-b150-1b35a361eb39 Jul 11 04:31:54 devstack sudo[95963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:55 devstack sudo[95963]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fa68eac2-3915-4fce-a759-1abcebd782e6 tempest-SnapshotsActionsTest-1830448284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.024b28c7-213e-451d-b150-1b35a361eb39" returned: 0 in 0.813s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:55 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-fa68eac2-3915-4fce-a759-1abcebd782e6 tempest-SnapshotsActionsTest-1830448284 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.024b28c7-213e-451d-b150-1b35a361eb39 is being set with open permissions: ugo+rw Jul 11 04:31:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fa68eac2-3915-4fce-a759-1abcebd782e6 tempest-SnapshotsActionsTest-1830448284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.024b28c7-213e-451d-b150-1b35a361eb39 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:55 devstack sudo[95971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.024b28c7-213e-451d-b150-1b35a361eb39 Jul 11 04:31:55 devstack sudo[95971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:56 devstack sudo[95971]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fa68eac2-3915-4fce-a759-1abcebd782e6 tempest-SnapshotsActionsTest-1830448284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.024b28c7-213e-451d-b150-1b35a361eb39" returned: 0 in 0.679s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fa68eac2-3915-4fce-a759-1abcebd782e6 tempest-SnapshotsActionsTest-1830448284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.881s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:31:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-3120998b-504b-4b98-9cfa-c384b346ffdb req-ec6b6b9a-feff-4309-ade6-e4dea5dd3667 tempest-AttachVolumeNegativeTest-930293942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.520s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:31:56 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad09d86-9ed4-48e2-bcd4-2a59947bed64]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:31:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-3120998b-504b-4b98-9cfa-c384b346ffdb req-ec6b6b9a-feff-4309-ade6-e4dea5dd3667 tempest-AttachVolumeNegativeTest-930293942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-90998e1f-6be1-4fda-8630-c1e9abd1f093 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:56 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-fa68eac2-3915-4fce-a759-1abcebd782e6 tempest-SnapshotsActionsTest-1830448284 None] Create snapshot completed successfully Jul 11 04:31:56 devstack sudo[95974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-90998e1f-6be1-4fda-8630-c1e9abd1f093 Jul 11 04:31:56 devstack sudo[95974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:56 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3c879155-3dbe-40c4-a1d1-8ba0ea39c01b tempest-SnapshotsActionsTest-816521708 None] Acquiring lock "cinder-024b28c7-213e-451d-b150-1b35a361eb39-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:31:56 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3c879155-3dbe-40c4-a1d1-8ba0ea39c01b tempest-SnapshotsActionsTest-816521708 None] Lock "cinder-024b28c7-213e-451d-b150-1b35a361eb39-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:31:56 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3c879155-3dbe-40c4-a1d1-8ba0ea39c01b tempest-SnapshotsActionsTest-816521708 None] Acquiring lock "cinder-quobyte-f8d305ce-c341-4981-a324-0974b0d97923" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:31:56 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3c879155-3dbe-40c4-a1d1-8ba0ea39c01b tempest-SnapshotsActionsTest-816521708 None] Lock "cinder-quobyte-f8d305ce-c341-4981-a324-0974b0d97923" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:31:56 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3c879155-3dbe-40c4-a1d1-8ba0ea39c01b tempest-SnapshotsActionsTest-816521708 None] Acquiring lock "cinder-quobyte-024b28c7-213e-451d-b150-1b35a361eb39" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:31:56 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3c879155-3dbe-40c4-a1d1-8ba0ea39c01b tempest-SnapshotsActionsTest-816521708 None] Lock "cinder-quobyte-024b28c7-213e-451d-b150-1b35a361eb39" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:31:56 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-3c879155-3dbe-40c4-a1d1-8ba0ea39c01b tempest-SnapshotsActionsTest-816521708 None] Deleting offline snapshot 024b28c7-213e-451d-b150-1b35a361eb39 of volume f8d305ce-c341-4981-a324-0974b0d97923 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:31:56 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-3c879155-3dbe-40c4-a1d1-8ba0ea39c01b tempest-SnapshotsActionsTest-816521708 None] snapshot_file for this snap is: volume-f8d305ce-c341-4981-a324-0974b0d97923.024b28c7-213e-451d-b150-1b35a361eb39 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:31:56 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c06c7c9-e517-4d66-ba78-9a6429c69073]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:31:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3c879155-3dbe-40c4-a1d1-8ba0ea39c01b tempest-SnapshotsActionsTest-816521708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.024b28c7-213e-451d-b150-1b35a361eb39 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:56 devstack sudo[95977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.024b28c7-213e-451d-b150-1b35a361eb39 Jul 11 04:31:56 devstack sudo[95977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:57 devstack sudo[95974]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-3120998b-504b-4b98-9cfa-c384b346ffdb req-ec6b6b9a-feff-4309-ade6-e4dea5dd3667 tempest-AttachVolumeNegativeTest-930293942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-90998e1f-6be1-4fda-8630-c1e9abd1f093" returned: 0 in 1.036s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-3120998b-504b-4b98-9cfa-c384b346ffdb req-ec6b6b9a-feff-4309-ade6-e4dea5dd3667 tempest-AttachVolumeNegativeTest-930293942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.061s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:31:57 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-3120998b-504b-4b98-9cfa-c384b346ffdb req-ec6b6b9a-feff-4309-ade6-e4dea5dd3667 tempest-AttachVolumeNegativeTest-930293942 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95', 'name': 'volume-90998e1f-6be1-4fda-8630-c1e9abd1f093', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b6206de7-844c-4737-bf79-6f7828682cbc', 'enforce_multipath': True} {{(pid=86964) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 04:31:57 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-3120998b-504b-4b98-9cfa-c384b346ffdb req-ec6b6b9a-feff-4309-ade6-e4dea5dd3667 tempest-AttachVolumeNegativeTest-930293942 None] attachment_update completed successfully. Jul 11 04:31:57 devstack sudo[95977]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3c879155-3dbe-40c4-a1d1-8ba0ea39c01b tempest-SnapshotsActionsTest-816521708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.024b28c7-213e-451d-b150-1b35a361eb39" returned: 0 in 0.959s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:57 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-3c879155-3dbe-40c4-a1d1-8ba0ea39c01b tempest-SnapshotsActionsTest-816521708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8d305ce-c341-4981-a324-0974b0d97923(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:31:57 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e46fb08-9342-4cf9-9bfb-696807bb1485]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:31:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3c879155-3dbe-40c4-a1d1-8ba0ea39c01b tempest-SnapshotsActionsTest-816521708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:57 devstack sudo[95987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c Jul 11 04:31:57 devstack sudo[95987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:58 devstack sudo[95987]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3c879155-3dbe-40c4-a1d1-8ba0ea39c01b tempest-SnapshotsActionsTest-816521708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c" returned: 0 in 1.024s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-3c879155-3dbe-40c4-a1d1-8ba0ea39c01b tempest-SnapshotsActionsTest-816521708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8d305ce-c341-4981-a324-0974b0d97923(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:31:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3c879155-3dbe-40c4-a1d1-8ba0ea39c01b tempest-SnapshotsActionsTest-816521708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.024b28c7-213e-451d-b150-1b35a361eb39 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:58 devstack sudo[96374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.024b28c7-213e-451d-b150-1b35a361eb39 Jul 11 04:31:58 devstack sudo[96374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:59 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:31:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:31:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:31:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:31:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:31:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:31:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:59 devstack sudo[96376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:31:59 devstack sudo[96376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:59 devstack sudo[96374]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3c879155-3dbe-40c4-a1d1-8ba0ea39c01b tempest-SnapshotsActionsTest-816521708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.024b28c7-213e-451d-b150-1b35a361eb39" returned: 0 in 1.067s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3c879155-3dbe-40c4-a1d1-8ba0ea39c01b tempest-SnapshotsActionsTest-816521708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.024b28c7-213e-451d-b150-1b35a361eb39 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:31:59 devstack sudo[96376]: pam_unix(sudo:session): session closed for user root Jul 11 04:31:59 devstack sudo[96384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.024b28c7-213e-451d-b150-1b35a361eb39 Jul 11 04:31:59 devstack sudo[96384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:31:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.809s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:31:59 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:31:59 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager._thread_info {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:31:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread count: 28 {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:31:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread info: [<_MainThread(MainThread, started 124675027595392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:32:00 devstack sudo[96384]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3c879155-3dbe-40c4-a1d1-8ba0ea39c01b tempest-SnapshotsActionsTest-816521708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.024b28c7-213e-451d-b150-1b35a361eb39" returned: 0 in 0.765s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:00 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3c879155-3dbe-40c4-a1d1-8ba0ea39c01b tempest-SnapshotsActionsTest-816521708 None] Lock "cinder-quobyte-024b28c7-213e-451d-b150-1b35a361eb39" released by "_delete_snapshot" :: held 3.986s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:32:00 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3c879155-3dbe-40c4-a1d1-8ba0ea39c01b tempest-SnapshotsActionsTest-816521708 None] Lock "cinder-quobyte-f8d305ce-c341-4981-a324-0974b0d97923" released by "delete_snapshot" :: held 4.015s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:32:00 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-3c879155-3dbe-40c4-a1d1-8ba0ea39c01b tempest-SnapshotsActionsTest-816521708 None] Created reservations ['003cde8c-7e55-4e80-a2fb-ff22bbeaf867', '9859eae1-f1ee-4d5e-8f52-57aa9c04e110', '864aae5a-dd8b-4d9c-92b2-2f7d19415c8f', '654212fe-b622-43fa-a1d7-62fa7ac4a209'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:32:00 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-3c879155-3dbe-40c4-a1d1-8ba0ea39c01b tempest-SnapshotsActionsTest-816521708 None] Delete snapshot completed successfully. Jul 11 04:32:00 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3c879155-3dbe-40c4-a1d1-8ba0ea39c01b tempest-SnapshotsActionsTest-816521708 None] Lock "cinder-024b28c7-213e-451d-b150-1b35a361eb39-delete_snapshot" released by "delete_snapshot" :: held 4.204s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:32:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f3f64610-ed41-4caf-8b5d-3c35333ee749 tempest-SnapshotsActionsTest-1830448284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:32:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f3f64610-ed41-4caf-8b5d-3c35333ee749 tempest-SnapshotsActionsTest-1830448284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:32:01 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-f3f64610-ed41-4caf-8b5d-3c35333ee749 tempest-SnapshotsActionsTest-1830448284 None] Creating offline snapshot 5e228721-ce59-4fa9-96b5-7aa0f56021b5 of volume f8d305ce-c341-4981-a324-0974b0d97923 {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:32:01 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce414ff-3fcd-41ba-9960-8dcabc8fc239]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:32:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f3f64610-ed41-4caf-8b5d-3c35333ee749 tempest-SnapshotsActionsTest-1830448284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:01 devstack sudo[96401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c Jul 11 04:32:01 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:02 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f3f64610-ed41-4caf-8b5d-3c35333ee749 tempest-SnapshotsActionsTest-1830448284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c" returned: 0 in 1.083s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:02 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-f3f64610-ed41-4caf-8b5d-3c35333ee749 tempest-SnapshotsActionsTest-1830448284 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8d305ce-c341-4981-a324-0974b0d97923(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:32:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f3f64610-ed41-4caf-8b5d-3c35333ee749 tempest-SnapshotsActionsTest-1830448284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.5e228721-ce59-4fa9-96b5-7aa0f56021b5 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:02 devstack sudo[96428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.5e228721-ce59-4fa9-96b5-7aa0f56021b5 1G Jul 11 04:32:02 devstack sudo[96428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:03 devstack sudo[96428]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f3f64610-ed41-4caf-8b5d-3c35333ee749 tempest-SnapshotsActionsTest-1830448284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.5e228721-ce59-4fa9-96b5-7aa0f56021b5 1G" returned: 0 in 1.274s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f3f64610-ed41-4caf-8b5d-3c35333ee749 tempest-SnapshotsActionsTest-1830448284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.5e228721-ce59-4fa9-96b5-7aa0f56021b5 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:03 devstack sudo[96434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.5e228721-ce59-4fa9-96b5-7aa0f56021b5 Jul 11 04:32:03 devstack sudo[96434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:04 devstack sudo[96434]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f3f64610-ed41-4caf-8b5d-3c35333ee749 tempest-SnapshotsActionsTest-1830448284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.5e228721-ce59-4fa9-96b5-7aa0f56021b5" returned: 0 in 0.918s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:04 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-f3f64610-ed41-4caf-8b5d-3c35333ee749 tempest-SnapshotsActionsTest-1830448284 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.5e228721-ce59-4fa9-96b5-7aa0f56021b5 is being set with open permissions: ugo+rw Jul 11 04:32:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f3f64610-ed41-4caf-8b5d-3c35333ee749 tempest-SnapshotsActionsTest-1830448284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.5e228721-ce59-4fa9-96b5-7aa0f56021b5 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:04 devstack sudo[96439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.5e228721-ce59-4fa9-96b5-7aa0f56021b5 Jul 11 04:32:04 devstack sudo[96439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:05 devstack sudo[96439]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f3f64610-ed41-4caf-8b5d-3c35333ee749 tempest-SnapshotsActionsTest-1830448284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.5e228721-ce59-4fa9-96b5-7aa0f56021b5" returned: 0 in 0.811s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f3f64610-ed41-4caf-8b5d-3c35333ee749 tempest-SnapshotsActionsTest-1830448284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.254s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:32:05 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-f3f64610-ed41-4caf-8b5d-3c35333ee749 tempest-SnapshotsActionsTest-1830448284 None] Create snapshot completed successfully Jul 11 04:32:06 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-8899149f-379a-4750-92e2-a0ae2bf5e492 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:32:06 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8899149f-379a-4750-92e2-a0ae2bf5e492 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Flow 'volume_create_manager' (300e04fc-5fb5-4850-9297-eeb3caf9c3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:32:06 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8899149f-379a-4750-92e2-a0ae2bf5e492 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7552365-a708-4c32-b757-14faa4457386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:32:06 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8899149f-379a-4750-92e2-a0ae2bf5e492 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7552365-a708-4c32-b757-14faa4457386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1806098554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=378218f1-baf9-4be3-b3f5-f4e8d1fec18a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f6de4030d7c4175982673db63bc1887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:32:06Z,use_quota=True,user_id='15d0f3c6539148c197682e228af0090c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:32:06 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8899149f-379a-4750-92e2-a0ae2bf5e492 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d1c6f3f-f23d-4aa6-b719-a0cf987f85b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:32:06 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8899149f-379a-4750-92e2-a0ae2bf5e492 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d1c6f3f-f23d-4aa6-b719-a0cf987f85b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:32:06 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8899149f-379a-4750-92e2-a0ae2bf5e492 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7af1d609-c6a2-4c72-b875-667f48585652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:32:06 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8899149f-379a-4750-92e2-a0ae2bf5e492 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7af1d609-c6a2-4c72-b875-667f48585652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '378218f1-baf9-4be3-b3f5-f4e8d1fec18a', 'volume_name': 'volume-378218f1-baf9-4be3-b3f5-f4e8d1fec18a', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:32:06 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8899149f-379a-4750-92e2-a0ae2bf5e492 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e14be29a-f0a8-4657-b98c-c5ccb16c61d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:32:06 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8899149f-379a-4750-92e2-a0ae2bf5e492 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e14be29a-f0a8-4657-b98c-c5ccb16c61d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:32:06 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8899149f-379a-4750-92e2-a0ae2bf5e492 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b14d934-2e16-4a59-b89c-9212b6c3142f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:32:06 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-8899149f-379a-4750-92e2-a0ae2bf5e492 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Volume 378218f1-baf9-4be3-b3f5-f4e8d1fec18a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-378218f1-baf9-4be3-b3f5-f4e8d1fec18a', 'volume_size': 1} Jul 11 04:32:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-8899149f-379a-4750-92e2-a0ae2bf5e492 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:32:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-8899149f-379a-4750-92e2-a0ae2bf5e492 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:32:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-8899149f-379a-4750-92e2-a0ae2bf5e492 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1806098554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=378218f1-baf9-4be3-b3f5-f4e8d1fec18a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f6de4030d7c4175982673db63bc1887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:32:06Z,use_quota=True,user_id='15d0f3c6539148c197682e228af0090c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:32:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-8899149f-379a-4750-92e2-a0ae2bf5e492 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Creating volume 378218f1-baf9-4be3-b3f5-f4e8d1fec18a {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:32:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-8899149f-379a-4750-92e2-a0ae2bf5e492 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:32:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-8899149f-379a-4750-92e2-a0ae2bf5e492 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:32:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-8899149f-379a-4750-92e2-a0ae2bf5e492 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:32:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-8899149f-379a-4750-92e2-a0ae2bf5e492 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:32:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-8899149f-379a-4750-92e2-a0ae2bf5e492 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:32:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-8899149f-379a-4750-92e2-a0ae2bf5e492 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:32:06 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-8899149f-379a-4750-92e2-a0ae2bf5e492 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:32:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8899149f-379a-4750-92e2-a0ae2bf5e492 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-378218f1-baf9-4be3-b3f5-f4e8d1fec18a 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:06 devstack sudo[96443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-378218f1-baf9-4be3-b3f5-f4e8d1fec18a 1073741824 Jul 11 04:32:06 devstack sudo[96443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:06 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fb1c29e5-d8fd-4adb-add9-a2f024e4bd53 tempest-SnapshotsActionsTest-816521708 None] Acquiring lock "cinder-5e228721-ce59-4fa9-96b5-7aa0f56021b5-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:32:06 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fb1c29e5-d8fd-4adb-add9-a2f024e4bd53 tempest-SnapshotsActionsTest-816521708 None] Lock "cinder-5e228721-ce59-4fa9-96b5-7aa0f56021b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:32:06 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fb1c29e5-d8fd-4adb-add9-a2f024e4bd53 tempest-SnapshotsActionsTest-816521708 None] Acquiring lock "cinder-quobyte-f8d305ce-c341-4981-a324-0974b0d97923" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:32:06 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fb1c29e5-d8fd-4adb-add9-a2f024e4bd53 tempest-SnapshotsActionsTest-816521708 None] Lock "cinder-quobyte-f8d305ce-c341-4981-a324-0974b0d97923" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:32:06 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fb1c29e5-d8fd-4adb-add9-a2f024e4bd53 tempest-SnapshotsActionsTest-816521708 None] Acquiring lock "cinder-quobyte-5e228721-ce59-4fa9-96b5-7aa0f56021b5" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:32:06 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fb1c29e5-d8fd-4adb-add9-a2f024e4bd53 tempest-SnapshotsActionsTest-816521708 None] Lock "cinder-quobyte-5e228721-ce59-4fa9-96b5-7aa0f56021b5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:32:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-fb1c29e5-d8fd-4adb-add9-a2f024e4bd53 tempest-SnapshotsActionsTest-816521708 None] Deleting offline snapshot 5e228721-ce59-4fa9-96b5-7aa0f56021b5 of volume f8d305ce-c341-4981-a324-0974b0d97923 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:32:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-fb1c29e5-d8fd-4adb-add9-a2f024e4bd53 tempest-SnapshotsActionsTest-816521708 None] snapshot_file for this snap is: volume-f8d305ce-c341-4981-a324-0974b0d97923.5e228721-ce59-4fa9-96b5-7aa0f56021b5 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:32:06 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d98b271-ae19-4522-9a53-0fa789f52ecd]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:32:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb1c29e5-d8fd-4adb-add9-a2f024e4bd53 tempest-SnapshotsActionsTest-816521708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.5e228721-ce59-4fa9-96b5-7aa0f56021b5 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:06 devstack sudo[96448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.5e228721-ce59-4fa9-96b5-7aa0f56021b5 Jul 11 04:32:06 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:07 devstack sudo[96443]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8899149f-379a-4750-92e2-a0ae2bf5e492 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-378218f1-baf9-4be3-b3f5-f4e8d1fec18a 1073741824" returned: 0 in 1.146s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8899149f-379a-4750-92e2-a0ae2bf5e492 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-378218f1-baf9-4be3-b3f5-f4e8d1fec18a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:07 devstack sudo[96453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-378218f1-baf9-4be3-b3f5-f4e8d1fec18a Jul 11 04:32:07 devstack sudo[96453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:07 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb1c29e5-d8fd-4adb-add9-a2f024e4bd53 tempest-SnapshotsActionsTest-816521708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.5e228721-ce59-4fa9-96b5-7aa0f56021b5" returned: 0 in 1.020s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:07 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-fb1c29e5-d8fd-4adb-add9-a2f024e4bd53 tempest-SnapshotsActionsTest-816521708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8d305ce-c341-4981-a324-0974b0d97923(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:32:07 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09c2cb1-c83e-49f5-8d27-5a123af6330d]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:32:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb1c29e5-d8fd-4adb-add9-a2f024e4bd53 tempest-SnapshotsActionsTest-816521708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:08 devstack sudo[96458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c Jul 11 04:32:08 devstack sudo[96458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:08 devstack sudo[96453]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8899149f-379a-4750-92e2-a0ae2bf5e492 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-378218f1-baf9-4be3-b3f5-f4e8d1fec18a" returned: 0 in 0.740s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:08 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-8899149f-379a-4750-92e2-a0ae2bf5e492 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] <== create_volume: return (1943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:32:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-8899149f-379a-4750-92e2-a0ae2bf5e492 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.946s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:32:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8899149f-379a-4750-92e2-a0ae2bf5e492 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b14d934-2e16-4a59-b89c-9212b6c3142f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-378218f1-baf9-4be3-b3f5-f4e8d1fec18a', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:32:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8899149f-379a-4750-92e2-a0ae2bf5e492 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a77307fd-7310-4b7f-9996-ed3c2fed9c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:32:08 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-8899149f-379a-4750-92e2-a0ae2bf5e492 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Volume volume-378218f1-baf9-4be3-b3f5-f4e8d1fec18a (378218f1-baf9-4be3-b3f5-f4e8d1fec18a): created successfully Jul 11 04:32:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8899149f-379a-4750-92e2-a0ae2bf5e492 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a77307fd-7310-4b7f-9996-ed3c2fed9c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:32:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8899149f-379a-4750-92e2-a0ae2bf5e492 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Flow 'volume_create_manager' (300e04fc-5fb5-4850-9297-eeb3caf9c3a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:32:08 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-8899149f-379a-4750-92e2-a0ae2bf5e492 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Created volume successfully. Jul 11 04:32:08 devstack sudo[96458]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb1c29e5-d8fd-4adb-add9-a2f024e4bd53 tempest-SnapshotsActionsTest-816521708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c" returned: 0 in 0.979s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:08 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-fb1c29e5-d8fd-4adb-add9-a2f024e4bd53 tempest-SnapshotsActionsTest-816521708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8d305ce-c341-4981-a324-0974b0d97923(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:32:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb1c29e5-d8fd-4adb-add9-a2f024e4bd53 tempest-SnapshotsActionsTest-816521708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.5e228721-ce59-4fa9-96b5-7aa0f56021b5 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:08 devstack sudo[96464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.5e228721-ce59-4fa9-96b5-7aa0f56021b5 Jul 11 04:32:08 devstack sudo[96464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:09 devstack sudo[96464]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb1c29e5-d8fd-4adb-add9-a2f024e4bd53 tempest-SnapshotsActionsTest-816521708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.5e228721-ce59-4fa9-96b5-7aa0f56021b5" returned: 0 in 0.964s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb1c29e5-d8fd-4adb-add9-a2f024e4bd53 tempest-SnapshotsActionsTest-816521708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.5e228721-ce59-4fa9-96b5-7aa0f56021b5 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:09 devstack sudo[96470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.5e228721-ce59-4fa9-96b5-7aa0f56021b5 Jul 11 04:32:09 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:10 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e857fb6f-897c-48ae-9834-150940de8d44 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Acquiring lock "cinder-378218f1-baf9-4be3-b3f5-f4e8d1fec18a-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:32:10 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e857fb6f-897c-48ae-9834-150940de8d44 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Lock "cinder-378218f1-baf9-4be3-b3f5-f4e8d1fec18a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:32:10 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e857fb6f-897c-48ae-9834-150940de8d44 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Acquiring lock "cinder-quobyte-378218f1-baf9-4be3-b3f5-f4e8d1fec18a" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:32:10 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e857fb6f-897c-48ae-9834-150940de8d44 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Lock "cinder-quobyte-378218f1-baf9-4be3-b3f5-f4e8d1fec18a" acquired by "delete_volume" :: waited 0.021s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:32:10 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bacee6-4270-424b-a563-402d1a8a7c92]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:32:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e857fb6f-897c-48ae-9834-150940de8d44 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-378218f1-baf9-4be3-b3f5-f4e8d1fec18a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:10 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb1c29e5-d8fd-4adb-add9-a2f024e4bd53 tempest-SnapshotsActionsTest-816521708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.5e228721-ce59-4fa9-96b5-7aa0f56021b5" returned: 0 in 1.109s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:10 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-378218f1-baf9-4be3-b3f5-f4e8d1fec18a Jul 11 04:32:10 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:10 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fb1c29e5-d8fd-4adb-add9-a2f024e4bd53 tempest-SnapshotsActionsTest-816521708 None] Lock "cinder-quobyte-5e228721-ce59-4fa9-96b5-7aa0f56021b5" released by "_delete_snapshot" :: held 4.212s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:32:10 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fb1c29e5-d8fd-4adb-add9-a2f024e4bd53 tempest-SnapshotsActionsTest-816521708 None] Lock "cinder-quobyte-f8d305ce-c341-4981-a324-0974b0d97923" released by "delete_snapshot" :: held 4.235s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:32:11 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-fb1c29e5-d8fd-4adb-add9-a2f024e4bd53 tempest-SnapshotsActionsTest-816521708 None] Created reservations ['a4b781a1-af43-49eb-be1b-7152b5e1a1c9', '2f35a548-1992-4059-af06-4478e704b8fd', '1268c271-cab7-43e5-9bbf-300911393cb8', 'd43df557-1898-47ef-a708-13e2c78f9803'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:32:11 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-fb1c29e5-d8fd-4adb-add9-a2f024e4bd53 tempest-SnapshotsActionsTest-816521708 None] Delete snapshot completed successfully. Jul 11 04:32:11 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fb1c29e5-d8fd-4adb-add9-a2f024e4bd53 tempest-SnapshotsActionsTest-816521708 None] Lock "cinder-5e228721-ce59-4fa9-96b5-7aa0f56021b5-delete_snapshot" released by "delete_snapshot" :: held 4.427s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:32:11 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e857fb6f-897c-48ae-9834-150940de8d44 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-378218f1-baf9-4be3-b3f5-f4e8d1fec18a" returned: 0 in 0.993s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e857fb6f-897c-48ae-9834-150940de8d44 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-378218f1-baf9-4be3-b3f5-f4e8d1fec18a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:11 devstack sudo[96478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-378218f1-baf9-4be3-b3f5-f4e8d1fec18a Jul 11 04:32:11 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:12 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:12 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-641b1540-40e5-4717-91d8-d8142323d889 tempest-SnapshotsActionsTest-1830448284 None] Acquiring lock "cinder-c44d6217-2cbf-428a-889f-3b4cca0ea96c-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:32:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e857fb6f-897c-48ae-9834-150940de8d44 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-378218f1-baf9-4be3-b3f5-f4e8d1fec18a" returned: 0 in 0.921s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:12 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e857fb6f-897c-48ae-9834-150940de8d44 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Lock "cinder-quobyte-378218f1-baf9-4be3-b3f5-f4e8d1fec18a" released by "delete_volume" :: held 1.980s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:32:12 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-641b1540-40e5-4717-91d8-d8142323d889 tempest-SnapshotsActionsTest-1830448284 None] Lock "cinder-c44d6217-2cbf-428a-889f-3b4cca0ea96c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:32:12 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-641b1540-40e5-4717-91d8-d8142323d889 tempest-SnapshotsActionsTest-1830448284 None] Acquiring lock "cinder-quobyte-f8d305ce-c341-4981-a324-0974b0d97923" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:32:12 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-641b1540-40e5-4717-91d8-d8142323d889 tempest-SnapshotsActionsTest-1830448284 None] Lock "cinder-quobyte-f8d305ce-c341-4981-a324-0974b0d97923" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:32:12 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-641b1540-40e5-4717-91d8-d8142323d889 tempest-SnapshotsActionsTest-1830448284 None] Acquiring lock "cinder-quobyte-c44d6217-2cbf-428a-889f-3b4cca0ea96c" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:32:12 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-641b1540-40e5-4717-91d8-d8142323d889 tempest-SnapshotsActionsTest-1830448284 None] Lock "cinder-quobyte-c44d6217-2cbf-428a-889f-3b4cca0ea96c" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:32:12 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-641b1540-40e5-4717-91d8-d8142323d889 tempest-SnapshotsActionsTest-1830448284 None] Deleting offline snapshot c44d6217-2cbf-428a-889f-3b4cca0ea96c of volume f8d305ce-c341-4981-a324-0974b0d97923 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:32:12 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-641b1540-40e5-4717-91d8-d8142323d889 tempest-SnapshotsActionsTest-1830448284 None] snapshot_file for this snap is: volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:32:12 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3cc8ed-d25b-407e-bcde-1d1efe0d12e5]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:32:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-641b1540-40e5-4717-91d8-d8142323d889 tempest-SnapshotsActionsTest-1830448284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:12 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-e857fb6f-897c-48ae-9834-150940de8d44 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Created reservations ['fab47613-a0bd-4170-a3e3-cceefc535b99', '78c4c89c-f613-41c5-9706-540f8df3c499', '27fd18a9-0ff0-45ec-9b85-828bcc28e5cf', '1d82e5bb-b727-457c-8a6a-6734ecbf624a'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:32:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e857fb6f-897c-48ae-9834-150940de8d44 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:32:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e857fb6f-897c-48ae-9834-150940de8d44 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:32:13 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e857fb6f-897c-48ae-9834-150940de8d44 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:32:13 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e857fb6f-897c-48ae-9834-150940de8d44 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:32:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e857fb6f-897c-48ae-9834-150940de8d44 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:32:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e857fb6f-897c-48ae-9834-150940de8d44 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:13 devstack sudo[96482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:32:13 devstack sudo[96482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:13 devstack sudo[96481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c Jul 11 04:32:13 devstack sudo[96481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:13 devstack sudo[96481]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-641b1540-40e5-4717-91d8-d8142323d889 tempest-SnapshotsActionsTest-1830448284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c" returned: 0 in 1.120s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:14 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-641b1540-40e5-4717-91d8-d8142323d889 tempest-SnapshotsActionsTest-1830448284 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8d305ce-c341-4981-a324-0974b0d97923(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:32:14 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f265c5-d6b1-4894-bdc0-039db74694f3]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:32:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-641b1540-40e5-4717-91d8-d8142323d889 tempest-SnapshotsActionsTest-1830448284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:14 devstack sudo[96482]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e857fb6f-897c-48ae-9834-150940de8d44 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 1.213s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:14 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-e857fb6f-897c-48ae-9834-150940de8d44 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:32:14 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-e857fb6f-897c-48ae-9834-150940de8d44 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Deleted volume successfully. Jul 11 04:32:14 devstack sudo[96502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923 Jul 11 04:32:14 devstack sudo[96502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:14 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e857fb6f-897c-48ae-9834-150940de8d44 tempest-VolumeQuotasNegativeTestJSON-1464517900 None] Lock "cinder-378218f1-baf9-4be3-b3f5-f4e8d1fec18a-delete_volume" released by "delete_volume" :: held 3.582s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:32:15 devstack sudo[96502]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-641b1540-40e5-4717-91d8-d8142323d889 tempest-SnapshotsActionsTest-1830448284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923" returned: 0 in 1.122s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-641b1540-40e5-4717-91d8-d8142323d889 tempest-SnapshotsActionsTest-1830448284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:15 devstack sudo[96514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c Jul 11 04:32:15 devstack sudo[96514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:16 devstack sudo[96514]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-641b1540-40e5-4717-91d8-d8142323d889 tempest-SnapshotsActionsTest-1830448284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c" returned: 0 in 1.018s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-641b1540-40e5-4717-91d8-d8142323d889 tempest-SnapshotsActionsTest-1830448284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:16 devstack sudo[96521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c Jul 11 04:32:16 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:17 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-641b1540-40e5-4717-91d8-d8142323d889 tempest-SnapshotsActionsTest-1830448284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923.c44d6217-2cbf-428a-889f-3b4cca0ea96c" returned: 0 in 0.904s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-641b1540-40e5-4717-91d8-d8142323d889 tempest-SnapshotsActionsTest-1830448284 None] Lock "cinder-quobyte-c44d6217-2cbf-428a-889f-3b4cca0ea96c" released by "_delete_snapshot" :: held 4.363s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:32:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-641b1540-40e5-4717-91d8-d8142323d889 tempest-SnapshotsActionsTest-1830448284 None] Lock "cinder-quobyte-f8d305ce-c341-4981-a324-0974b0d97923" released by "delete_snapshot" :: held 4.406s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:32:17 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-641b1540-40e5-4717-91d8-d8142323d889 tempest-SnapshotsActionsTest-1830448284 None] Created reservations ['f1db33d7-ad85-4e25-9b75-034b3d4be8a6', '5f580ae9-359b-4227-bf4e-4ea6b1fb8cd2', '8e81b6be-ddbc-4099-9d57-ae43075422fe', '1a8f3012-f3ac-476d-bc02-892f150a393b'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:32:17 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-641b1540-40e5-4717-91d8-d8142323d889 tempest-SnapshotsActionsTest-1830448284 None] Delete snapshot completed successfully. Jul 11 04:32:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-641b1540-40e5-4717-91d8-d8142323d889 tempest-SnapshotsActionsTest-1830448284 None] Lock "cinder-c44d6217-2cbf-428a-889f-3b4cca0ea96c-delete_snapshot" released by "delete_snapshot" :: held 4.596s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:32:18 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-cebe5906-d598-40da-a4b7-a32c64952ede tempest-SnapshotsActionsTest-1830448284 None] Acquiring lock "cinder-f8d305ce-c341-4981-a324-0974b0d97923-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:32:18 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-cebe5906-d598-40da-a4b7-a32c64952ede tempest-SnapshotsActionsTest-1830448284 None] Lock "cinder-f8d305ce-c341-4981-a324-0974b0d97923-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:32:18 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-cebe5906-d598-40da-a4b7-a32c64952ede tempest-SnapshotsActionsTest-1830448284 None] Acquiring lock "cinder-quobyte-f8d305ce-c341-4981-a324-0974b0d97923" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:32:18 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-cebe5906-d598-40da-a4b7-a32c64952ede tempest-SnapshotsActionsTest-1830448284 None] Lock "cinder-quobyte-f8d305ce-c341-4981-a324-0974b0d97923" acquired by "delete_volume" :: waited 0.021s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:32:18 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf652b7-bdaf-4742-bee1-b24a1941dbb9]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:32:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cebe5906-d598-40da-a4b7-a32c64952ede tempest-SnapshotsActionsTest-1830448284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:18 devstack sudo[96563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923 Jul 11 04:32:18 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:19 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cebe5906-d598-40da-a4b7-a32c64952ede tempest-SnapshotsActionsTest-1830448284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923" returned: 0 in 1.068s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cebe5906-d598-40da-a4b7-a32c64952ede tempest-SnapshotsActionsTest-1830448284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:19 devstack sudo[96586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923 Jul 11 04:32:19 devstack sudo[96586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:20 devstack sudo[96586]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cebe5906-d598-40da-a4b7-a32c64952ede tempest-SnapshotsActionsTest-1830448284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f8d305ce-c341-4981-a324-0974b0d97923" returned: 0 in 0.747s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:20 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-cebe5906-d598-40da-a4b7-a32c64952ede tempest-SnapshotsActionsTest-1830448284 None] Lock "cinder-quobyte-f8d305ce-c341-4981-a324-0974b0d97923" released by "delete_volume" :: held 1.886s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:32:20 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-cebe5906-d598-40da-a4b7-a32c64952ede tempest-SnapshotsActionsTest-1830448284 None] Created reservations ['9fab5cf8-0512-4ca3-9cae-1b980d253bd8', '3ebdff9c-27c1-4d14-a663-6fd073bbb831', '318b4bf4-ddfd-4186-bb64-e221164f4f3f', '5832091a-774e-40f4-b1fc-0e5d439ec854'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:32:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-cebe5906-d598-40da-a4b7-a32c64952ede tempest-SnapshotsActionsTest-1830448284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:32:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-cebe5906-d598-40da-a4b7-a32c64952ede tempest-SnapshotsActionsTest-1830448284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:32:20 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-cebe5906-d598-40da-a4b7-a32c64952ede tempest-SnapshotsActionsTest-1830448284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:32:20 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-cebe5906-d598-40da-a4b7-a32c64952ede tempest-SnapshotsActionsTest-1830448284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:32:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-cebe5906-d598-40da-a4b7-a32c64952ede tempest-SnapshotsActionsTest-1830448284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:32:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cebe5906-d598-40da-a4b7-a32c64952ede tempest-SnapshotsActionsTest-1830448284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:20 devstack sudo[96592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:32:20 devstack sudo[96592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:21 devstack sudo[96592]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cebe5906-d598-40da-a4b7-a32c64952ede tempest-SnapshotsActionsTest-1830448284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 1.074s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:21 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-cebe5906-d598-40da-a4b7-a32c64952ede tempest-SnapshotsActionsTest-1830448284 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:32:21 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-cebe5906-d598-40da-a4b7-a32c64952ede tempest-SnapshotsActionsTest-1830448284 None] Deleted volume successfully. Jul 11 04:32:21 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-cebe5906-d598-40da-a4b7-a32c64952ede tempest-SnapshotsActionsTest-1830448284 None] Lock "cinder-f8d305ce-c341-4981-a324-0974b0d97923-delete_volume" released by "delete_volume" :: held 3.233s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:32:28 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=92,cinder:UPDATE=100,cinder:DELETE=7,cinder:INSERT=25 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:32:28 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-fefaad35-0230-4001-a241-2abca7c36ffb tempest-TestServerVolumeAttachmentScenario-2105694299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:32:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fefaad35-0230-4001-a241-2abca7c36ffb tempest-TestServerVolumeAttachmentScenario-2105694299 None] Flow 'volume_create_manager' (62284b51-cc9b-46f7-ab26-231e8ab21693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:32:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fefaad35-0230-4001-a241-2abca7c36ffb tempest-TestServerVolumeAttachmentScenario-2105694299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (835a724d-d94b-4e99-b8f3-120317a97ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:32:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fefaad35-0230-4001-a241-2abca7c36ffb tempest-TestServerVolumeAttachmentScenario-2105694299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (835a724d-d94b-4e99-b8f3-120317a97ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-106328069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bcd6c98-b33c-4250-a5f6-0be9b8ed7532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ec5c021498840f19ea4249ab331a279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:32:28Z,use_quota=True,user_id='d3108f0aee9a41d5b85339666d8ff75e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:32:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fefaad35-0230-4001-a241-2abca7c36ffb tempest-TestServerVolumeAttachmentScenario-2105694299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd54478d-feb9-4658-93ab-f59da0564168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:32:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fefaad35-0230-4001-a241-2abca7c36ffb tempest-TestServerVolumeAttachmentScenario-2105694299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd54478d-feb9-4658-93ab-f59da0564168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:32:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fefaad35-0230-4001-a241-2abca7c36ffb tempest-TestServerVolumeAttachmentScenario-2105694299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a48106b1-2f49-44ec-8a0c-b303f7d9b2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:32:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fefaad35-0230-4001-a241-2abca7c36ffb tempest-TestServerVolumeAttachmentScenario-2105694299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a48106b1-2f49-44ec-8a0c-b303f7d9b2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bcd6c98-b33c-4250-a5f6-0be9b8ed7532', 'volume_name': 'volume-5bcd6c98-b33c-4250-a5f6-0be9b8ed7532', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:32:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fefaad35-0230-4001-a241-2abca7c36ffb tempest-TestServerVolumeAttachmentScenario-2105694299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bbca8bd-7535-49e1-bf12-faa17b9430d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:32:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fefaad35-0230-4001-a241-2abca7c36ffb tempest-TestServerVolumeAttachmentScenario-2105694299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bbca8bd-7535-49e1-bf12-faa17b9430d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:32:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fefaad35-0230-4001-a241-2abca7c36ffb tempest-TestServerVolumeAttachmentScenario-2105694299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b96c5c9-466a-43a8-ae55-afce053f7b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:32:28 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-fefaad35-0230-4001-a241-2abca7c36ffb tempest-TestServerVolumeAttachmentScenario-2105694299 None] Volume 5bcd6c98-b33c-4250-a5f6-0be9b8ed7532: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bcd6c98-b33c-4250-a5f6-0be9b8ed7532', 'volume_size': 1} Jul 11 04:32:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fefaad35-0230-4001-a241-2abca7c36ffb tempest-TestServerVolumeAttachmentScenario-2105694299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:32:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fefaad35-0230-4001-a241-2abca7c36ffb tempest-TestServerVolumeAttachmentScenario-2105694299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:32:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-fefaad35-0230-4001-a241-2abca7c36ffb tempest-TestServerVolumeAttachmentScenario-2105694299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-106328069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bcd6c98-b33c-4250-a5f6-0be9b8ed7532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ec5c021498840f19ea4249ab331a279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:32:28Z,use_quota=True,user_id='d3108f0aee9a41d5b85339666d8ff75e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:32:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-fefaad35-0230-4001-a241-2abca7c36ffb tempest-TestServerVolumeAttachmentScenario-2105694299 None] Creating volume 5bcd6c98-b33c-4250-a5f6-0be9b8ed7532 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:32:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fefaad35-0230-4001-a241-2abca7c36ffb tempest-TestServerVolumeAttachmentScenario-2105694299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:32:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fefaad35-0230-4001-a241-2abca7c36ffb tempest-TestServerVolumeAttachmentScenario-2105694299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:32:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-fefaad35-0230-4001-a241-2abca7c36ffb tempest-TestServerVolumeAttachmentScenario-2105694299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:32:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-fefaad35-0230-4001-a241-2abca7c36ffb tempest-TestServerVolumeAttachmentScenario-2105694299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:32:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fefaad35-0230-4001-a241-2abca7c36ffb tempest-TestServerVolumeAttachmentScenario-2105694299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:32:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-fefaad35-0230-4001-a241-2abca7c36ffb tempest-TestServerVolumeAttachmentScenario-2105694299 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:32:28 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-fefaad35-0230-4001-a241-2abca7c36ffb tempest-TestServerVolumeAttachmentScenario-2105694299 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:32:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fefaad35-0230-4001-a241-2abca7c36ffb tempest-TestServerVolumeAttachmentScenario-2105694299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5bcd6c98-b33c-4250-a5f6-0be9b8ed7532 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:28 devstack sudo[96618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5bcd6c98-b33c-4250-a5f6-0be9b8ed7532 1073741824 Jul 11 04:32:28 devstack sudo[96618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:29 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-014ed28f-5a67-48fe-a9ed-d0daa19eb7a3 tempest-TestServerVolumeAttachmentScenario-2105694299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:32:29 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-014ed28f-5a67-48fe-a9ed-d0daa19eb7a3 tempest-TestServerVolumeAttachmentScenario-2105694299 None] Flow 'volume_create_manager' (7064bbb8-d6a6-4ce1-9aee-433e194829e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:32:29 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-014ed28f-5a67-48fe-a9ed-d0daa19eb7a3 tempest-TestServerVolumeAttachmentScenario-2105694299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb31ac2-f08e-4153-b344-eb8db1870e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:32:29 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-014ed28f-5a67-48fe-a9ed-d0daa19eb7a3 tempest-TestServerVolumeAttachmentScenario-2105694299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb31ac2-f08e-4153-b344-eb8db1870e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1985992618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc330634-78a6-4e18-b31a-8f29b5003c43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ec5c021498840f19ea4249ab331a279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:32:29Z,use_quota=True,user_id='d3108f0aee9a41d5b85339666d8ff75e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:32:29 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-014ed28f-5a67-48fe-a9ed-d0daa19eb7a3 tempest-TestServerVolumeAttachmentScenario-2105694299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84ad4bb5-885b-4256-8000-c48e13044953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:32:29 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-014ed28f-5a67-48fe-a9ed-d0daa19eb7a3 tempest-TestServerVolumeAttachmentScenario-2105694299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84ad4bb5-885b-4256-8000-c48e13044953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:32:29 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-014ed28f-5a67-48fe-a9ed-d0daa19eb7a3 tempest-TestServerVolumeAttachmentScenario-2105694299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b088d4ab-fad5-4f85-889e-4a90f8aada6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:32:29 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-014ed28f-5a67-48fe-a9ed-d0daa19eb7a3 tempest-TestServerVolumeAttachmentScenario-2105694299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b088d4ab-fad5-4f85-889e-4a90f8aada6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc330634-78a6-4e18-b31a-8f29b5003c43', 'volume_name': 'volume-dc330634-78a6-4e18-b31a-8f29b5003c43', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:32:29 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-014ed28f-5a67-48fe-a9ed-d0daa19eb7a3 tempest-TestServerVolumeAttachmentScenario-2105694299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80bbc1e2-b5b9-4a0d-ac85-6a555d5b89ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:32:29 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-014ed28f-5a67-48fe-a9ed-d0daa19eb7a3 tempest-TestServerVolumeAttachmentScenario-2105694299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80bbc1e2-b5b9-4a0d-ac85-6a555d5b89ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:32:29 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-014ed28f-5a67-48fe-a9ed-d0daa19eb7a3 tempest-TestServerVolumeAttachmentScenario-2105694299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8586e1e4-67f0-4517-9a04-e03af43fb63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:32:29 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-014ed28f-5a67-48fe-a9ed-d0daa19eb7a3 tempest-TestServerVolumeAttachmentScenario-2105694299 None] Volume dc330634-78a6-4e18-b31a-8f29b5003c43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc330634-78a6-4e18-b31a-8f29b5003c43', 'volume_size': 1} Jul 11 04:32:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-014ed28f-5a67-48fe-a9ed-d0daa19eb7a3 tempest-TestServerVolumeAttachmentScenario-2105694299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:32:30 devstack sudo[96618]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fefaad35-0230-4001-a241-2abca7c36ffb tempest-TestServerVolumeAttachmentScenario-2105694299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5bcd6c98-b33c-4250-a5f6-0be9b8ed7532 1073741824" returned: 0 in 2.114s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fefaad35-0230-4001-a241-2abca7c36ffb tempest-TestServerVolumeAttachmentScenario-2105694299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5bcd6c98-b33c-4250-a5f6-0be9b8ed7532 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:30 devstack sudo[96624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5bcd6c98-b33c-4250-a5f6-0be9b8ed7532 Jul 11 04:32:30 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:31 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fefaad35-0230-4001-a241-2abca7c36ffb tempest-TestServerVolumeAttachmentScenario-2105694299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5bcd6c98-b33c-4250-a5f6-0be9b8ed7532" returned: 0 in 0.950s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:31 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-fefaad35-0230-4001-a241-2abca7c36ffb tempest-TestServerVolumeAttachmentScenario-2105694299 None] <== create_volume: return (3178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:32:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fefaad35-0230-4001-a241-2abca7c36ffb tempest-TestServerVolumeAttachmentScenario-2105694299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.186s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:32:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-014ed28f-5a67-48fe-a9ed-d0daa19eb7a3 tempest-TestServerVolumeAttachmentScenario-2105694299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.954s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:32:31 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-014ed28f-5a67-48fe-a9ed-d0daa19eb7a3 tempest-TestServerVolumeAttachmentScenario-2105694299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1985992618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc330634-78a6-4e18-b31a-8f29b5003c43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ec5c021498840f19ea4249ab331a279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:32:29Z,use_quota=True,user_id='d3108f0aee9a41d5b85339666d8ff75e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:32:31 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-014ed28f-5a67-48fe-a9ed-d0daa19eb7a3 tempest-TestServerVolumeAttachmentScenario-2105694299 None] Creating volume dc330634-78a6-4e18-b31a-8f29b5003c43 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:32:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-014ed28f-5a67-48fe-a9ed-d0daa19eb7a3 tempest-TestServerVolumeAttachmentScenario-2105694299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:32:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-014ed28f-5a67-48fe-a9ed-d0daa19eb7a3 tempest-TestServerVolumeAttachmentScenario-2105694299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:32:31 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-014ed28f-5a67-48fe-a9ed-d0daa19eb7a3 tempest-TestServerVolumeAttachmentScenario-2105694299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:32:31 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-014ed28f-5a67-48fe-a9ed-d0daa19eb7a3 tempest-TestServerVolumeAttachmentScenario-2105694299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:32:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-014ed28f-5a67-48fe-a9ed-d0daa19eb7a3 tempest-TestServerVolumeAttachmentScenario-2105694299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:32:31 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-014ed28f-5a67-48fe-a9ed-d0daa19eb7a3 tempest-TestServerVolumeAttachmentScenario-2105694299 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:32:31 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-014ed28f-5a67-48fe-a9ed-d0daa19eb7a3 tempest-TestServerVolumeAttachmentScenario-2105694299 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:32:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-014ed28f-5a67-48fe-a9ed-d0daa19eb7a3 tempest-TestServerVolumeAttachmentScenario-2105694299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dc330634-78a6-4e18-b31a-8f29b5003c43 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:31 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fefaad35-0230-4001-a241-2abca7c36ffb tempest-TestServerVolumeAttachmentScenario-2105694299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b96c5c9-466a-43a8-ae55-afce053f7b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bcd6c98-b33c-4250-a5f6-0be9b8ed7532', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:32:31 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fefaad35-0230-4001-a241-2abca7c36ffb tempest-TestServerVolumeAttachmentScenario-2105694299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (749b0cff-d21b-4b61-99f7-99bbe6ef7a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:32:31 devstack sudo[96628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dc330634-78a6-4e18-b31a-8f29b5003c43 1073741824 Jul 11 04:32:31 devstack sudo[96628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:31 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-fefaad35-0230-4001-a241-2abca7c36ffb tempest-TestServerVolumeAttachmentScenario-2105694299 None] Volume volume-5bcd6c98-b33c-4250-a5f6-0be9b8ed7532 (5bcd6c98-b33c-4250-a5f6-0be9b8ed7532): created successfully Jul 11 04:32:31 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fefaad35-0230-4001-a241-2abca7c36ffb tempest-TestServerVolumeAttachmentScenario-2105694299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (749b0cff-d21b-4b61-99f7-99bbe6ef7a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:32:31 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fefaad35-0230-4001-a241-2abca7c36ffb tempest-TestServerVolumeAttachmentScenario-2105694299 None] Flow 'volume_create_manager' (62284b51-cc9b-46f7-ab26-231e8ab21693) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:32:31 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-fefaad35-0230-4001-a241-2abca7c36ffb tempest-TestServerVolumeAttachmentScenario-2105694299 None] Created volume successfully. Jul 11 04:32:32 devstack sudo[96628]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-014ed28f-5a67-48fe-a9ed-d0daa19eb7a3 tempest-TestServerVolumeAttachmentScenario-2105694299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dc330634-78a6-4e18-b31a-8f29b5003c43 1073741824" returned: 0 in 1.150s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-014ed28f-5a67-48fe-a9ed-d0daa19eb7a3 tempest-TestServerVolumeAttachmentScenario-2105694299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dc330634-78a6-4e18-b31a-8f29b5003c43 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:33 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dc330634-78a6-4e18-b31a-8f29b5003c43 Jul 11 04:32:33 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:33 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca2499b2-0a36-4fdb-a125-37050f427bc9 tempest-SnapshotMetadataTestJSON-209675994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:32:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ca2499b2-0a36-4fdb-a125-37050f427bc9 tempest-SnapshotMetadataTestJSON-209675994 None] Flow 'volume_create_manager' (151e6f42-e046-4dba-97b3-e727e33f8e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:32:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ca2499b2-0a36-4fdb-a125-37050f427bc9 tempest-SnapshotMetadataTestJSON-209675994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb161fa8-acce-4bbf-833f-a6a6763e70a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:32:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ca2499b2-0a36-4fdb-a125-37050f427bc9 tempest-SnapshotMetadataTestJSON-209675994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb161fa8-acce-4bbf-833f-a6a6763e70a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-564130055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab3146ba-ac8c-458d-bfd9-f74f7e424ad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6d8f924e73b4d678b2cb834e348362a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:32:33Z,use_quota=True,user_id='4238550969ba4f6187dcb416180af381',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:32:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ca2499b2-0a36-4fdb-a125-37050f427bc9 tempest-SnapshotMetadataTestJSON-209675994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (527c6234-2981-4ac7-9668-4c0dcf875211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:32:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ca2499b2-0a36-4fdb-a125-37050f427bc9 tempest-SnapshotMetadataTestJSON-209675994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (527c6234-2981-4ac7-9668-4c0dcf875211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:32:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ca2499b2-0a36-4fdb-a125-37050f427bc9 tempest-SnapshotMetadataTestJSON-209675994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a6fa54-d15d-4af0-b32b-a60261fc19cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:32:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ca2499b2-0a36-4fdb-a125-37050f427bc9 tempest-SnapshotMetadataTestJSON-209675994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a6fa54-d15d-4af0-b32b-a60261fc19cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab3146ba-ac8c-458d-bfd9-f74f7e424ad8', 'volume_name': 'volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:32:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ca2499b2-0a36-4fdb-a125-37050f427bc9 tempest-SnapshotMetadataTestJSON-209675994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b460cd3f-eef7-4e33-89f1-dfdb8761db87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:32:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ca2499b2-0a36-4fdb-a125-37050f427bc9 tempest-SnapshotMetadataTestJSON-209675994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b460cd3f-eef7-4e33-89f1-dfdb8761db87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:32:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ca2499b2-0a36-4fdb-a125-37050f427bc9 tempest-SnapshotMetadataTestJSON-209675994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a890960-7329-42b8-9a82-2c3186fa211b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:32:33 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-ca2499b2-0a36-4fdb-a125-37050f427bc9 tempest-SnapshotMetadataTestJSON-209675994 None] Volume ab3146ba-ac8c-458d-bfd9-f74f7e424ad8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8', 'volume_size': 1} Jul 11 04:32:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ca2499b2-0a36-4fdb-a125-37050f427bc9 tempest-SnapshotMetadataTestJSON-209675994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:32:33 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-014ed28f-5a67-48fe-a9ed-d0daa19eb7a3 tempest-TestServerVolumeAttachmentScenario-2105694299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dc330634-78a6-4e18-b31a-8f29b5003c43" returned: 0 in 0.891s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:33 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-014ed28f-5a67-48fe-a9ed-d0daa19eb7a3 tempest-TestServerVolumeAttachmentScenario-2105694299 None] <== create_volume: return (2137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:32:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-014ed28f-5a67-48fe-a9ed-d0daa19eb7a3 tempest-TestServerVolumeAttachmentScenario-2105694299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.146s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:32:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ca2499b2-0a36-4fdb-a125-37050f427bc9 tempest-SnapshotMetadataTestJSON-209675994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.486s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:32:33 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ca2499b2-0a36-4fdb-a125-37050f427bc9 tempest-SnapshotMetadataTestJSON-209675994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-564130055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab3146ba-ac8c-458d-bfd9-f74f7e424ad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6d8f924e73b4d678b2cb834e348362a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:32:33Z,use_quota=True,user_id='4238550969ba4f6187dcb416180af381',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:32:33 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-ca2499b2-0a36-4fdb-a125-37050f427bc9 tempest-SnapshotMetadataTestJSON-209675994 None] Creating volume ab3146ba-ac8c-458d-bfd9-f74f7e424ad8 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:32:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ca2499b2-0a36-4fdb-a125-37050f427bc9 tempest-SnapshotMetadataTestJSON-209675994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:32:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ca2499b2-0a36-4fdb-a125-37050f427bc9 tempest-SnapshotMetadataTestJSON-209675994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:32:33 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ca2499b2-0a36-4fdb-a125-37050f427bc9 tempest-SnapshotMetadataTestJSON-209675994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:32:33 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ca2499b2-0a36-4fdb-a125-37050f427bc9 tempest-SnapshotMetadataTestJSON-209675994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:32:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ca2499b2-0a36-4fdb-a125-37050f427bc9 tempest-SnapshotMetadataTestJSON-209675994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:32:33 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ca2499b2-0a36-4fdb-a125-37050f427bc9 tempest-SnapshotMetadataTestJSON-209675994 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:32:33 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-ca2499b2-0a36-4fdb-a125-37050f427bc9 tempest-SnapshotMetadataTestJSON-209675994 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:32:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ca2499b2-0a36-4fdb-a125-37050f427bc9 tempest-SnapshotMetadataTestJSON-209675994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:33 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:DELETE=7,cinder:SELECT=95,cinder:UPDATE=102,cinder:INSERT=28 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:32:33 devstack sudo[96638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8 1073741824 Jul 11 04:32:33 devstack sudo[96638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-014ed28f-5a67-48fe-a9ed-d0daa19eb7a3 tempest-TestServerVolumeAttachmentScenario-2105694299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8586e1e4-67f0-4517-9a04-e03af43fb63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc330634-78a6-4e18-b31a-8f29b5003c43', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:32:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-014ed28f-5a67-48fe-a9ed-d0daa19eb7a3 tempest-TestServerVolumeAttachmentScenario-2105694299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (323d4634-b5dd-4b18-bff3-73dbfb5c7f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:32:33 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-014ed28f-5a67-48fe-a9ed-d0daa19eb7a3 tempest-TestServerVolumeAttachmentScenario-2105694299 None] Volume volume-dc330634-78a6-4e18-b31a-8f29b5003c43 (dc330634-78a6-4e18-b31a-8f29b5003c43): created successfully Jul 11 04:32:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-014ed28f-5a67-48fe-a9ed-d0daa19eb7a3 tempest-TestServerVolumeAttachmentScenario-2105694299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (323d4634-b5dd-4b18-bff3-73dbfb5c7f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:32:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-014ed28f-5a67-48fe-a9ed-d0daa19eb7a3 tempest-TestServerVolumeAttachmentScenario-2105694299 None] Flow 'volume_create_manager' (7064bbb8-d6a6-4ce1-9aee-433e194829e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:32:33 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-014ed28f-5a67-48fe-a9ed-d0daa19eb7a3 tempest-TestServerVolumeAttachmentScenario-2105694299 None] Created volume successfully. Jul 11 04:32:34 devstack sudo[96638]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ca2499b2-0a36-4fdb-a125-37050f427bc9 tempest-SnapshotMetadataTestJSON-209675994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8 1073741824" returned: 0 in 1.099s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ca2499b2-0a36-4fdb-a125-37050f427bc9 tempest-SnapshotMetadataTestJSON-209675994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:35 devstack sudo[96674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8 Jul 11 04:32:35 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:35 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ca2499b2-0a36-4fdb-a125-37050f427bc9 tempest-SnapshotMetadataTestJSON-209675994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8" returned: 0 in 0.747s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:35 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ca2499b2-0a36-4fdb-a125-37050f427bc9 tempest-SnapshotMetadataTestJSON-209675994 None] <== create_volume: return (1936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:32:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ca2499b2-0a36-4fdb-a125-37050f427bc9 tempest-SnapshotMetadataTestJSON-209675994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:32:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ca2499b2-0a36-4fdb-a125-37050f427bc9 tempest-SnapshotMetadataTestJSON-209675994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a890960-7329-42b8-9a82-2c3186fa211b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:32:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ca2499b2-0a36-4fdb-a125-37050f427bc9 tempest-SnapshotMetadataTestJSON-209675994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d62020a6-eff1-4fc4-83b3-ecf0a72a516a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:32:35 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-ca2499b2-0a36-4fdb-a125-37050f427bc9 tempest-SnapshotMetadataTestJSON-209675994 None] Volume volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8 (ab3146ba-ac8c-458d-bfd9-f74f7e424ad8): created successfully Jul 11 04:32:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ca2499b2-0a36-4fdb-a125-37050f427bc9 tempest-SnapshotMetadataTestJSON-209675994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d62020a6-eff1-4fc4-83b3-ecf0a72a516a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:32:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ca2499b2-0a36-4fdb-a125-37050f427bc9 tempest-SnapshotMetadataTestJSON-209675994 None] Flow 'volume_create_manager' (151e6f42-e046-4dba-97b3-e727e33f8e45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:32:35 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-ca2499b2-0a36-4fdb-a125-37050f427bc9 tempest-SnapshotMetadataTestJSON-209675994 None] Created volume successfully. Jul 11 04:32:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-af91b8b5-13fb-4f10-a510-4af18b70e3ba tempest-SnapshotMetadataTestJSON-209675994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:32:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-af91b8b5-13fb-4f10-a510-4af18b70e3ba tempest-SnapshotMetadataTestJSON-209675994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:32:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-af91b8b5-13fb-4f10-a510-4af18b70e3ba tempest-SnapshotMetadataTestJSON-209675994 None] Creating offline snapshot 7fb9e59e-bb92-4855-8d2f-ef8fefa649cf of volume ab3146ba-ac8c-458d-bfd9-f74f7e424ad8 {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:32:36 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e8f296-4463-4a44-a866-358224896b81]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:32:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-af91b8b5-13fb-4f10-a510-4af18b70e3ba tempest-SnapshotMetadataTestJSON-209675994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:36 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8 Jul 11 04:32:36 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:37 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-af91b8b5-13fb-4f10-a510-4af18b70e3ba tempest-SnapshotMetadataTestJSON-209675994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8" returned: 0 in 0.791s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-af91b8b5-13fb-4f10-a510-4af18b70e3ba tempest-SnapshotMetadataTestJSON-209675994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8.7fb9e59e-bb92-4855-8d2f-ef8fefa649cf 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:37 devstack sudo[96685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8.7fb9e59e-bb92-4855-8d2f-ef8fefa649cf 1G Jul 11 04:32:37 devstack sudo[96685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:38 devstack sudo[96685]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-af91b8b5-13fb-4f10-a510-4af18b70e3ba tempest-SnapshotMetadataTestJSON-209675994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8.7fb9e59e-bb92-4855-8d2f-ef8fefa649cf 1G" returned: 0 in 0.886s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-af91b8b5-13fb-4f10-a510-4af18b70e3ba tempest-SnapshotMetadataTestJSON-209675994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8.7fb9e59e-bb92-4855-8d2f-ef8fefa649cf {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:38 devstack sudo[96691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8.7fb9e59e-bb92-4855-8d2f-ef8fefa649cf Jul 11 04:32:38 devstack sudo[96691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:38 devstack sudo[96691]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-af91b8b5-13fb-4f10-a510-4af18b70e3ba tempest-SnapshotMetadataTestJSON-209675994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8.7fb9e59e-bb92-4855-8d2f-ef8fefa649cf" returned: 0 in 0.720s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:38 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-af91b8b5-13fb-4f10-a510-4af18b70e3ba tempest-SnapshotMetadataTestJSON-209675994 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8.7fb9e59e-bb92-4855-8d2f-ef8fefa649cf is being set with open permissions: ugo+rw Jul 11 04:32:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-af91b8b5-13fb-4f10-a510-4af18b70e3ba tempest-SnapshotMetadataTestJSON-209675994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8.7fb9e59e-bb92-4855-8d2f-ef8fefa649cf {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:38 devstack sudo[96697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8.7fb9e59e-bb92-4855-8d2f-ef8fefa649cf Jul 11 04:32:38 devstack sudo[96697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:39 devstack sudo[96697]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-af91b8b5-13fb-4f10-a510-4af18b70e3ba tempest-SnapshotMetadataTestJSON-209675994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8.7fb9e59e-bb92-4855-8d2f-ef8fefa649cf" returned: 0 in 0.721s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-af91b8b5-13fb-4f10-a510-4af18b70e3ba tempest-SnapshotMetadataTestJSON-209675994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:39 devstack sudo[96700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8.info Jul 11 04:32:39 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:40 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-af91b8b5-13fb-4f10-a510-4af18b70e3ba tempest-SnapshotMetadataTestJSON-209675994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8.info" returned: 0 in 0.898s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:40 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-af91b8b5-13fb-4f10-a510-4af18b70e3ba tempest-SnapshotMetadataTestJSON-209675994 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8.info is being set with open permissions: ugo+rw Jul 11 04:32:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-af91b8b5-13fb-4f10-a510-4af18b70e3ba tempest-SnapshotMetadataTestJSON-209675994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:40 devstack sudo[96703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8.info Jul 11 04:32:40 devstack sudo[96703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:41 devstack sudo[96703]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-af91b8b5-13fb-4f10-a510-4af18b70e3ba tempest-SnapshotMetadataTestJSON-209675994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8.info" returned: 0 in 1.054s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-af91b8b5-13fb-4f10-a510-4af18b70e3ba tempest-SnapshotMetadataTestJSON-209675994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.202s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:32:41 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-af91b8b5-13fb-4f10-a510-4af18b70e3ba tempest-SnapshotMetadataTestJSON-209675994 None] Create snapshot completed successfully Jul 11 04:32:43 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d454d756-b37a-42d1-a0ba-2ec82f2f322c tempest-SnapshotMetadataTestJSON-209675994 None] Acquiring lock "cinder-7fb9e59e-bb92-4855-8d2f-ef8fefa649cf-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:32:43 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d454d756-b37a-42d1-a0ba-2ec82f2f322c tempest-SnapshotMetadataTestJSON-209675994 None] Lock "cinder-7fb9e59e-bb92-4855-8d2f-ef8fefa649cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:32:43 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d454d756-b37a-42d1-a0ba-2ec82f2f322c tempest-SnapshotMetadataTestJSON-209675994 None] Acquiring lock "cinder-quobyte-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:32:43 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d454d756-b37a-42d1-a0ba-2ec82f2f322c tempest-SnapshotMetadataTestJSON-209675994 None] Lock "cinder-quobyte-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:32:43 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d454d756-b37a-42d1-a0ba-2ec82f2f322c tempest-SnapshotMetadataTestJSON-209675994 None] Acquiring lock "cinder-quobyte-7fb9e59e-bb92-4855-8d2f-ef8fefa649cf" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:32:43 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d454d756-b37a-42d1-a0ba-2ec82f2f322c tempest-SnapshotMetadataTestJSON-209675994 None] Lock "cinder-quobyte-7fb9e59e-bb92-4855-8d2f-ef8fefa649cf" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:32:43 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-d454d756-b37a-42d1-a0ba-2ec82f2f322c tempest-SnapshotMetadataTestJSON-209675994 None] Deleting offline snapshot 7fb9e59e-bb92-4855-8d2f-ef8fefa649cf of volume ab3146ba-ac8c-458d-bfd9-f74f7e424ad8 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:32:43 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-d454d756-b37a-42d1-a0ba-2ec82f2f322c tempest-SnapshotMetadataTestJSON-209675994 None] snapshot_file for this snap is: volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8.7fb9e59e-bb92-4855-8d2f-ef8fefa649cf {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:32:43 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67eeafe-424f-4e76-9dbd-9419c4d6db7f]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:32:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d454d756-b37a-42d1-a0ba-2ec82f2f322c tempest-SnapshotMetadataTestJSON-209675994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8.7fb9e59e-bb92-4855-8d2f-ef8fefa649cf {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:43 devstack sudo[96725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8.7fb9e59e-bb92-4855-8d2f-ef8fefa649cf Jul 11 04:32:43 devstack sudo[96725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:44 devstack sudo[96725]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d454d756-b37a-42d1-a0ba-2ec82f2f322c tempest-SnapshotMetadataTestJSON-209675994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8.7fb9e59e-bb92-4855-8d2f-ef8fefa649cf" returned: 0 in 0.833s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:44 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-d454d756-b37a-42d1-a0ba-2ec82f2f322c tempest-SnapshotMetadataTestJSON-209675994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:32:44 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e5ad45-3fd1-4b72-8ed1-b62033cd115a]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:32:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d454d756-b37a-42d1-a0ba-2ec82f2f322c tempest-SnapshotMetadataTestJSON-209675994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:44 devstack sudo[96730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8 Jul 11 04:32:44 devstack sudo[96730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:45 devstack sudo[96730]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d454d756-b37a-42d1-a0ba-2ec82f2f322c tempest-SnapshotMetadataTestJSON-209675994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8" returned: 0 in 1.062s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d454d756-b37a-42d1-a0ba-2ec82f2f322c tempest-SnapshotMetadataTestJSON-209675994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8.7fb9e59e-bb92-4855-8d2f-ef8fefa649cf {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:45 devstack sudo[96772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8.7fb9e59e-bb92-4855-8d2f-ef8fefa649cf Jul 11 04:32:45 devstack sudo[96772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:46 devstack sudo[96772]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d454d756-b37a-42d1-a0ba-2ec82f2f322c tempest-SnapshotMetadataTestJSON-209675994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8.7fb9e59e-bb92-4855-8d2f-ef8fefa649cf" returned: 0 in 1.021s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d454d756-b37a-42d1-a0ba-2ec82f2f322c tempest-SnapshotMetadataTestJSON-209675994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8.7fb9e59e-bb92-4855-8d2f-ef8fefa649cf {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:46 devstack sudo[96808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8.7fb9e59e-bb92-4855-8d2f-ef8fefa649cf Jul 11 04:32:46 devstack sudo[96808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:47 devstack sudo[96808]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d454d756-b37a-42d1-a0ba-2ec82f2f322c tempest-SnapshotMetadataTestJSON-209675994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8.7fb9e59e-bb92-4855-8d2f-ef8fefa649cf" returned: 0 in 1.043s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:47 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d454d756-b37a-42d1-a0ba-2ec82f2f322c tempest-SnapshotMetadataTestJSON-209675994 None] Lock "cinder-quobyte-7fb9e59e-bb92-4855-8d2f-ef8fefa649cf" released by "_delete_snapshot" :: held 4.120s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:32:47 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d454d756-b37a-42d1-a0ba-2ec82f2f322c tempest-SnapshotMetadataTestJSON-209675994 None] Lock "cinder-quobyte-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8" released by "delete_snapshot" :: held 4.154s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:32:47 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-d454d756-b37a-42d1-a0ba-2ec82f2f322c tempest-SnapshotMetadataTestJSON-209675994 None] Created reservations ['1210d5a6-e7b6-467d-be5c-00dca6fa40e3', 'f264d53b-956a-4002-97d5-b99d41c033c3', 'f23425ff-d07c-461e-886b-8e317192bbef', 'c221e0e6-4151-4dd2-b39b-6910e75f9174'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:32:47 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-d454d756-b37a-42d1-a0ba-2ec82f2f322c tempest-SnapshotMetadataTestJSON-209675994 None] Delete snapshot completed successfully. Jul 11 04:32:47 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d454d756-b37a-42d1-a0ba-2ec82f2f322c tempest-SnapshotMetadataTestJSON-209675994 None] Lock "cinder-7fb9e59e-bb92-4855-8d2f-ef8fefa649cf-delete_snapshot" released by "delete_snapshot" :: held 4.439s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:32:49 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c6bb6af7-6b75-42b1-bf4a-583a02191533 tempest-SnapshotMetadataTestJSON-209675994 None] Acquiring lock "cinder-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:32:49 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c6bb6af7-6b75-42b1-bf4a-583a02191533 tempest-SnapshotMetadataTestJSON-209675994 None] Lock "cinder-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:32:49 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c6bb6af7-6b75-42b1-bf4a-583a02191533 tempest-SnapshotMetadataTestJSON-209675994 None] Acquiring lock "cinder-quobyte-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:32:49 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c6bb6af7-6b75-42b1-bf4a-583a02191533 tempest-SnapshotMetadataTestJSON-209675994 None] Lock "cinder-quobyte-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8" acquired by "delete_volume" :: waited 0.024s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:32:49 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f45bf95-97e9-4f4a-ad39-d0b37ec9364d]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:32:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c6bb6af7-6b75-42b1-bf4a-583a02191533 tempest-SnapshotMetadataTestJSON-209675994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:49 devstack sudo[96854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8 Jul 11 04:32:49 devstack sudo[96854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:50 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f374150-4dfd-4f5f-a574-44eb49ce87ed tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:32:50 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5f374150-4dfd-4f5f-a574-44eb49ce87ed tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Flow 'volume_create_manager' (2cc1db49-a01c-42c4-a2e9-e6a3b2824bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:32:50 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5f374150-4dfd-4f5f-a574-44eb49ce87ed tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d03641c-ba7a-4c99-b576-82435910844f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:32:50 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5f374150-4dfd-4f5f-a574-44eb49ce87ed tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d03641c-ba7a-4c99-b576-82435910844f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-606012628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ce62d3-55e5-41c4-bf3e-747b04ade9b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a927715627074a30bafaf299ecaed7d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:32:50Z,use_quota=True,user_id='1571c03e7b2b48728d43731ef00c2fca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:32:50 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5f374150-4dfd-4f5f-a574-44eb49ce87ed tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d437f9d0-835f-4d29-9547-848beb08cfa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:32:50 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5f374150-4dfd-4f5f-a574-44eb49ce87ed tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d437f9d0-835f-4d29-9547-848beb08cfa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:32:50 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5f374150-4dfd-4f5f-a574-44eb49ce87ed tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (738f5a2f-7b6e-41bd-a392-a8d5d61d0c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:32:50 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5f374150-4dfd-4f5f-a574-44eb49ce87ed tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (738f5a2f-7b6e-41bd-a392-a8d5d61d0c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48ce62d3-55e5-41c4-bf3e-747b04ade9b4', 'volume_name': 'volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:32:50 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5f374150-4dfd-4f5f-a574-44eb49ce87ed tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b9b6a5f-aa15-4ac5-ba9c-3cd345454b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:32:50 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5f374150-4dfd-4f5f-a574-44eb49ce87ed tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b9b6a5f-aa15-4ac5-ba9c-3cd345454b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:32:50 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5f374150-4dfd-4f5f-a574-44eb49ce87ed tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (759c5550-38ef-4674-ab6c-950996dfdb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:32:50 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-5f374150-4dfd-4f5f-a574-44eb49ce87ed tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Volume 48ce62d3-55e5-41c4-bf3e-747b04ade9b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4', 'volume_size': 1} Jul 11 04:32:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5f374150-4dfd-4f5f-a574-44eb49ce87ed tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:32:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5f374150-4dfd-4f5f-a574-44eb49ce87ed tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:32:50 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-5f374150-4dfd-4f5f-a574-44eb49ce87ed tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-606012628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ce62d3-55e5-41c4-bf3e-747b04ade9b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a927715627074a30bafaf299ecaed7d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:32:50Z,use_quota=True,user_id='1571c03e7b2b48728d43731ef00c2fca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:32:50 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-5f374150-4dfd-4f5f-a574-44eb49ce87ed tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Creating volume 48ce62d3-55e5-41c4-bf3e-747b04ade9b4 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:32:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5f374150-4dfd-4f5f-a574-44eb49ce87ed tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:32:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5f374150-4dfd-4f5f-a574-44eb49ce87ed tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:32:50 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-5f374150-4dfd-4f5f-a574-44eb49ce87ed tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:32:50 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-5f374150-4dfd-4f5f-a574-44eb49ce87ed tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:32:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5f374150-4dfd-4f5f-a574-44eb49ce87ed tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:32:50 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-5f374150-4dfd-4f5f-a574-44eb49ce87ed tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:32:50 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-5f374150-4dfd-4f5f-a574-44eb49ce87ed tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:32:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5f374150-4dfd-4f5f-a574-44eb49ce87ed tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:50 devstack sudo[96857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4 1073741824 Jul 11 04:32:50 devstack sudo[96857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:50 devstack sudo[96854]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c6bb6af7-6b75-42b1-bf4a-583a02191533 tempest-SnapshotMetadataTestJSON-209675994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8" returned: 0 in 1.253s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c6bb6af7-6b75-42b1-bf4a-583a02191533 tempest-SnapshotMetadataTestJSON-209675994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:50 devstack sudo[96862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8 Jul 11 04:32:50 devstack sudo[96862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:51 devstack sudo[96857]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5f374150-4dfd-4f5f-a574-44eb49ce87ed tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4 1073741824" returned: 0 in 1.086s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5f374150-4dfd-4f5f-a574-44eb49ce87ed tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:51 devstack sudo[96862]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c6bb6af7-6b75-42b1-bf4a-583a02191533 tempest-SnapshotMetadataTestJSON-209675994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8" returned: 0 in 0.885s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:51 devstack sudo[96869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4 Jul 11 04:32:51 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c6bb6af7-6b75-42b1-bf4a-583a02191533 tempest-SnapshotMetadataTestJSON-209675994 None] Lock "cinder-quobyte-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8" released by "delete_volume" :: held 2.215s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:32:51 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-c6bb6af7-6b75-42b1-bf4a-583a02191533 tempest-SnapshotMetadataTestJSON-209675994 None] Created reservations ['eb96d7e8-5438-4e21-8c78-c94adfd2016d', '56e48c08-5ba8-4a89-a4c0-9f11570984a2', '2116029c-0120-48c0-aadc-895f5c6842d9', 'e6fc0566-662a-4ea6-b39d-00105aefce90'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:32:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c6bb6af7-6b75-42b1-bf4a-583a02191533 tempest-SnapshotMetadataTestJSON-209675994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:32:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c6bb6af7-6b75-42b1-bf4a-583a02191533 tempest-SnapshotMetadataTestJSON-209675994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:32:51 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c6bb6af7-6b75-42b1-bf4a-583a02191533 tempest-SnapshotMetadataTestJSON-209675994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:32:51 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c6bb6af7-6b75-42b1-bf4a-583a02191533 tempest-SnapshotMetadataTestJSON-209675994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:32:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c6bb6af7-6b75-42b1-bf4a-583a02191533 tempest-SnapshotMetadataTestJSON-209675994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:32:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c6bb6af7-6b75-42b1-bf4a-583a02191533 tempest-SnapshotMetadataTestJSON-209675994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:51 devstack sudo[96872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:32:51 devstack sudo[96872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:52 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5f374150-4dfd-4f5f-a574-44eb49ce87ed tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4" returned: 0 in 0.947s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:52 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-5f374150-4dfd-4f5f-a574-44eb49ce87ed tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] <== create_volume: return (2122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:32:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5f374150-4dfd-4f5f-a574-44eb49ce87ed tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.125s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:32:52 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5f374150-4dfd-4f5f-a574-44eb49ce87ed tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (759c5550-38ef-4674-ab6c-950996dfdb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:32:52 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5f374150-4dfd-4f5f-a574-44eb49ce87ed tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cf71f17-a931-4034-92d8-232c06991cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:32:52 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-5f374150-4dfd-4f5f-a574-44eb49ce87ed tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Volume volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4 (48ce62d3-55e5-41c4-bf3e-747b04ade9b4): created successfully Jul 11 04:32:52 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5f374150-4dfd-4f5f-a574-44eb49ce87ed tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cf71f17-a931-4034-92d8-232c06991cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:32:52 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5f374150-4dfd-4f5f-a574-44eb49ce87ed tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Flow 'volume_create_manager' (2cc1db49-a01c-42c4-a2e9-e6a3b2824bd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:32:52 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-5f374150-4dfd-4f5f-a574-44eb49ce87ed tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Created volume successfully. Jul 11 04:32:52 devstack sudo[96872]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c6bb6af7-6b75-42b1-bf4a-583a02191533 tempest-SnapshotMetadataTestJSON-209675994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.800s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:52 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-c6bb6af7-6b75-42b1-bf4a-583a02191533 tempest-SnapshotMetadataTestJSON-209675994 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:32:52 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-c6bb6af7-6b75-42b1-bf4a-583a02191533 tempest-SnapshotMetadataTestJSON-209675994 None] Deleted volume successfully. Jul 11 04:32:52 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c6bb6af7-6b75-42b1-bf4a-583a02191533 tempest-SnapshotMetadataTestJSON-209675994 None] Lock "cinder-ab3146ba-ac8c-458d-bfd9-f74f7e424ad8-delete_volume" released by "delete_volume" :: held 3.481s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:32:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-bb362612-98a5-4b50-a1f6-e7c8d323ee89 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:32:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-bb362612-98a5-4b50-a1f6-e7c8d323ee89 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:32:53 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-bb362612-98a5-4b50-a1f6-e7c8d323ee89 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Creating offline snapshot e3a1f2a3-4aa8-4af5-958b-2b5d9b449a00 of volume 48ce62d3-55e5-41c4-bf3e-747b04ade9b4 {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:32:53 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[d639916d-bb17-4078-afb2-f5cbd680b57f]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:32:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bb362612-98a5-4b50-a1f6-e7c8d323ee89 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:53 devstack sudo[96877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4 Jul 11 04:32:53 devstack sudo[96877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:54 devstack sudo[96877]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bb362612-98a5-4b50-a1f6-e7c8d323ee89 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4" returned: 0 in 0.980s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bb362612-98a5-4b50-a1f6-e7c8d323ee89 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4.e3a1f2a3-4aa8-4af5-958b-2b5d9b449a00 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:54 devstack sudo[96883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4.e3a1f2a3-4aa8-4af5-958b-2b5d9b449a00 1G Jul 11 04:32:54 devstack sudo[96883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:55 devstack sudo[96883]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bb362612-98a5-4b50-a1f6-e7c8d323ee89 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4.e3a1f2a3-4aa8-4af5-958b-2b5d9b449a00 1G" returned: 0 in 1.115s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bb362612-98a5-4b50-a1f6-e7c8d323ee89 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4.e3a1f2a3-4aa8-4af5-958b-2b5d9b449a00 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:55 devstack sudo[96890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4.e3a1f2a3-4aa8-4af5-958b-2b5d9b449a00 Jul 11 04:32:55 devstack sudo[96890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:56 devstack sudo[96890]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bb362612-98a5-4b50-a1f6-e7c8d323ee89 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4.e3a1f2a3-4aa8-4af5-958b-2b5d9b449a00" returned: 0 in 0.767s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:56 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-bb362612-98a5-4b50-a1f6-e7c8d323ee89 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4.e3a1f2a3-4aa8-4af5-958b-2b5d9b449a00 is being set with open permissions: ugo+rw Jul 11 04:32:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bb362612-98a5-4b50-a1f6-e7c8d323ee89 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4.e3a1f2a3-4aa8-4af5-958b-2b5d9b449a00 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:56 devstack sudo[96896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4.e3a1f2a3-4aa8-4af5-958b-2b5d9b449a00 Jul 11 04:32:56 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:57 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-be665a44-1441-4427-b322-0470654bbb18 req-e1775731-d4b2-45e6-812c-e810c527b06c tempest-AttachVolumeNegativeTest-930293942 None] Terminate volume connection completed successfully. Jul 11 04:32:57 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-be665a44-1441-4427-b322-0470654bbb18 req-e1775731-d4b2-45e6-812c-e810c527b06c tempest-AttachVolumeNegativeTest-930293942 None] Deleting attachment b6206de7-844c-4737-bf79-6f7828682cbc. {{(pid=86964) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 04:32:57 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bb362612-98a5-4b50-a1f6-e7c8d323ee89 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4.e3a1f2a3-4aa8-4af5-958b-2b5d9b449a00" returned: 0 in 0.809s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bb362612-98a5-4b50-a1f6-e7c8d323ee89 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:57 devstack sudo[96902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4.info Jul 11 04:32:57 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:58 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-45d307c0-356b-4bb8-925c-c3169b987403 tempest-VolumesTransfersTest-1429521428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:32:58 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-45d307c0-356b-4bb8-925c-c3169b987403 tempest-VolumesTransfersTest-1429521428 None] Flow 'volume_create_manager' (c6bce83a-7156-4ee3-ac5f-5ad2a8a2fc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:32:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-45d307c0-356b-4bb8-925c-c3169b987403 tempest-VolumesTransfersTest-1429521428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67b7275c-2ebe-4545-a6cf-1f11ad5fc481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:32:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bb362612-98a5-4b50-a1f6-e7c8d323ee89 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4.info" returned: 0 in 0.758s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:58 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-bb362612-98a5-4b50-a1f6-e7c8d323ee89 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4.info is being set with open permissions: ugo+rw Jul 11 04:32:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bb362612-98a5-4b50-a1f6-e7c8d323ee89 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-45d307c0-356b-4bb8-925c-c3169b987403 tempest-VolumesTransfersTest-1429521428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67b7275c-2ebe-4545-a6cf-1f11ad5fc481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-734305778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39c43d7f-49d7-47ee-991b-61beb200ce10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f37f43c45fec4d7cb9747a2373665c9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:32:58Z,use_quota=True,user_id='ae5db1fb45e74f08b38fec780a4d9deb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:32:58 devstack sudo[96905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4.info Jul 11 04:32:58 devstack sudo[96905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-45d307c0-356b-4bb8-925c-c3169b987403 tempest-VolumesTransfersTest-1429521428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d4a5186-f191-4fb9-b82b-2a9366fdf4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:32:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-45d307c0-356b-4bb8-925c-c3169b987403 tempest-VolumesTransfersTest-1429521428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d4a5186-f191-4fb9-b82b-2a9366fdf4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:32:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-45d307c0-356b-4bb8-925c-c3169b987403 tempest-VolumesTransfersTest-1429521428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a01613e2-3650-4370-9b91-a60f8778823a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:32:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-45d307c0-356b-4bb8-925c-c3169b987403 tempest-VolumesTransfersTest-1429521428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a01613e2-3650-4370-9b91-a60f8778823a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39c43d7f-49d7-47ee-991b-61beb200ce10', 'volume_name': 'volume-39c43d7f-49d7-47ee-991b-61beb200ce10', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:32:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-45d307c0-356b-4bb8-925c-c3169b987403 tempest-VolumesTransfersTest-1429521428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (483b4b4f-4640-452f-b989-46fe0db56da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:32:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-45d307c0-356b-4bb8-925c-c3169b987403 tempest-VolumesTransfersTest-1429521428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (483b4b4f-4640-452f-b989-46fe0db56da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:32:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-45d307c0-356b-4bb8-925c-c3169b987403 tempest-VolumesTransfersTest-1429521428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fe85b70-2f2b-444b-8551-d4cf58719d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:32:58 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-45d307c0-356b-4bb8-925c-c3169b987403 tempest-VolumesTransfersTest-1429521428 None] Volume 39c43d7f-49d7-47ee-991b-61beb200ce10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39c43d7f-49d7-47ee-991b-61beb200ce10', 'volume_size': 1} Jul 11 04:32:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-45d307c0-356b-4bb8-925c-c3169b987403 tempest-VolumesTransfersTest-1429521428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:32:58 devstack sudo[96905]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bb362612-98a5-4b50-a1f6-e7c8d323ee89 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4.info" returned: 0 in 0.652s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-bb362612-98a5-4b50-a1f6-e7c8d323ee89 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.200s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:32:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-45d307c0-356b-4bb8-925c-c3169b987403 tempest-VolumesTransfersTest-1429521428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.610s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:32:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-45d307c0-356b-4bb8-925c-c3169b987403 tempest-VolumesTransfersTest-1429521428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-734305778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39c43d7f-49d7-47ee-991b-61beb200ce10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f37f43c45fec4d7cb9747a2373665c9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:32:58Z,use_quota=True,user_id='ae5db1fb45e74f08b38fec780a4d9deb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:32:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-45d307c0-356b-4bb8-925c-c3169b987403 tempest-VolumesTransfersTest-1429521428 None] Creating volume 39c43d7f-49d7-47ee-991b-61beb200ce10 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:32:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-45d307c0-356b-4bb8-925c-c3169b987403 tempest-VolumesTransfersTest-1429521428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:32:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-45d307c0-356b-4bb8-925c-c3169b987403 tempest-VolumesTransfersTest-1429521428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:32:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-45d307c0-356b-4bb8-925c-c3169b987403 tempest-VolumesTransfersTest-1429521428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:32:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-45d307c0-356b-4bb8-925c-c3169b987403 tempest-VolumesTransfersTest-1429521428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:32:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-45d307c0-356b-4bb8-925c-c3169b987403 tempest-VolumesTransfersTest-1429521428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:32:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-45d307c0-356b-4bb8-925c-c3169b987403 tempest-VolumesTransfersTest-1429521428 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:32:58 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-45d307c0-356b-4bb8-925c-c3169b987403 tempest-VolumesTransfersTest-1429521428 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:32:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-45d307c0-356b-4bb8-925c-c3169b987403 tempest-VolumesTransfersTest-1429521428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-39c43d7f-49d7-47ee-991b-61beb200ce10 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:58 devstack sudo[96908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-39c43d7f-49d7-47ee-991b-61beb200ce10 1073741824 Jul 11 04:32:58 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:58 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-bb362612-98a5-4b50-a1f6-e7c8d323ee89 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Create snapshot completed successfully Jul 11 04:32:59 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:32:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:32:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:32:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:32:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:32:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:32:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:59 devstack sudo[96910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:32:59 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:32:59 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.745s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:59 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:32:59 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager._thread_info {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:32:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread count: 28 {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:32:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread info: [<_MainThread(MainThread, started 124675027595392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:32:59 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root Jul 11 04:32:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-45d307c0-356b-4bb8-925c-c3169b987403 tempest-VolumesTransfersTest-1429521428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-39c43d7f-49d7-47ee-991b-61beb200ce10 1073741824" returned: 0 in 1.037s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:32:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-45d307c0-356b-4bb8-925c-c3169b987403 tempest-VolumesTransfersTest-1429521428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-39c43d7f-49d7-47ee-991b-61beb200ce10 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:32:59 devstack sudo[96917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-39c43d7f-49d7-47ee-991b-61beb200ce10 Jul 11 04:32:59 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:33:00 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-89cac9ca-25e7-4a46-877c-72568e717484 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Acquiring lock "cinder-e3a1f2a3-4aa8-4af5-958b-2b5d9b449a00-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:33:00 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-89cac9ca-25e7-4a46-877c-72568e717484 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Lock "cinder-e3a1f2a3-4aa8-4af5-958b-2b5d9b449a00-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:33:00 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-89cac9ca-25e7-4a46-877c-72568e717484 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Acquiring lock "cinder-quobyte-48ce62d3-55e5-41c4-bf3e-747b04ade9b4" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:33:00 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-89cac9ca-25e7-4a46-877c-72568e717484 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Lock "cinder-quobyte-48ce62d3-55e5-41c4-bf3e-747b04ade9b4" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:33:00 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-89cac9ca-25e7-4a46-877c-72568e717484 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Acquiring lock "cinder-quobyte-e3a1f2a3-4aa8-4af5-958b-2b5d9b449a00" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:33:00 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-89cac9ca-25e7-4a46-877c-72568e717484 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Lock "cinder-quobyte-e3a1f2a3-4aa8-4af5-958b-2b5d9b449a00" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:33:00 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-89cac9ca-25e7-4a46-877c-72568e717484 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Deleting offline snapshot e3a1f2a3-4aa8-4af5-958b-2b5d9b449a00 of volume 48ce62d3-55e5-41c4-bf3e-747b04ade9b4 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:33:00 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-89cac9ca-25e7-4a46-877c-72568e717484 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] snapshot_file for this snap is: volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4.e3a1f2a3-4aa8-4af5-958b-2b5d9b449a00 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:33:00 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd0d38b-00ee-4b7f-a488-b55a7f4f376b]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:33:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-89cac9ca-25e7-4a46-877c-72568e717484 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4.e3a1f2a3-4aa8-4af5-958b-2b5d9b449a00 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:33:00 devstack sudo[96949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4.e3a1f2a3-4aa8-4af5-958b-2b5d9b449a00 Jul 11 04:33:00 devstack sudo[96949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:33:00 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root Jul 11 04:33:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-45d307c0-356b-4bb8-925c-c3169b987403 tempest-VolumesTransfersTest-1429521428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-39c43d7f-49d7-47ee-991b-61beb200ce10" returned: 0 in 0.911s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:33:00 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-45d307c0-356b-4bb8-925c-c3169b987403 tempest-VolumesTransfersTest-1429521428 None] <== create_volume: return (2007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:33:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-45d307c0-356b-4bb8-925c-c3169b987403 tempest-VolumesTransfersTest-1429521428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.011s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:33:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-45d307c0-356b-4bb8-925c-c3169b987403 tempest-VolumesTransfersTest-1429521428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fe85b70-2f2b-444b-8551-d4cf58719d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39c43d7f-49d7-47ee-991b-61beb200ce10', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:33:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-45d307c0-356b-4bb8-925c-c3169b987403 tempest-VolumesTransfersTest-1429521428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e4893ef-f041-4868-b75f-be450fcf164c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:33:00 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-45d307c0-356b-4bb8-925c-c3169b987403 tempest-VolumesTransfersTest-1429521428 None] Volume volume-39c43d7f-49d7-47ee-991b-61beb200ce10 (39c43d7f-49d7-47ee-991b-61beb200ce10): created successfully Jul 11 04:33:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-45d307c0-356b-4bb8-925c-c3169b987403 tempest-VolumesTransfersTest-1429521428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e4893ef-f041-4868-b75f-be450fcf164c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:33:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-45d307c0-356b-4bb8-925c-c3169b987403 tempest-VolumesTransfersTest-1429521428 None] Flow 'volume_create_manager' (c6bce83a-7156-4ee3-ac5f-5ad2a8a2fc99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:33:00 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-45d307c0-356b-4bb8-925c-c3169b987403 tempest-VolumesTransfersTest-1429521428 None] Created volume successfully. Jul 11 04:33:01 devstack sudo[96949]: pam_unix(sudo:session): session closed for user root Jul 11 04:33:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-89cac9ca-25e7-4a46-877c-72568e717484 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4.e3a1f2a3-4aa8-4af5-958b-2b5d9b449a00" returned: 0 in 1.106s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:33:01 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-89cac9ca-25e7-4a46-877c-72568e717484 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:33:01 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef830da5-559d-44a3-8e3a-611689287600]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:33:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-89cac9ca-25e7-4a46-877c-72568e717484 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:33:01 devstack sudo[96972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4 Jul 11 04:33:01 devstack sudo[96972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:33:02 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-a8696c90-999c-4876-aa0a-25b19e1b85da tempest-VolumesTransfersTest-1227438887 None] Transfer volume completed successfully. Jul 11 04:33:02 devstack sudo[96972]: pam_unix(sudo:session): session closed for user root Jul 11 04:33:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-89cac9ca-25e7-4a46-877c-72568e717484 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4" returned: 0 in 0.982s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:33:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-89cac9ca-25e7-4a46-877c-72568e717484 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4.e3a1f2a3-4aa8-4af5-958b-2b5d9b449a00 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:33:02 devstack sudo[97016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4.e3a1f2a3-4aa8-4af5-958b-2b5d9b449a00 Jul 11 04:33:02 devstack sudo[97016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:33:03 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-90a15d36-acd1-47d8-99a0-d7f7dda9a734 tempest-VolumesTransfersTest-1690019420 None] Acquiring lock "cinder-39c43d7f-49d7-47ee-991b-61beb200ce10-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:33:03 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-90a15d36-acd1-47d8-99a0-d7f7dda9a734 tempest-VolumesTransfersTest-1690019420 None] Lock "cinder-39c43d7f-49d7-47ee-991b-61beb200ce10-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:33:03 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-90a15d36-acd1-47d8-99a0-d7f7dda9a734 tempest-VolumesTransfersTest-1690019420 None] Acquiring lock "cinder-quobyte-39c43d7f-49d7-47ee-991b-61beb200ce10" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:33:03 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-90a15d36-acd1-47d8-99a0-d7f7dda9a734 tempest-VolumesTransfersTest-1690019420 None] Lock "cinder-quobyte-39c43d7f-49d7-47ee-991b-61beb200ce10" acquired by "delete_volume" :: waited 0.026s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:33:03 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[6315fda2-b8d3-40ef-a2fd-74c9331711ab]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:33:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-90a15d36-acd1-47d8-99a0-d7f7dda9a734 tempest-VolumesTransfersTest-1690019420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-39c43d7f-49d7-47ee-991b-61beb200ce10 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:33:03 devstack sudo[97018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-39c43d7f-49d7-47ee-991b-61beb200ce10 Jul 11 04:33:03 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:33:03 devstack sudo[97016]: pam_unix(sudo:session): session closed for user root Jul 11 04:33:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-89cac9ca-25e7-4a46-877c-72568e717484 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4.e3a1f2a3-4aa8-4af5-958b-2b5d9b449a00" returned: 0 in 0.760s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:33:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-89cac9ca-25e7-4a46-877c-72568e717484 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4.e3a1f2a3-4aa8-4af5-958b-2b5d9b449a00 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:33:03 devstack sudo[97023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4.e3a1f2a3-4aa8-4af5-958b-2b5d9b449a00 Jul 11 04:33:03 devstack sudo[97023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:33:03 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root Jul 11 04:33:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-90a15d36-acd1-47d8-99a0-d7f7dda9a734 tempest-VolumesTransfersTest-1690019420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-39c43d7f-49d7-47ee-991b-61beb200ce10" returned: 0 in 0.800s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:33:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-90a15d36-acd1-47d8-99a0-d7f7dda9a734 tempest-VolumesTransfersTest-1690019420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-39c43d7f-49d7-47ee-991b-61beb200ce10 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:33:04 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-39c43d7f-49d7-47ee-991b-61beb200ce10 Jul 11 04:33:04 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:33:04 devstack sudo[97023]: pam_unix(sudo:session): session closed for user root Jul 11 04:33:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-89cac9ca-25e7-4a46-877c-72568e717484 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4.e3a1f2a3-4aa8-4af5-958b-2b5d9b449a00" returned: 0 in 0.709s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:33:04 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-89cac9ca-25e7-4a46-877c-72568e717484 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Lock "cinder-quobyte-e3a1f2a3-4aa8-4af5-958b-2b5d9b449a00" released by "_delete_snapshot" :: held 3.671s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:33:04 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-89cac9ca-25e7-4a46-877c-72568e717484 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Lock "cinder-quobyte-48ce62d3-55e5-41c4-bf3e-747b04ade9b4" released by "delete_snapshot" :: held 3.697s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:33:04 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-89cac9ca-25e7-4a46-877c-72568e717484 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Created reservations ['0b079959-5abf-40e6-8f18-564f12381677', '13eeeab3-1333-4e41-b99a-805a22c831b3', '245ac553-15c7-46c5-99bc-eb2838950376', 'b05cf625-a8ff-42d1-9200-01ab6f55578c'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:33:04 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-89cac9ca-25e7-4a46-877c-72568e717484 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Delete snapshot completed successfully. Jul 11 04:33:04 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-89cac9ca-25e7-4a46-877c-72568e717484 tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Lock "cinder-e3a1f2a3-4aa8-4af5-958b-2b5d9b449a00-delete_snapshot" released by "delete_snapshot" :: held 3.853s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:33:04 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Jul 11 04:33:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-90a15d36-acd1-47d8-99a0-d7f7dda9a734 tempest-VolumesTransfersTest-1690019420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-39c43d7f-49d7-47ee-991b-61beb200ce10" returned: 0 in 0.644s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:33:04 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-90a15d36-acd1-47d8-99a0-d7f7dda9a734 tempest-VolumesTransfersTest-1690019420 None] Lock "cinder-quobyte-39c43d7f-49d7-47ee-991b-61beb200ce10" released by "delete_volume" :: held 1.496s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:33:04 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-90a15d36-acd1-47d8-99a0-d7f7dda9a734 tempest-VolumesTransfersTest-1690019420 None] Created reservations ['632f5abd-799b-4e5c-8d0d-ea024c104ee5', '1fa7c4aa-3182-454c-8c22-98375145bbf6', '4c641570-eb49-4771-86f0-6142d78cda3b', '2680c7e4-d983-488c-853c-17d13d556401'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:33:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-90a15d36-acd1-47d8-99a0-d7f7dda9a734 tempest-VolumesTransfersTest-1690019420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:33:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-90a15d36-acd1-47d8-99a0-d7f7dda9a734 tempest-VolumesTransfersTest-1690019420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:33:04 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-90a15d36-acd1-47d8-99a0-d7f7dda9a734 tempest-VolumesTransfersTest-1690019420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:33:04 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-90a15d36-acd1-47d8-99a0-d7f7dda9a734 tempest-VolumesTransfersTest-1690019420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:33:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-90a15d36-acd1-47d8-99a0-d7f7dda9a734 tempest-VolumesTransfersTest-1690019420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:33:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-90a15d36-acd1-47d8-99a0-d7f7dda9a734 tempest-VolumesTransfersTest-1690019420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:33:04 devstack sudo[97034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:33:04 devstack sudo[97034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:33:04 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d4badf3f-e879-48f8-9cea-b7ac598f5ffa tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Acquiring lock "cinder-48ce62d3-55e5-41c4-bf3e-747b04ade9b4-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:33:04 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d4badf3f-e879-48f8-9cea-b7ac598f5ffa tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Lock "cinder-48ce62d3-55e5-41c4-bf3e-747b04ade9b4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:33:04 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d4badf3f-e879-48f8-9cea-b7ac598f5ffa tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Acquiring lock "cinder-quobyte-48ce62d3-55e5-41c4-bf3e-747b04ade9b4" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:33:04 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d4badf3f-e879-48f8-9cea-b7ac598f5ffa tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Lock "cinder-quobyte-48ce62d3-55e5-41c4-bf3e-747b04ade9b4" acquired by "delete_volume" :: waited 0.015s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:33:04 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42f521a-ee4e-407e-a217-bdd182d48eaf]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:33:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d4badf3f-e879-48f8-9cea-b7ac598f5ffa tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:33:05 devstack sudo[97037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4 Jul 11 04:33:05 devstack sudo[97037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:33:05 devstack sudo[97034]: pam_unix(sudo:session): session closed for user root Jul 11 04:33:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-90a15d36-acd1-47d8-99a0-d7f7dda9a734 tempest-VolumesTransfersTest-1690019420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.692s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:33:05 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-90a15d36-acd1-47d8-99a0-d7f7dda9a734 tempest-VolumesTransfersTest-1690019420 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:33:05 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-90a15d36-acd1-47d8-99a0-d7f7dda9a734 tempest-VolumesTransfersTest-1690019420 None] Deleted volume successfully. Jul 11 04:33:05 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-90a15d36-acd1-47d8-99a0-d7f7dda9a734 tempest-VolumesTransfersTest-1690019420 None] Lock "cinder-39c43d7f-49d7-47ee-991b-61beb200ce10-delete_volume" released by "delete_volume" :: held 2.426s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:33:05 devstack sudo[97037]: pam_unix(sudo:session): session closed for user root Jul 11 04:33:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d4badf3f-e879-48f8-9cea-b7ac598f5ffa tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4" returned: 0 in 0.835s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:33:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d4badf3f-e879-48f8-9cea-b7ac598f5ffa tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:33:05 devstack sudo[97051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4 Jul 11 04:33:05 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-603bb137-1d4a-4d0a-aa27-019ac434336b tempest-VolumesTransfersTest-1429521428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:33:05 devstack sudo[97051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:33:05 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-603bb137-1d4a-4d0a-aa27-019ac434336b tempest-VolumesTransfersTest-1429521428 None] Flow 'volume_create_manager' (f81c1a31-2eeb-44ae-8d90-2e56544b1463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:33:05 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-603bb137-1d4a-4d0a-aa27-019ac434336b tempest-VolumesTransfersTest-1429521428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (653eba8f-25b2-4d0b-9308-c7241d4081be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:33:05 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-603bb137-1d4a-4d0a-aa27-019ac434336b tempest-VolumesTransfersTest-1429521428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (653eba8f-25b2-4d0b-9308-c7241d4081be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-377750489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e344a50d-7c5f-4346-b2a1-81ae31cd6e1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f37f43c45fec4d7cb9747a2373665c9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:33:06Z,use_quota=True,user_id='ae5db1fb45e74f08b38fec780a4d9deb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:33:05 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-603bb137-1d4a-4d0a-aa27-019ac434336b tempest-VolumesTransfersTest-1429521428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd73232-ce30-4623-84c8-28f5194e8a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:33:05 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-603bb137-1d4a-4d0a-aa27-019ac434336b tempest-VolumesTransfersTest-1429521428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd73232-ce30-4623-84c8-28f5194e8a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:33:05 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-603bb137-1d4a-4d0a-aa27-019ac434336b tempest-VolumesTransfersTest-1429521428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6f1ab85-3e26-43e0-ae62-123f8073b9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:33:05 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-603bb137-1d4a-4d0a-aa27-019ac434336b tempest-VolumesTransfersTest-1429521428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6f1ab85-3e26-43e0-ae62-123f8073b9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e344a50d-7c5f-4346-b2a1-81ae31cd6e1a', 'volume_name': 'volume-e344a50d-7c5f-4346-b2a1-81ae31cd6e1a', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:33:05 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-603bb137-1d4a-4d0a-aa27-019ac434336b tempest-VolumesTransfersTest-1429521428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (662b6901-42dd-4453-9912-9f6e6d3cfdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:33:05 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-603bb137-1d4a-4d0a-aa27-019ac434336b tempest-VolumesTransfersTest-1429521428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (662b6901-42dd-4453-9912-9f6e6d3cfdc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:33:05 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-603bb137-1d4a-4d0a-aa27-019ac434336b tempest-VolumesTransfersTest-1429521428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce2f394-6558-4c94-a97a-78c1ec560494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:33:05 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-603bb137-1d4a-4d0a-aa27-019ac434336b tempest-VolumesTransfersTest-1429521428 None] Volume e344a50d-7c5f-4346-b2a1-81ae31cd6e1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e344a50d-7c5f-4346-b2a1-81ae31cd6e1a', 'volume_size': 1} Jul 11 04:33:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-603bb137-1d4a-4d0a-aa27-019ac434336b tempest-VolumesTransfersTest-1429521428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:33:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-603bb137-1d4a-4d0a-aa27-019ac434336b tempest-VolumesTransfersTest-1429521428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:33:05 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-603bb137-1d4a-4d0a-aa27-019ac434336b tempest-VolumesTransfersTest-1429521428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-377750489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e344a50d-7c5f-4346-b2a1-81ae31cd6e1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f37f43c45fec4d7cb9747a2373665c9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:33:06Z,use_quota=True,user_id='ae5db1fb45e74f08b38fec780a4d9deb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:33:05 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-603bb137-1d4a-4d0a-aa27-019ac434336b tempest-VolumesTransfersTest-1429521428 None] Creating volume e344a50d-7c5f-4346-b2a1-81ae31cd6e1a {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:33:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-603bb137-1d4a-4d0a-aa27-019ac434336b tempest-VolumesTransfersTest-1429521428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:33:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-603bb137-1d4a-4d0a-aa27-019ac434336b tempest-VolumesTransfersTest-1429521428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:33:05 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-603bb137-1d4a-4d0a-aa27-019ac434336b tempest-VolumesTransfersTest-1429521428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:33:05 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-603bb137-1d4a-4d0a-aa27-019ac434336b tempest-VolumesTransfersTest-1429521428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:33:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-603bb137-1d4a-4d0a-aa27-019ac434336b tempest-VolumesTransfersTest-1429521428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:33:05 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-603bb137-1d4a-4d0a-aa27-019ac434336b tempest-VolumesTransfersTest-1429521428 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:33:05 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-603bb137-1d4a-4d0a-aa27-019ac434336b tempest-VolumesTransfersTest-1429521428 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:33:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-603bb137-1d4a-4d0a-aa27-019ac434336b tempest-VolumesTransfersTest-1429521428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e344a50d-7c5f-4346-b2a1-81ae31cd6e1a 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:33:05 devstack sudo[97053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e344a50d-7c5f-4346-b2a1-81ae31cd6e1a 1073741824 Jul 11 04:33:05 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:33:06 devstack sudo[97051]: pam_unix(sudo:session): session closed for user root Jul 11 04:33:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d4badf3f-e879-48f8-9cea-b7ac598f5ffa tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-48ce62d3-55e5-41c4-bf3e-747b04ade9b4" returned: 0 in 0.687s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:33:06 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d4badf3f-e879-48f8-9cea-b7ac598f5ffa tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Lock "cinder-quobyte-48ce62d3-55e5-41c4-bf3e-747b04ade9b4" released by "delete_volume" :: held 1.593s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:33:06 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-d4badf3f-e879-48f8-9cea-b7ac598f5ffa tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Created reservations ['c7847e1a-ebd9-4568-abd0-46028dede24c', '73ce6953-2837-4f05-8d98-82f72c138a4c', '12e3f49f-eac6-4f44-a843-df1ff702c44f', '88264d27-a72c-4d33-8b33-9c5944b13b7d'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:33:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d4badf3f-e879-48f8-9cea-b7ac598f5ffa tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:33:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d4badf3f-e879-48f8-9cea-b7ac598f5ffa tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:33:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-d4badf3f-e879-48f8-9cea-b7ac598f5ffa tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:33:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-d4badf3f-e879-48f8-9cea-b7ac598f5ffa tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:33:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d4badf3f-e879-48f8-9cea-b7ac598f5ffa tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:33:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d4badf3f-e879-48f8-9cea-b7ac598f5ffa tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:33:06 devstack sudo[97059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:33:06 devstack sudo[97059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:33:07 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root Jul 11 04:33:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-603bb137-1d4a-4d0a-aa27-019ac434336b tempest-VolumesTransfersTest-1429521428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e344a50d-7c5f-4346-b2a1-81ae31cd6e1a 1073741824" returned: 0 in 1.164s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:33:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-603bb137-1d4a-4d0a-aa27-019ac434336b tempest-VolumesTransfersTest-1429521428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e344a50d-7c5f-4346-b2a1-81ae31cd6e1a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:33:07 devstack sudo[97061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e344a50d-7c5f-4346-b2a1-81ae31cd6e1a Jul 11 04:33:07 devstack sudo[97061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:33:07 devstack sudo[97059]: pam_unix(sudo:session): session closed for user root Jul 11 04:33:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d4badf3f-e879-48f8-9cea-b7ac598f5ffa tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 1.145s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:33:07 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-d4badf3f-e879-48f8-9cea-b7ac598f5ffa tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:33:07 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-d4badf3f-e879-48f8-9cea-b7ac598f5ffa tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Deleted volume successfully. Jul 11 04:33:07 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d4badf3f-e879-48f8-9cea-b7ac598f5ffa tempest-VolumeSnapshotQuotasNegativeTestJSON-2088121832 None] Lock "cinder-48ce62d3-55e5-41c4-bf3e-747b04ade9b4-delete_volume" released by "delete_volume" :: held 2.989s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:33:08 devstack sudo[97061]: pam_unix(sudo:session): session closed for user root Jul 11 04:33:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-603bb137-1d4a-4d0a-aa27-019ac434336b tempest-VolumesTransfersTest-1429521428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e344a50d-7c5f-4346-b2a1-81ae31cd6e1a" returned: 0 in 0.911s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:33:08 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-603bb137-1d4a-4d0a-aa27-019ac434336b tempest-VolumesTransfersTest-1429521428 None] <== create_volume: return (2151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:33:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-603bb137-1d4a-4d0a-aa27-019ac434336b tempest-VolumesTransfersTest-1429521428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.154s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:33:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-603bb137-1d4a-4d0a-aa27-019ac434336b tempest-VolumesTransfersTest-1429521428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce2f394-6558-4c94-a97a-78c1ec560494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e344a50d-7c5f-4346-b2a1-81ae31cd6e1a', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:33:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-603bb137-1d4a-4d0a-aa27-019ac434336b tempest-VolumesTransfersTest-1429521428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b9f401-9cd1-40c1-a496-832f4eb76946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:33:08 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-603bb137-1d4a-4d0a-aa27-019ac434336b tempest-VolumesTransfersTest-1429521428 None] Volume volume-e344a50d-7c5f-4346-b2a1-81ae31cd6e1a (e344a50d-7c5f-4346-b2a1-81ae31cd6e1a): created successfully Jul 11 04:33:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-603bb137-1d4a-4d0a-aa27-019ac434336b tempest-VolumesTransfersTest-1429521428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b9f401-9cd1-40c1-a496-832f4eb76946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:33:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-603bb137-1d4a-4d0a-aa27-019ac434336b tempest-VolumesTransfersTest-1429521428 None] Flow 'volume_create_manager' (f81c1a31-2eeb-44ae-8d90-2e56544b1463) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:33:08 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-603bb137-1d4a-4d0a-aa27-019ac434336b tempest-VolumesTransfersTest-1429521428 None] Created volume successfully. Jul 11 04:33:09 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ff1e0665-2020-4f69-9d6a-d32b977edb4f tempest-VolumesTransfersTest-1690019420 None] Acquiring lock "cinder-e344a50d-7c5f-4346-b2a1-81ae31cd6e1a-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:33:09 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ff1e0665-2020-4f69-9d6a-d32b977edb4f tempest-VolumesTransfersTest-1690019420 None] Lock "cinder-e344a50d-7c5f-4346-b2a1-81ae31cd6e1a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:33:09 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ff1e0665-2020-4f69-9d6a-d32b977edb4f tempest-VolumesTransfersTest-1690019420 None] Acquiring lock "cinder-quobyte-e344a50d-7c5f-4346-b2a1-81ae31cd6e1a" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:33:09 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ff1e0665-2020-4f69-9d6a-d32b977edb4f tempest-VolumesTransfersTest-1690019420 None] Lock "cinder-quobyte-e344a50d-7c5f-4346-b2a1-81ae31cd6e1a" acquired by "delete_volume" :: waited 0.023s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:33:09 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b5db55-85ae-437b-8715-f8c64e9a6e38]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:33:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ff1e0665-2020-4f69-9d6a-d32b977edb4f tempest-VolumesTransfersTest-1690019420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e344a50d-7c5f-4346-b2a1-81ae31cd6e1a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:33:09 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e344a50d-7c5f-4346-b2a1-81ae31cd6e1a Jul 11 04:33:09 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:33:10 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Jul 11 04:33:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ff1e0665-2020-4f69-9d6a-d32b977edb4f tempest-VolumesTransfersTest-1690019420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e344a50d-7c5f-4346-b2a1-81ae31cd6e1a" returned: 0 in 0.873s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:33:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ff1e0665-2020-4f69-9d6a-d32b977edb4f tempest-VolumesTransfersTest-1690019420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e344a50d-7c5f-4346-b2a1-81ae31cd6e1a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:33:10 devstack sudo[97070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e344a50d-7c5f-4346-b2a1-81ae31cd6e1a Jul 11 04:33:10 devstack sudo[97070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:33:11 devstack sudo[97070]: pam_unix(sudo:session): session closed for user root Jul 11 04:33:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ff1e0665-2020-4f69-9d6a-d32b977edb4f tempest-VolumesTransfersTest-1690019420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e344a50d-7c5f-4346-b2a1-81ae31cd6e1a" returned: 0 in 0.727s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:33:11 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ff1e0665-2020-4f69-9d6a-d32b977edb4f tempest-VolumesTransfersTest-1690019420 None] Lock "cinder-quobyte-e344a50d-7c5f-4346-b2a1-81ae31cd6e1a" released by "delete_volume" :: held 1.662s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:33:11 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-ff1e0665-2020-4f69-9d6a-d32b977edb4f tempest-VolumesTransfersTest-1690019420 None] Created reservations ['ff987dd1-82f3-43b8-a14e-7400916c7949', 'e94a796c-a35f-4fbc-b850-b8d7ebbf591d', 'fc5f8605-b002-493b-9df4-86241a1daa2b', '60d6571c-f3e6-4d53-9328-51d0fc8db1cf'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:33:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ff1e0665-2020-4f69-9d6a-d32b977edb4f tempest-VolumesTransfersTest-1690019420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:33:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ff1e0665-2020-4f69-9d6a-d32b977edb4f tempest-VolumesTransfersTest-1690019420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:33:11 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ff1e0665-2020-4f69-9d6a-d32b977edb4f tempest-VolumesTransfersTest-1690019420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:33:11 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ff1e0665-2020-4f69-9d6a-d32b977edb4f tempest-VolumesTransfersTest-1690019420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:33:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ff1e0665-2020-4f69-9d6a-d32b977edb4f tempest-VolumesTransfersTest-1690019420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:33:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ff1e0665-2020-4f69-9d6a-d32b977edb4f tempest-VolumesTransfersTest-1690019420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:33:11 devstack sudo[97073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:33:11 devstack sudo[97073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:33:12 devstack sudo[97073]: pam_unix(sudo:session): session closed for user root Jul 11 04:33:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ff1e0665-2020-4f69-9d6a-d32b977edb4f tempest-VolumesTransfersTest-1690019420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.790s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:33:12 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-ff1e0665-2020-4f69-9d6a-d32b977edb4f tempest-VolumesTransfersTest-1690019420 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:33:12 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-ff1e0665-2020-4f69-9d6a-d32b977edb4f tempest-VolumesTransfersTest-1690019420 None] Deleted volume successfully. Jul 11 04:33:12 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ff1e0665-2020-4f69-9d6a-d32b977edb4f tempest-VolumesTransfersTest-1690019420 None] Lock "cinder-e344a50d-7c5f-4346-b2a1-81ae31cd6e1a-delete_volume" released by "delete_volume" :: held 2.744s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:33:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-a5f27638-9f50-4abe-98a4-a9f5ac7173ee req-1ed202d2-aeb4-4fa9-bf8f-2f2b495e9ff1 tempest-TestServerVolumeAttachmentScenario-2105694299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:33:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-a5f27638-9f50-4abe-98a4-a9f5ac7173ee req-1ed202d2-aeb4-4fa9-bf8f-2f2b495e9ff1 tempest-TestServerVolumeAttachmentScenario-2105694299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:33:16 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[e698a595-85a2-4b59-8f59-0bab093d2e80]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:33:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-a5f27638-9f50-4abe-98a4-a9f5ac7173ee req-1ed202d2-aeb4-4fa9-bf8f-2f2b495e9ff1 tempest-TestServerVolumeAttachmentScenario-2105694299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5bcd6c98-b33c-4250-a5f6-0be9b8ed7532 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:33:16 devstack sudo[97093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5bcd6c98-b33c-4250-a5f6-0be9b8ed7532 Jul 11 04:33:16 devstack sudo[97093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:33:17 devstack sudo[97093]: pam_unix(sudo:session): session closed for user root Jul 11 04:33:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-a5f27638-9f50-4abe-98a4-a9f5ac7173ee req-1ed202d2-aeb4-4fa9-bf8f-2f2b495e9ff1 tempest-TestServerVolumeAttachmentScenario-2105694299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5bcd6c98-b33c-4250-a5f6-0be9b8ed7532" returned: 0 in 1.002s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:33:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-a5f27638-9f50-4abe-98a4-a9f5ac7173ee req-1ed202d2-aeb4-4fa9-bf8f-2f2b495e9ff1 tempest-TestServerVolumeAttachmentScenario-2105694299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.024s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:33:17 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-a5f27638-9f50-4abe-98a4-a9f5ac7173ee req-1ed202d2-aeb4-4fa9-bf8f-2f2b495e9ff1 tempest-TestServerVolumeAttachmentScenario-2105694299 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95', 'name': 'volume-5bcd6c98-b33c-4250-a5f6-0be9b8ed7532', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4d3da5cb-b934-4da3-bc7c-508f35ab5c8b', 'enforce_multipath': True} {{(pid=86964) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 04:33:17 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-a5f27638-9f50-4abe-98a4-a9f5ac7173ee req-1ed202d2-aeb4-4fa9-bf8f-2f2b495e9ff1 tempest-TestServerVolumeAttachmentScenario-2105694299 None] attachment_update completed successfully. Jul 11 04:33:27 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=58,cinder:UPDATE=61,cinder:INSERT=13,cinder:DELETE=7 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:33:27 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:DELETE=4,cinder:SELECT=52,cinder:UPDATE=64,cinder:INSERT=18 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:33:28 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f6ed4fb-09bb-4e4c-9006-bd72865b3c3c tempest-VolumesActionsTest-1672075969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:33:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9f6ed4fb-09bb-4e4c-9006-bd72865b3c3c tempest-VolumesActionsTest-1672075969 None] Flow 'volume_create_manager' (6e27d617-a948-4c88-96e8-ce04d84f0bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:33:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9f6ed4fb-09bb-4e4c-9006-bd72865b3c3c tempest-VolumesActionsTest-1672075969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1e78b4f-9a36-4236-bf28-f3a6ea3caf15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:33:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9f6ed4fb-09bb-4e4c-9006-bd72865b3c3c tempest-VolumesActionsTest-1672075969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1e78b4f-9a36-4236-bf28-f3a6ea3caf15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1699282247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c26d4c8f-0a69-45b0-83db-1bee00a0307c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ec12826ee2c41f3b5d2ff97a89a8853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:33:28Z,use_quota=True,user_id='9143254f514e4953a9102528f0c90702',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:33:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9f6ed4fb-09bb-4e4c-9006-bd72865b3c3c tempest-VolumesActionsTest-1672075969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96764895-57bb-472d-bf12-dc2361062571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:33:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9f6ed4fb-09bb-4e4c-9006-bd72865b3c3c tempest-VolumesActionsTest-1672075969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96764895-57bb-472d-bf12-dc2361062571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:33:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9f6ed4fb-09bb-4e4c-9006-bd72865b3c3c tempest-VolumesActionsTest-1672075969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb1e303f-2ad8-4840-bb2a-559c0bb09a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:33:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9f6ed4fb-09bb-4e4c-9006-bd72865b3c3c tempest-VolumesActionsTest-1672075969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb1e303f-2ad8-4840-bb2a-559c0bb09a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c26d4c8f-0a69-45b0-83db-1bee00a0307c', 'volume_name': 'volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:33:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9f6ed4fb-09bb-4e4c-9006-bd72865b3c3c tempest-VolumesActionsTest-1672075969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (169e1fcc-60ea-4efd-ab75-9e15367eed65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:33:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9f6ed4fb-09bb-4e4c-9006-bd72865b3c3c tempest-VolumesActionsTest-1672075969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (169e1fcc-60ea-4efd-ab75-9e15367eed65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:33:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9f6ed4fb-09bb-4e4c-9006-bd72865b3c3c tempest-VolumesActionsTest-1672075969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2db9c3a9-7b68-421e-b21b-630cd13c690f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:33:28 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-9f6ed4fb-09bb-4e4c-9006-bd72865b3c3c tempest-VolumesActionsTest-1672075969 None] Volume c26d4c8f-0a69-45b0-83db-1bee00a0307c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c', 'volume_size': 1} Jul 11 04:33:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9f6ed4fb-09bb-4e4c-9006-bd72865b3c3c tempest-VolumesActionsTest-1672075969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:33:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9f6ed4fb-09bb-4e4c-9006-bd72865b3c3c tempest-VolumesActionsTest-1672075969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:33:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-9f6ed4fb-09bb-4e4c-9006-bd72865b3c3c tempest-VolumesActionsTest-1672075969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1699282247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c26d4c8f-0a69-45b0-83db-1bee00a0307c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ec12826ee2c41f3b5d2ff97a89a8853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:33:28Z,use_quota=True,user_id='9143254f514e4953a9102528f0c90702',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:33:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-9f6ed4fb-09bb-4e4c-9006-bd72865b3c3c tempest-VolumesActionsTest-1672075969 None] Creating volume c26d4c8f-0a69-45b0-83db-1bee00a0307c {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:33:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9f6ed4fb-09bb-4e4c-9006-bd72865b3c3c tempest-VolumesActionsTest-1672075969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:33:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9f6ed4fb-09bb-4e4c-9006-bd72865b3c3c tempest-VolumesActionsTest-1672075969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:33:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-9f6ed4fb-09bb-4e4c-9006-bd72865b3c3c tempest-VolumesActionsTest-1672075969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:33:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-9f6ed4fb-09bb-4e4c-9006-bd72865b3c3c tempest-VolumesActionsTest-1672075969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:33:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9f6ed4fb-09bb-4e4c-9006-bd72865b3c3c tempest-VolumesActionsTest-1672075969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:33:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-9f6ed4fb-09bb-4e4c-9006-bd72865b3c3c tempest-VolumesActionsTest-1672075969 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:33:28 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-9f6ed4fb-09bb-4e4c-9006-bd72865b3c3c tempest-VolumesActionsTest-1672075969 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:33:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9f6ed4fb-09bb-4e4c-9006-bd72865b3c3c tempest-VolumesActionsTest-1672075969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:33:28 devstack sudo[97517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c 1073741824 Jul 11 04:33:28 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:33:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-54452cc9-c75e-48b6-8dff-33303f8cf482 req-983ae741-425c-45a3-8606-dd13b731124d tempest-TestServerVolumeAttachmentScenario-2105694299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:33:29 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root Jul 11 04:33:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9f6ed4fb-09bb-4e4c-9006-bd72865b3c3c tempest-VolumesActionsTest-1672075969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c 1073741824" returned: 0 in 1.052s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:33:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9f6ed4fb-09bb-4e4c-9006-bd72865b3c3c tempest-VolumesActionsTest-1672075969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:33:29 devstack sudo[97560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c Jul 11 04:33:29 devstack sudo[97560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:33:30 devstack sudo[97560]: pam_unix(sudo:session): session closed for user root Jul 11 04:33:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9f6ed4fb-09bb-4e4c-9006-bd72865b3c3c tempest-VolumesActionsTest-1672075969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c" returned: 0 in 0.749s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:33:30 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-9f6ed4fb-09bb-4e4c-9006-bd72865b3c3c tempest-VolumesActionsTest-1672075969 None] <== create_volume: return (1866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:33:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9f6ed4fb-09bb-4e4c-9006-bd72865b3c3c tempest-VolumesActionsTest-1672075969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.870s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:33:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-54452cc9-c75e-48b6-8dff-33303f8cf482 req-983ae741-425c-45a3-8606-dd13b731124d tempest-TestServerVolumeAttachmentScenario-2105694299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.673s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:33:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9f6ed4fb-09bb-4e4c-9006-bd72865b3c3c tempest-VolumesActionsTest-1672075969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2db9c3a9-7b68-421e-b21b-630cd13c690f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:33:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9f6ed4fb-09bb-4e4c-9006-bd72865b3c3c tempest-VolumesActionsTest-1672075969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002aa3f4-9903-41f2-814a-0f9e89811e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:33:30 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e490d7-3d54-4301-9883-8022b52e1475]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:33:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-54452cc9-c75e-48b6-8dff-33303f8cf482 req-983ae741-425c-45a3-8606-dd13b731124d tempest-TestServerVolumeAttachmentScenario-2105694299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dc330634-78a6-4e18-b31a-8f29b5003c43 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:33:30 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-9f6ed4fb-09bb-4e4c-9006-bd72865b3c3c tempest-VolumesActionsTest-1672075969 None] Volume volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c (c26d4c8f-0a69-45b0-83db-1bee00a0307c): created successfully Jul 11 04:33:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9f6ed4fb-09bb-4e4c-9006-bd72865b3c3c tempest-VolumesActionsTest-1672075969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002aa3f4-9903-41f2-814a-0f9e89811e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:33:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9f6ed4fb-09bb-4e4c-9006-bd72865b3c3c tempest-VolumesActionsTest-1672075969 None] Flow 'volume_create_manager' (6e27d617-a948-4c88-96e8-ce04d84f0bf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:33:30 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-9f6ed4fb-09bb-4e4c-9006-bd72865b3c3c tempest-VolumesActionsTest-1672075969 None] Created volume successfully. Jul 11 04:33:30 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dc330634-78a6-4e18-b31a-8f29b5003c43 Jul 11 04:33:30 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:33:31 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Jul 11 04:33:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-54452cc9-c75e-48b6-8dff-33303f8cf482 req-983ae741-425c-45a3-8606-dd13b731124d tempest-TestServerVolumeAttachmentScenario-2105694299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dc330634-78a6-4e18-b31a-8f29b5003c43" returned: 0 in 0.890s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:33:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-54452cc9-c75e-48b6-8dff-33303f8cf482 req-983ae741-425c-45a3-8606-dd13b731124d tempest-TestServerVolumeAttachmentScenario-2105694299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.936s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:33:31 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-54452cc9-c75e-48b6-8dff-33303f8cf482 req-983ae741-425c-45a3-8606-dd13b731124d tempest-TestServerVolumeAttachmentScenario-2105694299 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95', 'name': 'volume-dc330634-78a6-4e18-b31a-8f29b5003c43', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a184cfba-5156-47b7-937d-8916408bf76d', 'enforce_multipath': True} {{(pid=86964) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 04:33:31 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-54452cc9-c75e-48b6-8dff-33303f8cf482 req-983ae741-425c-45a3-8606-dd13b731124d tempest-TestServerVolumeAttachmentScenario-2105694299 None] attachment_update completed successfully. Jul 11 04:33:38 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-17e809b3-3852-4bd2-a497-5dc16b35d93a req-f4b3682c-32f1-470a-97c9-034c94789dfe tempest-TestServerVolumeAttachmentScenario-2105694299 None] Terminate volume connection completed successfully. Jul 11 04:33:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-17e809b3-3852-4bd2-a497-5dc16b35d93a req-f4b3682c-32f1-470a-97c9-034c94789dfe tempest-TestServerVolumeAttachmentScenario-2105694299 None] Deleting attachment a184cfba-5156-47b7-937d-8916408bf76d. {{(pid=86964) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 04:33:42 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-379e29fd-4959-4a30-b576-a7bef6dd8da6 req-8ae92930-96d1-41fc-ae30-bb21bd616d22 tempest-TestServerVolumeAttachmentScenario-2105694299 None] Terminate volume connection completed successfully. Jul 11 04:33:42 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-379e29fd-4959-4a30-b576-a7bef6dd8da6 req-8ae92930-96d1-41fc-ae30-bb21bd616d22 tempest-TestServerVolumeAttachmentScenario-2105694299 None] Deleting attachment 4d3da5cb-b934-4da3-bc7c-508f35ab5c8b. {{(pid=86964) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 04:33:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-9eb0ccc8-09de-466f-bbea-84b818f0de7a tempest-VolumesActionsTest-1672075969 None] Acquiring lock "cinder-c26d4c8f-0a69-45b0-83db-1bee00a0307c" by "attach_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:33:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-9eb0ccc8-09de-466f-bbea-84b818f0de7a tempest-VolumesActionsTest-1672075969 None] Lock "cinder-c26d4c8f-0a69-45b0-83db-1bee00a0307c" acquired by "attach_volume" :: waited 0.051s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:33:50 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-9eb0ccc8-09de-466f-bbea-84b818f0de7a tempest-VolumesActionsTest-1672075969 None] Attaching volume c26d4c8f-0a69-45b0-83db-1bee00a0307c to instance 55a6b7c2-632e-4562-8a2f-32b7725fa575 at mountpoint /dev/vdb on host None. Jul 11 04:33:50 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-9eb0ccc8-09de-466f-bbea-84b818f0de7a tempest-VolumesActionsTest-1672075969 None] Attach volume completed successfully. Jul 11 04:33:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-9eb0ccc8-09de-466f-bbea-84b818f0de7a tempest-VolumesActionsTest-1672075969 None] Lock "cinder-c26d4c8f-0a69-45b0-83db-1bee00a0307c" released by "attach_volume" :: held 0.195s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:33:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-7a40061c-7b1d-44e7-a781-e55db863843f tempest-VolumesActionsTest-1672075969 None] Acquiring lock "cinder-c26d4c8f-0a69-45b0-83db-1bee00a0307c-detach_volume" by "detach_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:33:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-7a40061c-7b1d-44e7-a781-e55db863843f tempest-VolumesActionsTest-1672075969 None] Lock "cinder-c26d4c8f-0a69-45b0-83db-1bee00a0307c-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:33:50 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-7a40061c-7b1d-44e7-a781-e55db863843f tempest-VolumesActionsTest-1672075969 None] Detaching volume c26d4c8f-0a69-45b0-83db-1bee00a0307c from instance 55a6b7c2-632e-4562-8a2f-32b7725fa575. Jul 11 04:33:50 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-7a40061c-7b1d-44e7-a781-e55db863843f tempest-VolumesActionsTest-1672075969 None] Detach volume completed successfully. Jul 11 04:33:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-7a40061c-7b1d-44e7-a781-e55db863843f tempest-VolumesActionsTest-1672075969 None] Lock "cinder-c26d4c8f-0a69-45b0-83db-1bee00a0307c-detach_volume" released by "detach_volume" :: held 0.091s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:33:53 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e06b63b5-c5e8-49bf-a9e4-81b7e6a10fcf tempest-TestServerVolumeAttachmentScenario-2105694299 None] Acquiring lock "cinder-dc330634-78a6-4e18-b31a-8f29b5003c43-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:33:53 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e06b63b5-c5e8-49bf-a9e4-81b7e6a10fcf tempest-TestServerVolumeAttachmentScenario-2105694299 None] Lock "cinder-dc330634-78a6-4e18-b31a-8f29b5003c43-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:33:53 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e06b63b5-c5e8-49bf-a9e4-81b7e6a10fcf tempest-TestServerVolumeAttachmentScenario-2105694299 None] Acquiring lock "cinder-quobyte-dc330634-78a6-4e18-b31a-8f29b5003c43" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:33:53 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e06b63b5-c5e8-49bf-a9e4-81b7e6a10fcf tempest-TestServerVolumeAttachmentScenario-2105694299 None] Lock "cinder-quobyte-dc330634-78a6-4e18-b31a-8f29b5003c43" acquired by "delete_volume" :: waited 0.017s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:33:53 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[91371d71-d2b4-4403-ae6a-8be94cd1eeac]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:33:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e06b63b5-c5e8-49bf-a9e4-81b7e6a10fcf tempest-TestServerVolumeAttachmentScenario-2105694299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dc330634-78a6-4e18-b31a-8f29b5003c43 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:33:53 devstack sudo[97776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dc330634-78a6-4e18-b31a-8f29b5003c43 Jul 11 04:33:53 devstack sudo[97776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:33:54 devstack sudo[97776]: pam_unix(sudo:session): session closed for user root Jul 11 04:33:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e06b63b5-c5e8-49bf-a9e4-81b7e6a10fcf tempest-TestServerVolumeAttachmentScenario-2105694299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dc330634-78a6-4e18-b31a-8f29b5003c43" returned: 0 in 1.069s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:33:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e06b63b5-c5e8-49bf-a9e4-81b7e6a10fcf tempest-TestServerVolumeAttachmentScenario-2105694299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dc330634-78a6-4e18-b31a-8f29b5003c43 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:33:54 devstack sudo[97798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dc330634-78a6-4e18-b31a-8f29b5003c43 Jul 11 04:33:54 devstack sudo[97798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:33:55 devstack sudo[97798]: pam_unix(sudo:session): session closed for user root Jul 11 04:33:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e06b63b5-c5e8-49bf-a9e4-81b7e6a10fcf tempest-TestServerVolumeAttachmentScenario-2105694299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dc330634-78a6-4e18-b31a-8f29b5003c43" returned: 0 in 0.683s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:33:55 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e06b63b5-c5e8-49bf-a9e4-81b7e6a10fcf tempest-TestServerVolumeAttachmentScenario-2105694299 None] Lock "cinder-quobyte-dc330634-78a6-4e18-b31a-8f29b5003c43" released by "delete_volume" :: held 1.804s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:33:55 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-e06b63b5-c5e8-49bf-a9e4-81b7e6a10fcf tempest-TestServerVolumeAttachmentScenario-2105694299 None] Created reservations ['bfd6bf2f-3a1a-465e-8839-1cbc4a749568', '997a8382-9723-4cbe-b763-32150515a7da', '023ba9a5-85b5-4ea5-a3ad-dc47ecbacccb', '5405ef3d-f157-4c6e-8987-758991312c13'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:33:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e06b63b5-c5e8-49bf-a9e4-81b7e6a10fcf tempest-TestServerVolumeAttachmentScenario-2105694299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:33:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e06b63b5-c5e8-49bf-a9e4-81b7e6a10fcf tempest-TestServerVolumeAttachmentScenario-2105694299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:33:55 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e06b63b5-c5e8-49bf-a9e4-81b7e6a10fcf tempest-TestServerVolumeAttachmentScenario-2105694299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:33:55 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e06b63b5-c5e8-49bf-a9e4-81b7e6a10fcf tempest-TestServerVolumeAttachmentScenario-2105694299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:33:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e06b63b5-c5e8-49bf-a9e4-81b7e6a10fcf tempest-TestServerVolumeAttachmentScenario-2105694299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:33:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e06b63b5-c5e8-49bf-a9e4-81b7e6a10fcf tempest-TestServerVolumeAttachmentScenario-2105694299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:33:55 devstack sudo[97802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:33:55 devstack sudo[97802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:33:55 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3633c424-429c-41f2-9970-1ec0e224572d tempest-TestServerVolumeAttachmentScenario-2105694299 None] Acquiring lock "cinder-5bcd6c98-b33c-4250-a5f6-0be9b8ed7532-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:33:55 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3633c424-429c-41f2-9970-1ec0e224572d tempest-TestServerVolumeAttachmentScenario-2105694299 None] Lock "cinder-5bcd6c98-b33c-4250-a5f6-0be9b8ed7532-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:33:55 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3633c424-429c-41f2-9970-1ec0e224572d tempest-TestServerVolumeAttachmentScenario-2105694299 None] Acquiring lock "cinder-quobyte-5bcd6c98-b33c-4250-a5f6-0be9b8ed7532" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:33:55 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3633c424-429c-41f2-9970-1ec0e224572d tempest-TestServerVolumeAttachmentScenario-2105694299 None] Lock "cinder-quobyte-5bcd6c98-b33c-4250-a5f6-0be9b8ed7532" acquired by "delete_volume" :: waited 0.022s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:33:55 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d3c670-410f-4f1d-b38d-d9fc5b2dbb00]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:33:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3633c424-429c-41f2-9970-1ec0e224572d tempest-TestServerVolumeAttachmentScenario-2105694299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5bcd6c98-b33c-4250-a5f6-0be9b8ed7532 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:33:55 devstack sudo[97805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5bcd6c98-b33c-4250-a5f6-0be9b8ed7532 Jul 11 04:33:55 devstack sudo[97805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:33:55 devstack sudo[97802]: pam_unix(sudo:session): session closed for user root Jul 11 04:33:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e06b63b5-c5e8-49bf-a9e4-81b7e6a10fcf tempest-TestServerVolumeAttachmentScenario-2105694299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.650s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:33:55 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-e06b63b5-c5e8-49bf-a9e4-81b7e6a10fcf tempest-TestServerVolumeAttachmentScenario-2105694299 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:33:55 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-e06b63b5-c5e8-49bf-a9e4-81b7e6a10fcf tempest-TestServerVolumeAttachmentScenario-2105694299 None] Deleted volume successfully. Jul 11 04:33:55 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e06b63b5-c5e8-49bf-a9e4-81b7e6a10fcf tempest-TestServerVolumeAttachmentScenario-2105694299 None] Lock "cinder-dc330634-78a6-4e18-b31a-8f29b5003c43-delete_volume" released by "delete_volume" :: held 2.658s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:33:56 devstack sudo[97805]: pam_unix(sudo:session): session closed for user root Jul 11 04:33:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3633c424-429c-41f2-9970-1ec0e224572d tempest-TestServerVolumeAttachmentScenario-2105694299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5bcd6c98-b33c-4250-a5f6-0be9b8ed7532" returned: 0 in 0.755s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:33:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3633c424-429c-41f2-9970-1ec0e224572d tempest-TestServerVolumeAttachmentScenario-2105694299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5bcd6c98-b33c-4250-a5f6-0be9b8ed7532 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:33:56 devstack sudo[97811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5bcd6c98-b33c-4250-a5f6-0be9b8ed7532 Jul 11 04:33:56 devstack sudo[97811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:33:57 devstack sudo[97811]: pam_unix(sudo:session): session closed for user root Jul 11 04:33:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3633c424-429c-41f2-9970-1ec0e224572d tempest-TestServerVolumeAttachmentScenario-2105694299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5bcd6c98-b33c-4250-a5f6-0be9b8ed7532" returned: 0 in 0.668s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:33:57 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3633c424-429c-41f2-9970-1ec0e224572d tempest-TestServerVolumeAttachmentScenario-2105694299 None] Lock "cinder-quobyte-5bcd6c98-b33c-4250-a5f6-0be9b8ed7532" released by "delete_volume" :: held 1.473s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:33:57 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-3633c424-429c-41f2-9970-1ec0e224572d tempest-TestServerVolumeAttachmentScenario-2105694299 None] Created reservations ['edc67c40-ab75-4389-9702-7525cdaad2b1', '0420ed0c-bcf2-48e5-82e4-993400046c02', 'a5242df4-c91b-4839-bf71-b6968b65a58f', '4019ff06-6cbb-4968-8ec9-377d26e58191'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:33:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3633c424-429c-41f2-9970-1ec0e224572d tempest-TestServerVolumeAttachmentScenario-2105694299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:33:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3633c424-429c-41f2-9970-1ec0e224572d tempest-TestServerVolumeAttachmentScenario-2105694299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:33:57 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-3633c424-429c-41f2-9970-1ec0e224572d tempest-TestServerVolumeAttachmentScenario-2105694299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:33:57 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-3633c424-429c-41f2-9970-1ec0e224572d tempest-TestServerVolumeAttachmentScenario-2105694299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:33:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3633c424-429c-41f2-9970-1ec0e224572d tempest-TestServerVolumeAttachmentScenario-2105694299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:33:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3633c424-429c-41f2-9970-1ec0e224572d tempest-TestServerVolumeAttachmentScenario-2105694299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:33:57 devstack sudo[97814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:33:57 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:33:57 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root Jul 11 04:33:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3633c424-429c-41f2-9970-1ec0e224572d tempest-TestServerVolumeAttachmentScenario-2105694299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.704s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:33:57 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-3633c424-429c-41f2-9970-1ec0e224572d tempest-TestServerVolumeAttachmentScenario-2105694299 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:33:57 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-3633c424-429c-41f2-9970-1ec0e224572d tempest-TestServerVolumeAttachmentScenario-2105694299 None] Deleted volume successfully. Jul 11 04:33:58 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3633c424-429c-41f2-9970-1ec0e224572d tempest-TestServerVolumeAttachmentScenario-2105694299 None] Lock "cinder-5bcd6c98-b33c-4250-a5f6-0be9b8ed7532-delete_volume" released by "delete_volume" :: held 2.408s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:33:58 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-be91edc8-3dd3-4337-b301-a2409b61d801 tempest-AttachVolumeNegativeTest-930293942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:33:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-be91edc8-3dd3-4337-b301-a2409b61d801 tempest-AttachVolumeNegativeTest-930293942 None] Flow 'volume_create_manager' (86896a84-eaa1-4b1e-963d-5335ddd451f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:33:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-be91edc8-3dd3-4337-b301-a2409b61d801 tempest-AttachVolumeNegativeTest-930293942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a59598ac-327e-4ab1-b25e-01c190f00222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:33:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-be91edc8-3dd3-4337-b301-a2409b61d801 tempest-AttachVolumeNegativeTest-930293942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a59598ac-327e-4ab1-b25e-01c190f00222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2106404290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fb3e5bb-ab60-44c3-bd5a-8c1dc09ef3e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44e231901653417dbcb1950f52b0f087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:33:59Z,use_quota=True,user_id='8a13d9d5816e46b2a784648c5f438e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:33:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-be91edc8-3dd3-4337-b301-a2409b61d801 tempest-AttachVolumeNegativeTest-930293942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f32a1b-2c11-45be-b35f-80d7cbb57a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:33:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-be91edc8-3dd3-4337-b301-a2409b61d801 tempest-AttachVolumeNegativeTest-930293942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f32a1b-2c11-45be-b35f-80d7cbb57a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:33:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-be91edc8-3dd3-4337-b301-a2409b61d801 tempest-AttachVolumeNegativeTest-930293942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b6046e9-3590-4f21-9f93-8a6e31d4e893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:33:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-be91edc8-3dd3-4337-b301-a2409b61d801 tempest-AttachVolumeNegativeTest-930293942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b6046e9-3590-4f21-9f93-8a6e31d4e893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fb3e5bb-ab60-44c3-bd5a-8c1dc09ef3e8', 'volume_name': 'volume-5fb3e5bb-ab60-44c3-bd5a-8c1dc09ef3e8', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:33:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-be91edc8-3dd3-4337-b301-a2409b61d801 tempest-AttachVolumeNegativeTest-930293942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (def37e2c-626e-4d4f-abad-0b942c4eff15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:33:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-be91edc8-3dd3-4337-b301-a2409b61d801 tempest-AttachVolumeNegativeTest-930293942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (def37e2c-626e-4d4f-abad-0b942c4eff15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:33:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-be91edc8-3dd3-4337-b301-a2409b61d801 tempest-AttachVolumeNegativeTest-930293942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbff770a-5620-465b-bb85-74e3a707f327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:33:58 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-be91edc8-3dd3-4337-b301-a2409b61d801 tempest-AttachVolumeNegativeTest-930293942 None] Volume 5fb3e5bb-ab60-44c3-bd5a-8c1dc09ef3e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fb3e5bb-ab60-44c3-bd5a-8c1dc09ef3e8', 'volume_size': 1} Jul 11 04:33:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-be91edc8-3dd3-4337-b301-a2409b61d801 tempest-AttachVolumeNegativeTest-930293942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:33:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-be91edc8-3dd3-4337-b301-a2409b61d801 tempest-AttachVolumeNegativeTest-930293942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:33:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-be91edc8-3dd3-4337-b301-a2409b61d801 tempest-AttachVolumeNegativeTest-930293942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2106404290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fb3e5bb-ab60-44c3-bd5a-8c1dc09ef3e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44e231901653417dbcb1950f52b0f087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:33:59Z,use_quota=True,user_id='8a13d9d5816e46b2a784648c5f438e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:33:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-be91edc8-3dd3-4337-b301-a2409b61d801 tempest-AttachVolumeNegativeTest-930293942 None] Creating volume 5fb3e5bb-ab60-44c3-bd5a-8c1dc09ef3e8 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:33:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-be91edc8-3dd3-4337-b301-a2409b61d801 tempest-AttachVolumeNegativeTest-930293942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:33:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-be91edc8-3dd3-4337-b301-a2409b61d801 tempest-AttachVolumeNegativeTest-930293942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:33:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-be91edc8-3dd3-4337-b301-a2409b61d801 tempest-AttachVolumeNegativeTest-930293942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:33:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-be91edc8-3dd3-4337-b301-a2409b61d801 tempest-AttachVolumeNegativeTest-930293942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:33:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-be91edc8-3dd3-4337-b301-a2409b61d801 tempest-AttachVolumeNegativeTest-930293942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:33:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-be91edc8-3dd3-4337-b301-a2409b61d801 tempest-AttachVolumeNegativeTest-930293942 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:33:58 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-be91edc8-3dd3-4337-b301-a2409b61d801 tempest-AttachVolumeNegativeTest-930293942 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:33:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-be91edc8-3dd3-4337-b301-a2409b61d801 tempest-AttachVolumeNegativeTest-930293942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5fb3e5bb-ab60-44c3-bd5a-8c1dc09ef3e8 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:33:58 devstack sudo[97819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5fb3e5bb-ab60-44c3-bd5a-8c1dc09ef3e8 1073741824 Jul 11 04:33:58 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:33:59 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:33:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:33:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:33:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:33:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:33:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:33:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:33:59 devstack sudo[97821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:33:59 devstack sudo[97821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:34:00 devstack sudo[97821]: pam_unix(sudo:session): session closed for user root Jul 11 04:34:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.872s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:34:00 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:34:00 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager._thread_info {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:34:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread count: 28 {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:34:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread info: [<_MainThread(MainThread, started 124675027595392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:34:00 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root Jul 11 04:34:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-be91edc8-3dd3-4337-b301-a2409b61d801 tempest-AttachVolumeNegativeTest-930293942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5fb3e5bb-ab60-44c3-bd5a-8c1dc09ef3e8 1073741824" returned: 0 in 1.456s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:34:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-be91edc8-3dd3-4337-b301-a2409b61d801 tempest-AttachVolumeNegativeTest-930293942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5fb3e5bb-ab60-44c3-bd5a-8c1dc09ef3e8 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:34:00 devstack sudo[97843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5fb3e5bb-ab60-44c3-bd5a-8c1dc09ef3e8 Jul 11 04:34:00 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:34:01 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root Jul 11 04:34:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-be91edc8-3dd3-4337-b301-a2409b61d801 tempest-AttachVolumeNegativeTest-930293942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5fb3e5bb-ab60-44c3-bd5a-8c1dc09ef3e8" returned: 0 in 0.853s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:34:01 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-be91edc8-3dd3-4337-b301-a2409b61d801 tempest-AttachVolumeNegativeTest-930293942 None] <== create_volume: return (2373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:34:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-be91edc8-3dd3-4337-b301-a2409b61d801 tempest-AttachVolumeNegativeTest-930293942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.376s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:34:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-be91edc8-3dd3-4337-b301-a2409b61d801 tempest-AttachVolumeNegativeTest-930293942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbff770a-5620-465b-bb85-74e3a707f327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fb3e5bb-ab60-44c3-bd5a-8c1dc09ef3e8', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:34:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-be91edc8-3dd3-4337-b301-a2409b61d801 tempest-AttachVolumeNegativeTest-930293942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc64bff-fa17-4825-9544-23420190c560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:34:01 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-be91edc8-3dd3-4337-b301-a2409b61d801 tempest-AttachVolumeNegativeTest-930293942 None] Volume volume-5fb3e5bb-ab60-44c3-bd5a-8c1dc09ef3e8 (5fb3e5bb-ab60-44c3-bd5a-8c1dc09ef3e8): created successfully Jul 11 04:34:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-be91edc8-3dd3-4337-b301-a2409b61d801 tempest-AttachVolumeNegativeTest-930293942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc64bff-fa17-4825-9544-23420190c560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:34:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-be91edc8-3dd3-4337-b301-a2409b61d801 tempest-AttachVolumeNegativeTest-930293942 None] Flow 'volume_create_manager' (86896a84-eaa1-4b1e-963d-5335ddd451f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:34:01 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-be91edc8-3dd3-4337-b301-a2409b61d801 tempest-AttachVolumeNegativeTest-930293942 None] Created volume successfully. Jul 11 04:34:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-7d39cb90-a629-480c-8968-ca33bf566afc req-c7073fbd-bd52-4df9-86a7-bda38828f290 tempest-AttachVolumeNegativeTest-930293942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:34:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-7d39cb90-a629-480c-8968-ca33bf566afc req-c7073fbd-bd52-4df9-86a7-bda38828f290 tempest-AttachVolumeNegativeTest-930293942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:34:05 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e13e2d-9620-418e-a6dc-11f47f458af6]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:34:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-7d39cb90-a629-480c-8968-ca33bf566afc req-c7073fbd-bd52-4df9-86a7-bda38828f290 tempest-AttachVolumeNegativeTest-930293942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5fb3e5bb-ab60-44c3-bd5a-8c1dc09ef3e8 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:34:05 devstack sudo[97948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5fb3e5bb-ab60-44c3-bd5a-8c1dc09ef3e8 Jul 11 04:34:05 devstack sudo[97948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:34:06 devstack sudo[97948]: pam_unix(sudo:session): session closed for user root Jul 11 04:34:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-7d39cb90-a629-480c-8968-ca33bf566afc req-c7073fbd-bd52-4df9-86a7-bda38828f290 tempest-AttachVolumeNegativeTest-930293942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5fb3e5bb-ab60-44c3-bd5a-8c1dc09ef3e8" returned: 0 in 1.233s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:34:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-7d39cb90-a629-480c-8968-ca33bf566afc req-c7073fbd-bd52-4df9-86a7-bda38828f290 tempest-AttachVolumeNegativeTest-930293942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.260s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:34:06 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-7d39cb90-a629-480c-8968-ca33bf566afc req-c7073fbd-bd52-4df9-86a7-bda38828f290 tempest-AttachVolumeNegativeTest-930293942 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95', 'name': 'volume-5fb3e5bb-ab60-44c3-bd5a-8c1dc09ef3e8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7111417e-58c5-45c3-b3f9-de51cd0f09f4', 'enforce_multipath': True} {{(pid=86964) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 04:34:07 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-7d39cb90-a629-480c-8968-ca33bf566afc req-c7073fbd-bd52-4df9-86a7-bda38828f290 tempest-AttachVolumeNegativeTest-930293942 None] attachment_update completed successfully. Jul 11 04:34:10 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5ff6ba0-be66-40da-a539-3b2c5450cef2 tempest-VolumesActionsTest-1247525239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:34:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e5ff6ba0-be66-40da-a539-3b2c5450cef2 tempest-VolumesActionsTest-1247525239 None] Flow 'volume_create_manager' (5c01edf1-c572-4b6c-ab15-b45c7790a059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:34:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e5ff6ba0-be66-40da-a539-3b2c5450cef2 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67ccda56-2a0e-4274-b102-8a2499ebea1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:34:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e5ff6ba0-be66-40da-a539-3b2c5450cef2 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67ccda56-2a0e-4274-b102-8a2499ebea1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1545123739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d093de3a-b4fa-4d06-9de5-d8a2711c2faf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c69db80db0a34d178f41b637c7919206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:34:11Z,use_quota=True,user_id='375b256be71241e1883629ee3579bc71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:34:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e5ff6ba0-be66-40da-a539-3b2c5450cef2 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4a94cb8-5bc2-4953-aebd-f99944af406a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:34:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e5ff6ba0-be66-40da-a539-3b2c5450cef2 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4a94cb8-5bc2-4953-aebd-f99944af406a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:34:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e5ff6ba0-be66-40da-a539-3b2c5450cef2 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cd1fc4c-50fc-48c2-9653-638b29311a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:34:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e5ff6ba0-be66-40da-a539-3b2c5450cef2 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cd1fc4c-50fc-48c2-9653-638b29311a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd093de3a-b4fa-4d06-9de5-d8a2711c2faf', 'volume_name': 'volume-d093de3a-b4fa-4d06-9de5-d8a2711c2faf', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:34:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e5ff6ba0-be66-40da-a539-3b2c5450cef2 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aa543b6-6ed3-40fb-b1f5-9626a7a17dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:34:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e5ff6ba0-be66-40da-a539-3b2c5450cef2 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aa543b6-6ed3-40fb-b1f5-9626a7a17dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:34:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e5ff6ba0-be66-40da-a539-3b2c5450cef2 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c63fb37-9120-4c3d-a053-e546b75628a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:34:10 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-e5ff6ba0-be66-40da-a539-3b2c5450cef2 tempest-VolumesActionsTest-1247525239 None] Volume d093de3a-b4fa-4d06-9de5-d8a2711c2faf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d093de3a-b4fa-4d06-9de5-d8a2711c2faf', 'volume_size': 1} Jul 11 04:34:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e5ff6ba0-be66-40da-a539-3b2c5450cef2 tempest-VolumesActionsTest-1247525239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:34:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e5ff6ba0-be66-40da-a539-3b2c5450cef2 tempest-VolumesActionsTest-1247525239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:34:10 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e5ff6ba0-be66-40da-a539-3b2c5450cef2 tempest-VolumesActionsTest-1247525239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1545123739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d093de3a-b4fa-4d06-9de5-d8a2711c2faf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c69db80db0a34d178f41b637c7919206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:34:11Z,use_quota=True,user_id='375b256be71241e1883629ee3579bc71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:34:10 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-e5ff6ba0-be66-40da-a539-3b2c5450cef2 tempest-VolumesActionsTest-1247525239 None] Creating volume d093de3a-b4fa-4d06-9de5-d8a2711c2faf {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:34:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e5ff6ba0-be66-40da-a539-3b2c5450cef2 tempest-VolumesActionsTest-1247525239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:34:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e5ff6ba0-be66-40da-a539-3b2c5450cef2 tempest-VolumesActionsTest-1247525239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:34:10 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e5ff6ba0-be66-40da-a539-3b2c5450cef2 tempest-VolumesActionsTest-1247525239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:34:10 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e5ff6ba0-be66-40da-a539-3b2c5450cef2 tempest-VolumesActionsTest-1247525239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:34:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e5ff6ba0-be66-40da-a539-3b2c5450cef2 tempest-VolumesActionsTest-1247525239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:34:10 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e5ff6ba0-be66-40da-a539-3b2c5450cef2 tempest-VolumesActionsTest-1247525239 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:34:10 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-e5ff6ba0-be66-40da-a539-3b2c5450cef2 tempest-VolumesActionsTest-1247525239 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:34:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e5ff6ba0-be66-40da-a539-3b2c5450cef2 tempest-VolumesActionsTest-1247525239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d093de3a-b4fa-4d06-9de5-d8a2711c2faf 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:34:11 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d093de3a-b4fa-4d06-9de5-d8a2711c2faf 1073741824 Jul 11 04:34:11 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:34:12 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Jul 11 04:34:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e5ff6ba0-be66-40da-a539-3b2c5450cef2 tempest-VolumesActionsTest-1247525239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d093de3a-b4fa-4d06-9de5-d8a2711c2faf 1073741824" returned: 0 in 1.242s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:34:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e5ff6ba0-be66-40da-a539-3b2c5450cef2 tempest-VolumesActionsTest-1247525239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d093de3a-b4fa-4d06-9de5-d8a2711c2faf {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:34:12 devstack sudo[98394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d093de3a-b4fa-4d06-9de5-d8a2711c2faf Jul 11 04:34:12 devstack sudo[98394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:34:13 devstack sudo[98394]: pam_unix(sudo:session): session closed for user root Jul 11 04:34:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e5ff6ba0-be66-40da-a539-3b2c5450cef2 tempest-VolumesActionsTest-1247525239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d093de3a-b4fa-4d06-9de5-d8a2711c2faf" returned: 0 in 0.955s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:34:13 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e5ff6ba0-be66-40da-a539-3b2c5450cef2 tempest-VolumesActionsTest-1247525239 None] <== create_volume: return (2269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:34:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e5ff6ba0-be66-40da-a539-3b2c5450cef2 tempest-VolumesActionsTest-1247525239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.272s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:34:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e5ff6ba0-be66-40da-a539-3b2c5450cef2 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c63fb37-9120-4c3d-a053-e546b75628a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d093de3a-b4fa-4d06-9de5-d8a2711c2faf', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:34:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e5ff6ba0-be66-40da-a539-3b2c5450cef2 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be1eb4ad-dab4-4aca-b091-f6b7980c8f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:34:13 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-e5ff6ba0-be66-40da-a539-3b2c5450cef2 tempest-VolumesActionsTest-1247525239 None] Volume volume-d093de3a-b4fa-4d06-9de5-d8a2711c2faf (d093de3a-b4fa-4d06-9de5-d8a2711c2faf): created successfully Jul 11 04:34:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e5ff6ba0-be66-40da-a539-3b2c5450cef2 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be1eb4ad-dab4-4aca-b091-f6b7980c8f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:34:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e5ff6ba0-be66-40da-a539-3b2c5450cef2 tempest-VolumesActionsTest-1247525239 None] Flow 'volume_create_manager' (5c01edf1-c572-4b6c-ab15-b45c7790a059) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:34:13 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-e5ff6ba0-be66-40da-a539-3b2c5450cef2 tempest-VolumesActionsTest-1247525239 None] Created volume successfully. Jul 11 04:34:14 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fe66f141-905a-4a1b-a808-59b06e1a20ff tempest-VolumesActionsTest-1247525239 None] Acquiring lock "cinder-d093de3a-b4fa-4d06-9de5-d8a2711c2faf" by "attach_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:34:14 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fe66f141-905a-4a1b-a808-59b06e1a20ff tempest-VolumesActionsTest-1247525239 None] Lock "cinder-d093de3a-b4fa-4d06-9de5-d8a2711c2faf" acquired by "attach_volume" :: waited 0.042s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:34:14 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-fe66f141-905a-4a1b-a808-59b06e1a20ff tempest-VolumesActionsTest-1247525239 None] Attaching volume d093de3a-b4fa-4d06-9de5-d8a2711c2faf to instance 464414ae-4e37-4b92-8c64-5ab6ea98707a at mountpoint /dev/vdb on host None. Jul 11 04:34:14 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-fe66f141-905a-4a1b-a808-59b06e1a20ff tempest-VolumesActionsTest-1247525239 None] Attach volume completed successfully. Jul 11 04:34:14 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fe66f141-905a-4a1b-a808-59b06e1a20ff tempest-VolumesActionsTest-1247525239 None] Lock "cinder-d093de3a-b4fa-4d06-9de5-d8a2711c2faf" released by "attach_volume" :: held 0.202s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:34:15 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-28c6e2b8-ad31-4890-bf69-1f0150b0c2b2 req-ae53f68a-74ac-47ca-b086-b248fb903e30 tempest-AttachVolumeNegativeTest-930293942 None] Terminate volume connection completed successfully. Jul 11 04:34:15 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-28c6e2b8-ad31-4890-bf69-1f0150b0c2b2 req-ae53f68a-74ac-47ca-b086-b248fb903e30 tempest-AttachVolumeNegativeTest-930293942 None] Deleting attachment 7111417e-58c5-45c3-b3f9-de51cd0f09f4. {{(pid=86964) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 04:34:15 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-42a79b2e-4a3a-4671-a449-9d333e9a7c67 tempest-VolumesActionsTest-560347811 None] Terminate volume connection completed successfully. Jul 11 04:34:16 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-42a79b2e-4a3a-4671-a449-9d333e9a7c67 tempest-VolumesActionsTest-560347811 None] Acquiring lock "cinder-d093de3a-b4fa-4d06-9de5-d8a2711c2faf-detach_volume" by "detach_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:34:16 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-42a79b2e-4a3a-4671-a449-9d333e9a7c67 tempest-VolumesActionsTest-560347811 None] Lock "cinder-d093de3a-b4fa-4d06-9de5-d8a2711c2faf-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:34:16 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-42a79b2e-4a3a-4671-a449-9d333e9a7c67 tempest-VolumesActionsTest-560347811 None] Detaching volume d093de3a-b4fa-4d06-9de5-d8a2711c2faf from instance 464414ae-4e37-4b92-8c64-5ab6ea98707a. Jul 11 04:34:16 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-42a79b2e-4a3a-4671-a449-9d333e9a7c67 tempest-VolumesActionsTest-560347811 None] Detach volume completed successfully. Jul 11 04:34:16 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-42a79b2e-4a3a-4671-a449-9d333e9a7c67 tempest-VolumesActionsTest-560347811 None] Lock "cinder-d093de3a-b4fa-4d06-9de5-d8a2711c2faf-detach_volume" released by "detach_volume" :: held 0.103s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:34:16 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c715ab1b-36b2-4329-8521-b099e69f2679 tempest-VolumesActionsTest-1247525239 None] Acquiring lock "cinder-d093de3a-b4fa-4d06-9de5-d8a2711c2faf-detach_volume" by "detach_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:34:16 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c715ab1b-36b2-4329-8521-b099e69f2679 tempest-VolumesActionsTest-1247525239 None] Lock "cinder-d093de3a-b4fa-4d06-9de5-d8a2711c2faf-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:34:16 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-c715ab1b-36b2-4329-8521-b099e69f2679 tempest-VolumesActionsTest-1247525239 None] Volume detach called, but volume not attached. Jul 11 04:34:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c715ab1b-36b2-4329-8521-b099e69f2679 tempest-VolumesActionsTest-1247525239 None] Lock "cinder-d093de3a-b4fa-4d06-9de5-d8a2711c2faf-detach_volume" released by "detach_volume" :: held 0.044s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:34:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3c72b184-e95c-48cc-b560-98a5c0f93a2c tempest-VolumesActionsTest-1247525239 None] Acquiring lock "cinder-d093de3a-b4fa-4d06-9de5-d8a2711c2faf-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:34:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3c72b184-e95c-48cc-b560-98a5c0f93a2c tempest-VolumesActionsTest-1247525239 None] Lock "cinder-d093de3a-b4fa-4d06-9de5-d8a2711c2faf-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:34:18 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3c72b184-e95c-48cc-b560-98a5c0f93a2c tempest-VolumesActionsTest-1247525239 None] Acquiring lock "cinder-quobyte-d093de3a-b4fa-4d06-9de5-d8a2711c2faf" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:34:18 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3c72b184-e95c-48cc-b560-98a5c0f93a2c tempest-VolumesActionsTest-1247525239 None] Lock "cinder-quobyte-d093de3a-b4fa-4d06-9de5-d8a2711c2faf" acquired by "delete_volume" :: waited 0.043s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:34:18 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a61c22f-40c1-4948-86be-32c97ae7d7bb]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:34:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3c72b184-e95c-48cc-b560-98a5c0f93a2c tempest-VolumesActionsTest-1247525239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d093de3a-b4fa-4d06-9de5-d8a2711c2faf {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:34:18 devstack sudo[98495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d093de3a-b4fa-4d06-9de5-d8a2711c2faf Jul 11 04:34:18 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:34:19 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-68a8b468-7a76-48be-a4a9-6589a0938705 tempest-VolumesActionsTest-1672075969 None] Acquiring lock "cinder-c26d4c8f-0a69-45b0-83db-1bee00a0307c" by "attach_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:34:19 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-68a8b468-7a76-48be-a4a9-6589a0938705 tempest-VolumesActionsTest-1672075969 None] Lock "cinder-c26d4c8f-0a69-45b0-83db-1bee00a0307c" acquired by "attach_volume" :: waited 0.042s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:34:19 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-68a8b468-7a76-48be-a4a9-6589a0938705 tempest-VolumesActionsTest-1672075969 None] Attaching volume c26d4c8f-0a69-45b0-83db-1bee00a0307c to instance 3f267419-893e-4a68-ae22-63f5f43fc1a1 at mountpoint /dev/vdb on host None. Jul 11 04:34:19 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-68a8b468-7a76-48be-a4a9-6589a0938705 tempest-VolumesActionsTest-1672075969 None] Attach volume completed successfully. Jul 11 04:34:19 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-68a8b468-7a76-48be-a4a9-6589a0938705 tempest-VolumesActionsTest-1672075969 None] Lock "cinder-c26d4c8f-0a69-45b0-83db-1bee00a0307c" released by "attach_volume" :: held 0.213s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:34:20 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root Jul 11 04:34:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3c72b184-e95c-48cc-b560-98a5c0f93a2c tempest-VolumesActionsTest-1247525239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d093de3a-b4fa-4d06-9de5-d8a2711c2faf" returned: 0 in 2.331s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:34:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3c72b184-e95c-48cc-b560-98a5c0f93a2c tempest-VolumesActionsTest-1247525239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d093de3a-b4fa-4d06-9de5-d8a2711c2faf {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:34:20 devstack sudo[98551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d093de3a-b4fa-4d06-9de5-d8a2711c2faf Jul 11 04:34:20 devstack sudo[98551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:34:20 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-87e5a0ee-a10b-458e-9418-a00d54880b56 tempest-VolumesActionsTest-1672075969 None] Acquiring lock "cinder-c26d4c8f-0a69-45b0-83db-1bee00a0307c-detach_volume" by "detach_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:34:20 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-87e5a0ee-a10b-458e-9418-a00d54880b56 tempest-VolumesActionsTest-1672075969 None] Lock "cinder-c26d4c8f-0a69-45b0-83db-1bee00a0307c-detach_volume" acquired by "detach_volume" :: waited 0.098s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:34:20 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-87e5a0ee-a10b-458e-9418-a00d54880b56 tempest-VolumesActionsTest-1672075969 None] Detaching volume c26d4c8f-0a69-45b0-83db-1bee00a0307c from instance 3f267419-893e-4a68-ae22-63f5f43fc1a1. Jul 11 04:34:20 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-87e5a0ee-a10b-458e-9418-a00d54880b56 tempest-VolumesActionsTest-1672075969 None] Detach volume completed successfully. Jul 11 04:34:20 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-87e5a0ee-a10b-458e-9418-a00d54880b56 tempest-VolumesActionsTest-1672075969 None] Lock "cinder-c26d4c8f-0a69-45b0-83db-1bee00a0307c-detach_volume" released by "detach_volume" :: held 0.109s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:34:21 devstack sudo[98551]: pam_unix(sudo:session): session closed for user root Jul 11 04:34:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3c72b184-e95c-48cc-b560-98a5c0f93a2c tempest-VolumesActionsTest-1247525239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d093de3a-b4fa-4d06-9de5-d8a2711c2faf" returned: 0 in 1.283s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:34:21 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3c72b184-e95c-48cc-b560-98a5c0f93a2c tempest-VolumesActionsTest-1247525239 None] Lock "cinder-quobyte-d093de3a-b4fa-4d06-9de5-d8a2711c2faf" released by "delete_volume" :: held 3.683s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:34:21 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-3c72b184-e95c-48cc-b560-98a5c0f93a2c tempest-VolumesActionsTest-1247525239 None] Created reservations ['55808f65-0677-4370-acec-5ea3460c1455', 'e450549a-abb0-4203-8fc7-3a96fa39e42a', '80e06c40-af6b-4b40-968f-f70d00b6926c', 'a533fca2-8336-4055-b0cc-f081ad2247e1'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:34:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3c72b184-e95c-48cc-b560-98a5c0f93a2c tempest-VolumesActionsTest-1247525239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:34:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3c72b184-e95c-48cc-b560-98a5c0f93a2c tempest-VolumesActionsTest-1247525239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:34:21 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-3c72b184-e95c-48cc-b560-98a5c0f93a2c tempest-VolumesActionsTest-1247525239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:34:21 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-3c72b184-e95c-48cc-b560-98a5c0f93a2c tempest-VolumesActionsTest-1247525239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:34:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3c72b184-e95c-48cc-b560-98a5c0f93a2c tempest-VolumesActionsTest-1247525239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:34:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3c72b184-e95c-48cc-b560-98a5c0f93a2c tempest-VolumesActionsTest-1247525239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:34:21 devstack sudo[98557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:34:21 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:34:23 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root Jul 11 04:34:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3c72b184-e95c-48cc-b560-98a5c0f93a2c tempest-VolumesActionsTest-1247525239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 1.047s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:34:23 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-3c72b184-e95c-48cc-b560-98a5c0f93a2c tempest-VolumesActionsTest-1247525239 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:34:23 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-3c72b184-e95c-48cc-b560-98a5c0f93a2c tempest-VolumesActionsTest-1247525239 None] Deleted volume successfully. Jul 11 04:34:23 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3c72b184-e95c-48cc-b560-98a5c0f93a2c tempest-VolumesActionsTest-1247525239 None] Lock "cinder-d093de3a-b4fa-4d06-9de5-d8a2711c2faf-delete_volume" released by "delete_volume" :: held 5.057s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:34:23 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1c525fd-cd21-4823-a911-b6e85eb5d038 tempest-ProjectReaderTests-1257901305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:34:23 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b1c525fd-cd21-4823-a911-b6e85eb5d038 tempest-ProjectReaderTests-1257901305 None] Flow 'volume_create_manager' (a34da7fd-b497-45be-b776-5d02c25e866b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:34:23 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b1c525fd-cd21-4823-a911-b6e85eb5d038 tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff6cf519-9ecc-4ed4-9b6e-d86df6308b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:34:23 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b1c525fd-cd21-4823-a911-b6e85eb5d038 tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff6cf519-9ecc-4ed4-9b6e-d86df6308b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1154775917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02a5cb70-1d3f-4bb8-bdb7-8cc849cccbd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ad838d72f4544ce9b5b6f16e9c50f39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:34:24Z,use_quota=True,user_id='a34d05aeaa8c4abc8cacb89ab3f39e1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:34:23 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b1c525fd-cd21-4823-a911-b6e85eb5d038 tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ddcbb42-de95-4834-9438-a96159228370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:34:23 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b1c525fd-cd21-4823-a911-b6e85eb5d038 tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ddcbb42-de95-4834-9438-a96159228370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:34:23 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b1c525fd-cd21-4823-a911-b6e85eb5d038 tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69f850c5-3017-42e9-bf85-8d41781ba441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:34:23 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b1c525fd-cd21-4823-a911-b6e85eb5d038 tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69f850c5-3017-42e9-bf85-8d41781ba441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02a5cb70-1d3f-4bb8-bdb7-8cc849cccbd5', 'volume_name': 'volume-02a5cb70-1d3f-4bb8-bdb7-8cc849cccbd5', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:34:23 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b1c525fd-cd21-4823-a911-b6e85eb5d038 tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26f29247-e0c2-4e3e-ac03-076946e57f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:34:23 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b1c525fd-cd21-4823-a911-b6e85eb5d038 tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26f29247-e0c2-4e3e-ac03-076946e57f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:34:23 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b1c525fd-cd21-4823-a911-b6e85eb5d038 tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88867027-2808-4b04-88a0-20114f62c001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:34:23 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-b1c525fd-cd21-4823-a911-b6e85eb5d038 tempest-ProjectReaderTests-1257901305 None] Volume 02a5cb70-1d3f-4bb8-bdb7-8cc849cccbd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02a5cb70-1d3f-4bb8-bdb7-8cc849cccbd5', 'volume_size': 1} Jul 11 04:34:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b1c525fd-cd21-4823-a911-b6e85eb5d038 tempest-ProjectReaderTests-1257901305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:34:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b1c525fd-cd21-4823-a911-b6e85eb5d038 tempest-ProjectReaderTests-1257901305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:34:23 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b1c525fd-cd21-4823-a911-b6e85eb5d038 tempest-ProjectReaderTests-1257901305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1154775917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02a5cb70-1d3f-4bb8-bdb7-8cc849cccbd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ad838d72f4544ce9b5b6f16e9c50f39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:34:24Z,use_quota=True,user_id='a34d05aeaa8c4abc8cacb89ab3f39e1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:34:23 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-b1c525fd-cd21-4823-a911-b6e85eb5d038 tempest-ProjectReaderTests-1257901305 None] Creating volume 02a5cb70-1d3f-4bb8-bdb7-8cc849cccbd5 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:34:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b1c525fd-cd21-4823-a911-b6e85eb5d038 tempest-ProjectReaderTests-1257901305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:34:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b1c525fd-cd21-4823-a911-b6e85eb5d038 tempest-ProjectReaderTests-1257901305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:34:23 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b1c525fd-cd21-4823-a911-b6e85eb5d038 tempest-ProjectReaderTests-1257901305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:34:23 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b1c525fd-cd21-4823-a911-b6e85eb5d038 tempest-ProjectReaderTests-1257901305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:34:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b1c525fd-cd21-4823-a911-b6e85eb5d038 tempest-ProjectReaderTests-1257901305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:34:23 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b1c525fd-cd21-4823-a911-b6e85eb5d038 tempest-ProjectReaderTests-1257901305 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:34:23 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-b1c525fd-cd21-4823-a911-b6e85eb5d038 tempest-ProjectReaderTests-1257901305 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:34:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b1c525fd-cd21-4823-a911-b6e85eb5d038 tempest-ProjectReaderTests-1257901305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-02a5cb70-1d3f-4bb8-bdb7-8cc849cccbd5 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:34:23 devstack sudo[98580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-02a5cb70-1d3f-4bb8-bdb7-8cc849cccbd5 1073741824 Jul 11 04:34:23 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:34:25 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root Jul 11 04:34:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b1c525fd-cd21-4823-a911-b6e85eb5d038 tempest-ProjectReaderTests-1257901305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-02a5cb70-1d3f-4bb8-bdb7-8cc849cccbd5 1073741824" returned: 0 in 1.211s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:34:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b1c525fd-cd21-4823-a911-b6e85eb5d038 tempest-ProjectReaderTests-1257901305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-02a5cb70-1d3f-4bb8-bdb7-8cc849cccbd5 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:34:25 devstack sudo[98608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-02a5cb70-1d3f-4bb8-bdb7-8cc849cccbd5 Jul 11 04:34:25 devstack sudo[98608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:34:25 devstack sudo[98608]: pam_unix(sudo:session): session closed for user root Jul 11 04:34:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b1c525fd-cd21-4823-a911-b6e85eb5d038 tempest-ProjectReaderTests-1257901305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-02a5cb70-1d3f-4bb8-bdb7-8cc849cccbd5" returned: 0 in 0.794s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:34:25 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b1c525fd-cd21-4823-a911-b6e85eb5d038 tempest-ProjectReaderTests-1257901305 None] <== create_volume: return (2048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:34:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b1c525fd-cd21-4823-a911-b6e85eb5d038 tempest-ProjectReaderTests-1257901305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.052s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:34:26 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b1c525fd-cd21-4823-a911-b6e85eb5d038 tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88867027-2808-4b04-88a0-20114f62c001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02a5cb70-1d3f-4bb8-bdb7-8cc849cccbd5', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:34:26 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b1c525fd-cd21-4823-a911-b6e85eb5d038 tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d81ceae-6b93-4e0b-a968-98e4e141d048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:34:26 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-b1c525fd-cd21-4823-a911-b6e85eb5d038 tempest-ProjectReaderTests-1257901305 None] Volume volume-02a5cb70-1d3f-4bb8-bdb7-8cc849cccbd5 (02a5cb70-1d3f-4bb8-bdb7-8cc849cccbd5): created successfully Jul 11 04:34:26 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b1c525fd-cd21-4823-a911-b6e85eb5d038 tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d81ceae-6b93-4e0b-a968-98e4e141d048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:34:26 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b1c525fd-cd21-4823-a911-b6e85eb5d038 tempest-ProjectReaderTests-1257901305 None] Flow 'volume_create_manager' (a34da7fd-b497-45be-b776-5d02c25e866b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:34:26 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-b1c525fd-cd21-4823-a911-b6e85eb5d038 tempest-ProjectReaderTests-1257901305 None] Created volume successfully. Jul 11 04:34:27 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6fca6f3a-3a6e-416b-8199-0a58e1d62c22 tempest-ProjectReaderTests-1257901305 None] Acquiring lock "cinder-02a5cb70-1d3f-4bb8-bdb7-8cc849cccbd5-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:34:27 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6fca6f3a-3a6e-416b-8199-0a58e1d62c22 tempest-ProjectReaderTests-1257901305 None] Lock "cinder-02a5cb70-1d3f-4bb8-bdb7-8cc849cccbd5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:34:27 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=63,cinder:INSERT=10,cinder:UPDATE=43,cinder:DELETE=4 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:34:27 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:UPDATE=55,cinder:SELECT=53,cinder:INSERT=12,cinder:DELETE=3 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:34:27 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6fca6f3a-3a6e-416b-8199-0a58e1d62c22 tempest-ProjectReaderTests-1257901305 None] Acquiring lock "cinder-quobyte-02a5cb70-1d3f-4bb8-bdb7-8cc849cccbd5" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:34:27 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6fca6f3a-3a6e-416b-8199-0a58e1d62c22 tempest-ProjectReaderTests-1257901305 None] Lock "cinder-quobyte-02a5cb70-1d3f-4bb8-bdb7-8cc849cccbd5" acquired by "delete_volume" :: waited 0.017s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:34:27 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3dccea7-955c-4ac2-bfff-a8573a7db36f]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:34:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6fca6f3a-3a6e-416b-8199-0a58e1d62c22 tempest-ProjectReaderTests-1257901305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-02a5cb70-1d3f-4bb8-bdb7-8cc849cccbd5 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:34:27 devstack sudo[98615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-02a5cb70-1d3f-4bb8-bdb7-8cc849cccbd5 Jul 11 04:34:27 devstack sudo[98615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:34:28 devstack sudo[98615]: pam_unix(sudo:session): session closed for user root Jul 11 04:34:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6fca6f3a-3a6e-416b-8199-0a58e1d62c22 tempest-ProjectReaderTests-1257901305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-02a5cb70-1d3f-4bb8-bdb7-8cc849cccbd5" returned: 0 in 0.827s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:34:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6fca6f3a-3a6e-416b-8199-0a58e1d62c22 tempest-ProjectReaderTests-1257901305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-02a5cb70-1d3f-4bb8-bdb7-8cc849cccbd5 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:34:28 devstack sudo[98620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-02a5cb70-1d3f-4bb8-bdb7-8cc849cccbd5 Jul 11 04:34:28 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:34:28 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root Jul 11 04:34:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6fca6f3a-3a6e-416b-8199-0a58e1d62c22 tempest-ProjectReaderTests-1257901305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-02a5cb70-1d3f-4bb8-bdb7-8cc849cccbd5" returned: 0 in 0.674s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:34:28 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6fca6f3a-3a6e-416b-8199-0a58e1d62c22 tempest-ProjectReaderTests-1257901305 None] Lock "cinder-quobyte-02a5cb70-1d3f-4bb8-bdb7-8cc849cccbd5" released by "delete_volume" :: held 1.550s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:34:28 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-6fca6f3a-3a6e-416b-8199-0a58e1d62c22 tempest-ProjectReaderTests-1257901305 None] Created reservations ['010d555e-729f-4d6a-81fe-9abf34c08e07', '073417f7-cd7e-42c3-9c64-097782e6288a', '0b6b064b-2594-4eee-82c4-904a07eb0989', '76a754c0-ebcc-43fd-9391-064090df203f'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:34:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6fca6f3a-3a6e-416b-8199-0a58e1d62c22 tempest-ProjectReaderTests-1257901305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:34:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6fca6f3a-3a6e-416b-8199-0a58e1d62c22 tempest-ProjectReaderTests-1257901305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:34:29 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6fca6f3a-3a6e-416b-8199-0a58e1d62c22 tempest-ProjectReaderTests-1257901305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:34:29 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6fca6f3a-3a6e-416b-8199-0a58e1d62c22 tempest-ProjectReaderTests-1257901305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:34:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6fca6f3a-3a6e-416b-8199-0a58e1d62c22 tempest-ProjectReaderTests-1257901305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:34:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6fca6f3a-3a6e-416b-8199-0a58e1d62c22 tempest-ProjectReaderTests-1257901305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:34:29 devstack sudo[98623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:34:29 devstack sudo[98623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:34:29 devstack sudo[98623]: pam_unix(sudo:session): session closed for user root Jul 11 04:34:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6fca6f3a-3a6e-416b-8199-0a58e1d62c22 tempest-ProjectReaderTests-1257901305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.736s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:34:29 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-6fca6f3a-3a6e-416b-8199-0a58e1d62c22 tempest-ProjectReaderTests-1257901305 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:34:29 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-6fca6f3a-3a6e-416b-8199-0a58e1d62c22 tempest-ProjectReaderTests-1257901305 None] Deleted volume successfully. Jul 11 04:34:29 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6fca6f3a-3a6e-416b-8199-0a58e1d62c22 tempest-ProjectReaderTests-1257901305 None] Lock "cinder-02a5cb70-1d3f-4bb8-bdb7-8cc849cccbd5-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:34:30 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-841642dc-c645-429a-b0c0-9043bdd9d816 tempest-ProjectReaderTests-1257901305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:34:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-841642dc-c645-429a-b0c0-9043bdd9d816 tempest-ProjectReaderTests-1257901305 None] Flow 'volume_create_manager' (1a199fc1-fbe1-47bf-9c3a-76f58f8cb076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:34:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-841642dc-c645-429a-b0c0-9043bdd9d816 tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3651bab3-c2ac-499c-af02-d25cfe9fd1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:34:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-841642dc-c645-429a-b0c0-9043bdd9d816 tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3651bab3-c2ac-499c-af02-d25cfe9fd1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-113498755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=251239c7-7bcc-4423-bbd8-3f88cd93d9b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ad838d72f4544ce9b5b6f16e9c50f39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:34:30Z,use_quota=True,user_id='a34d05aeaa8c4abc8cacb89ab3f39e1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:34:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-841642dc-c645-429a-b0c0-9043bdd9d816 tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84cbc566-2fcd-4365-ba7e-211b70ce35d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:34:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-841642dc-c645-429a-b0c0-9043bdd9d816 tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84cbc566-2fcd-4365-ba7e-211b70ce35d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:34:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-841642dc-c645-429a-b0c0-9043bdd9d816 tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc241b2e-974d-4c81-bd27-022788aa4464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:34:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-841642dc-c645-429a-b0c0-9043bdd9d816 tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc241b2e-974d-4c81-bd27-022788aa4464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '251239c7-7bcc-4423-bbd8-3f88cd93d9b3', 'volume_name': 'volume-251239c7-7bcc-4423-bbd8-3f88cd93d9b3', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:34:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-841642dc-c645-429a-b0c0-9043bdd9d816 tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b411c71-451e-4083-be11-b41e41156dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:34:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-841642dc-c645-429a-b0c0-9043bdd9d816 tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b411c71-451e-4083-be11-b41e41156dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:34:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-841642dc-c645-429a-b0c0-9043bdd9d816 tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac688e43-a69c-4a80-841d-18b5a15423d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:34:30 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-841642dc-c645-429a-b0c0-9043bdd9d816 tempest-ProjectReaderTests-1257901305 None] Volume 251239c7-7bcc-4423-bbd8-3f88cd93d9b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-251239c7-7bcc-4423-bbd8-3f88cd93d9b3', 'volume_size': 1} Jul 11 04:34:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-841642dc-c645-429a-b0c0-9043bdd9d816 tempest-ProjectReaderTests-1257901305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:34:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-841642dc-c645-429a-b0c0-9043bdd9d816 tempest-ProjectReaderTests-1257901305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:34:30 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-841642dc-c645-429a-b0c0-9043bdd9d816 tempest-ProjectReaderTests-1257901305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-113498755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=251239c7-7bcc-4423-bbd8-3f88cd93d9b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ad838d72f4544ce9b5b6f16e9c50f39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:34:30Z,use_quota=True,user_id='a34d05aeaa8c4abc8cacb89ab3f39e1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:34:30 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-841642dc-c645-429a-b0c0-9043bdd9d816 tempest-ProjectReaderTests-1257901305 None] Creating volume 251239c7-7bcc-4423-bbd8-3f88cd93d9b3 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:34:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-841642dc-c645-429a-b0c0-9043bdd9d816 tempest-ProjectReaderTests-1257901305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:34:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-841642dc-c645-429a-b0c0-9043bdd9d816 tempest-ProjectReaderTests-1257901305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:34:30 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-841642dc-c645-429a-b0c0-9043bdd9d816 tempest-ProjectReaderTests-1257901305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:34:30 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-841642dc-c645-429a-b0c0-9043bdd9d816 tempest-ProjectReaderTests-1257901305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:34:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-841642dc-c645-429a-b0c0-9043bdd9d816 tempest-ProjectReaderTests-1257901305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:34:30 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-841642dc-c645-429a-b0c0-9043bdd9d816 tempest-ProjectReaderTests-1257901305 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:34:30 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-841642dc-c645-429a-b0c0-9043bdd9d816 tempest-ProjectReaderTests-1257901305 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:34:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-841642dc-c645-429a-b0c0-9043bdd9d816 tempest-ProjectReaderTests-1257901305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-251239c7-7bcc-4423-bbd8-3f88cd93d9b3 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:34:30 devstack sudo[98626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-251239c7-7bcc-4423-bbd8-3f88cd93d9b3 1073741824 Jul 11 04:34:30 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:34:30 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-3234ac35-0e72-4715-b73b-0dcbed6c1a76 tempest-VolumesActionsTest-1247525239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:34:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3234ac35-0e72-4715-b73b-0dcbed6c1a76 tempest-VolumesActionsTest-1247525239 None] Flow 'volume_create_manager' (edf9aae9-7603-4a1c-88b6-10e23c0e5eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:34:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3234ac35-0e72-4715-b73b-0dcbed6c1a76 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a3f1660-55d7-44f1-85a2-433db1e7daee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:34:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3234ac35-0e72-4715-b73b-0dcbed6c1a76 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a3f1660-55d7-44f1-85a2-433db1e7daee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-377899637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffa86da4-c4e3-4c88-b83e-5d8f497bb815,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c69db80db0a34d178f41b637c7919206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:34:31Z,use_quota=True,user_id='375b256be71241e1883629ee3579bc71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:34:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3234ac35-0e72-4715-b73b-0dcbed6c1a76 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fadc4e3-edde-475e-9cb9-bc84dfdbaa8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:34:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3234ac35-0e72-4715-b73b-0dcbed6c1a76 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fadc4e3-edde-475e-9cb9-bc84dfdbaa8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:34:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3234ac35-0e72-4715-b73b-0dcbed6c1a76 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c0b776d-e3e2-44f8-8782-0d17ad021eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:34:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3234ac35-0e72-4715-b73b-0dcbed6c1a76 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c0b776d-e3e2-44f8-8782-0d17ad021eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffa86da4-c4e3-4c88-b83e-5d8f497bb815', 'volume_name': 'volume-ffa86da4-c4e3-4c88-b83e-5d8f497bb815', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:34:31 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3234ac35-0e72-4715-b73b-0dcbed6c1a76 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (011a101f-0611-49b8-9365-3fce4bf0a8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:34:31 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3234ac35-0e72-4715-b73b-0dcbed6c1a76 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (011a101f-0611-49b8-9365-3fce4bf0a8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:34:31 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3234ac35-0e72-4715-b73b-0dcbed6c1a76 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (410bf69d-635a-467f-96eb-fdf8ab5c613d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:34:31 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-3234ac35-0e72-4715-b73b-0dcbed6c1a76 tempest-VolumesActionsTest-1247525239 None] Volume ffa86da4-c4e3-4c88-b83e-5d8f497bb815: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffa86da4-c4e3-4c88-b83e-5d8f497bb815', 'volume_size': 1} Jul 11 04:34:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3234ac35-0e72-4715-b73b-0dcbed6c1a76 tempest-VolumesActionsTest-1247525239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:34:31 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root Jul 11 04:34:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-841642dc-c645-429a-b0c0-9043bdd9d816 tempest-ProjectReaderTests-1257901305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-251239c7-7bcc-4423-bbd8-3f88cd93d9b3 1073741824" returned: 0 in 0.978s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:34:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-07ce6647-b3bf-444d-b8bd-22d20d9bdbf4 tempest-VolumesActionsTest-1672075969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:34:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-841642dc-c645-429a-b0c0-9043bdd9d816 tempest-ProjectReaderTests-1257901305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-251239c7-7bcc-4423-bbd8-3f88cd93d9b3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:34:31 devstack sudo[98632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-251239c7-7bcc-4423-bbd8-3f88cd93d9b3 Jul 11 04:34:31 devstack sudo[98632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:34:31 devstack sudo[98632]: pam_unix(sudo:session): session closed for user root Jul 11 04:34:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-841642dc-c645-429a-b0c0-9043bdd9d816 tempest-ProjectReaderTests-1257901305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-251239c7-7bcc-4423-bbd8-3f88cd93d9b3" returned: 0 in 0.629s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:34:31 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-841642dc-c645-429a-b0c0-9043bdd9d816 tempest-ProjectReaderTests-1257901305 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:34:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-841642dc-c645-429a-b0c0-9043bdd9d816 tempest-ProjectReaderTests-1257901305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:34:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3234ac35-0e72-4715-b73b-0dcbed6c1a76 tempest-VolumesActionsTest-1247525239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.916s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:34:31 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-3234ac35-0e72-4715-b73b-0dcbed6c1a76 tempest-VolumesActionsTest-1247525239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-377899637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffa86da4-c4e3-4c88-b83e-5d8f497bb815,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c69db80db0a34d178f41b637c7919206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:34:31Z,use_quota=True,user_id='375b256be71241e1883629ee3579bc71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:34:31 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-3234ac35-0e72-4715-b73b-0dcbed6c1a76 tempest-VolumesActionsTest-1247525239 None] Creating volume ffa86da4-c4e3-4c88-b83e-5d8f497bb815 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:34:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3234ac35-0e72-4715-b73b-0dcbed6c1a76 tempest-VolumesActionsTest-1247525239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:34:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3234ac35-0e72-4715-b73b-0dcbed6c1a76 tempest-VolumesActionsTest-1247525239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:34:31 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-3234ac35-0e72-4715-b73b-0dcbed6c1a76 tempest-VolumesActionsTest-1247525239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:34:31 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-3234ac35-0e72-4715-b73b-0dcbed6c1a76 tempest-VolumesActionsTest-1247525239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:34:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3234ac35-0e72-4715-b73b-0dcbed6c1a76 tempest-VolumesActionsTest-1247525239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:34:31 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-3234ac35-0e72-4715-b73b-0dcbed6c1a76 tempest-VolumesActionsTest-1247525239 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:34:31 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-3234ac35-0e72-4715-b73b-0dcbed6c1a76 tempest-VolumesActionsTest-1247525239 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:34:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3234ac35-0e72-4715-b73b-0dcbed6c1a76 tempest-VolumesActionsTest-1247525239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ffa86da4-c4e3-4c88-b83e-5d8f497bb815 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:34:31 devstack sudo[98638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ffa86da4-c4e3-4c88-b83e-5d8f497bb815 1073741824 Jul 11 04:34:31 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:34:31 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-841642dc-c645-429a-b0c0-9043bdd9d816 tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac688e43-a69c-4a80-841d-18b5a15423d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-251239c7-7bcc-4423-bbd8-3f88cd93d9b3', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:34:31 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-841642dc-c645-429a-b0c0-9043bdd9d816 tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55823832-e0a5-414f-a35f-e5550a8b5918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:34:31 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-841642dc-c645-429a-b0c0-9043bdd9d816 tempest-ProjectReaderTests-1257901305 None] Volume volume-251239c7-7bcc-4423-bbd8-3f88cd93d9b3 (251239c7-7bcc-4423-bbd8-3f88cd93d9b3): created successfully Jul 11 04:34:31 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-841642dc-c645-429a-b0c0-9043bdd9d816 tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55823832-e0a5-414f-a35f-e5550a8b5918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:34:32 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-841642dc-c645-429a-b0c0-9043bdd9d816 tempest-ProjectReaderTests-1257901305 None] Flow 'volume_create_manager' (1a199fc1-fbe1-47bf-9c3a-76f58f8cb076) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:34:32 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-841642dc-c645-429a-b0c0-9043bdd9d816 tempest-ProjectReaderTests-1257901305 None] Created volume successfully. Jul 11 04:34:32 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4fc6e59c-1f4e-4c40-822b-341fbbdac4c2 tempest-ProjectReaderTests-1257901305 None] Acquiring lock "cinder-251239c7-7bcc-4423-bbd8-3f88cd93d9b3-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:34:32 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4fc6e59c-1f4e-4c40-822b-341fbbdac4c2 tempest-ProjectReaderTests-1257901305 None] Lock "cinder-251239c7-7bcc-4423-bbd8-3f88cd93d9b3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:34:32 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4fc6e59c-1f4e-4c40-822b-341fbbdac4c2 tempest-ProjectReaderTests-1257901305 None] Acquiring lock "cinder-quobyte-251239c7-7bcc-4423-bbd8-3f88cd93d9b3" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:34:32 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4fc6e59c-1f4e-4c40-822b-341fbbdac4c2 tempest-ProjectReaderTests-1257901305 None] Lock "cinder-quobyte-251239c7-7bcc-4423-bbd8-3f88cd93d9b3" acquired by "delete_volume" :: waited 0.023s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:34:32 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9811c3-d3b3-4c29-a021-0f4b63eba559]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:34:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4fc6e59c-1f4e-4c40-822b-341fbbdac4c2 tempest-ProjectReaderTests-1257901305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-251239c7-7bcc-4423-bbd8-3f88cd93d9b3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:34:32 devstack sudo[98640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-251239c7-7bcc-4423-bbd8-3f88cd93d9b3 Jul 11 04:34:32 devstack sudo[98640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:34:32 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root Jul 11 04:34:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3234ac35-0e72-4715-b73b-0dcbed6c1a76 tempest-VolumesActionsTest-1247525239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ffa86da4-c4e3-4c88-b83e-5d8f497bb815 1073741824" returned: 0 in 0.850s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:34:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3234ac35-0e72-4715-b73b-0dcbed6c1a76 tempest-VolumesActionsTest-1247525239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ffa86da4-c4e3-4c88-b83e-5d8f497bb815 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:34:32 devstack sudo[98645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ffa86da4-c4e3-4c88-b83e-5d8f497bb815 Jul 11 04:34:32 devstack sudo[98645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:34:33 devstack sudo[98640]: pam_unix(sudo:session): session closed for user root Jul 11 04:34:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4fc6e59c-1f4e-4c40-822b-341fbbdac4c2 tempest-ProjectReaderTests-1257901305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-251239c7-7bcc-4423-bbd8-3f88cd93d9b3" returned: 0 in 0.844s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:34:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4fc6e59c-1f4e-4c40-822b-341fbbdac4c2 tempest-ProjectReaderTests-1257901305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-251239c7-7bcc-4423-bbd8-3f88cd93d9b3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:34:33 devstack sudo[98650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-251239c7-7bcc-4423-bbd8-3f88cd93d9b3 Jul 11 04:34:33 devstack sudo[98650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:34:33 devstack sudo[98645]: pam_unix(sudo:session): session closed for user root Jul 11 04:34:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3234ac35-0e72-4715-b73b-0dcbed6c1a76 tempest-VolumesActionsTest-1247525239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ffa86da4-c4e3-4c88-b83e-5d8f497bb815" returned: 0 in 0.632s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:34:33 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-3234ac35-0e72-4715-b73b-0dcbed6c1a76 tempest-VolumesActionsTest-1247525239 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:34:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3234ac35-0e72-4715-b73b-0dcbed6c1a76 tempest-VolumesActionsTest-1247525239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:34:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-07ce6647-b3bf-444d-b8bd-22d20d9bdbf4 tempest-VolumesActionsTest-1672075969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.185s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:34:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3234ac35-0e72-4715-b73b-0dcbed6c1a76 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (410bf69d-635a-467f-96eb-fdf8ab5c613d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffa86da4-c4e3-4c88-b83e-5d8f497bb815', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:34:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3234ac35-0e72-4715-b73b-0dcbed6c1a76 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f94a6ae-5c7e-4302-9c92-a1a1ba39a93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:34:33 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d234be2-c277-4f69-807b-63d41fca0bcd]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:34:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-07ce6647-b3bf-444d-b8bd-22d20d9bdbf4 tempest-VolumesActionsTest-1672075969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:34:33 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-3234ac35-0e72-4715-b73b-0dcbed6c1a76 tempest-VolumesActionsTest-1247525239 None] Volume volume-ffa86da4-c4e3-4c88-b83e-5d8f497bb815 (ffa86da4-c4e3-4c88-b83e-5d8f497bb815): created successfully Jul 11 04:34:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3234ac35-0e72-4715-b73b-0dcbed6c1a76 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f94a6ae-5c7e-4302-9c92-a1a1ba39a93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:34:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3234ac35-0e72-4715-b73b-0dcbed6c1a76 tempest-VolumesActionsTest-1247525239 None] Flow 'volume_create_manager' (edf9aae9-7603-4a1c-88b6-10e23c0e5eb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:34:33 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-3234ac35-0e72-4715-b73b-0dcbed6c1a76 tempest-VolumesActionsTest-1247525239 None] Created volume successfully. Jul 11 04:34:33 devstack sudo[98653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c Jul 11 04:34:33 devstack sudo[98653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:34:34 devstack sudo[98650]: pam_unix(sudo:session): session closed for user root Jul 11 04:34:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4fc6e59c-1f4e-4c40-822b-341fbbdac4c2 tempest-ProjectReaderTests-1257901305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-251239c7-7bcc-4423-bbd8-3f88cd93d9b3" returned: 0 in 0.730s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:34:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4fc6e59c-1f4e-4c40-822b-341fbbdac4c2 tempest-ProjectReaderTests-1257901305 None] Lock "cinder-quobyte-251239c7-7bcc-4423-bbd8-3f88cd93d9b3" released by "delete_volume" :: held 1.623s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:34:34 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-4fc6e59c-1f4e-4c40-822b-341fbbdac4c2 tempest-ProjectReaderTests-1257901305 None] Created reservations ['ec023194-44a4-4255-b847-062f194df661', '0be7209b-9c25-4c13-a882-05a84a437a64', 'fbd30cf1-757b-4fba-a3f3-99677107e1db', '9466d1d6-cdf0-4761-aad3-6208f0d92828'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:34:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4fc6e59c-1f4e-4c40-822b-341fbbdac4c2 tempest-ProjectReaderTests-1257901305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:34:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4fc6e59c-1f4e-4c40-822b-341fbbdac4c2 tempest-ProjectReaderTests-1257901305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:34:34 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4fc6e59c-1f4e-4c40-822b-341fbbdac4c2 tempest-ProjectReaderTests-1257901305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:34:34 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4fc6e59c-1f4e-4c40-822b-341fbbdac4c2 tempest-ProjectReaderTests-1257901305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:34:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4fc6e59c-1f4e-4c40-822b-341fbbdac4c2 tempest-ProjectReaderTests-1257901305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:34:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4fc6e59c-1f4e-4c40-822b-341fbbdac4c2 tempest-ProjectReaderTests-1257901305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:34:34 devstack sudo[98659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:34:34 devstack sudo[98659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:34:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e5a51df6-c61c-4194-a655-f6392c443a55 tempest-VolumesActionsTest-560347811 None] Acquiring lock "cinder-ffa86da4-c4e3-4c88-b83e-5d8f497bb815-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:34:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e5a51df6-c61c-4194-a655-f6392c443a55 tempest-VolumesActionsTest-560347811 None] Lock "cinder-ffa86da4-c4e3-4c88-b83e-5d8f497bb815-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:34:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e5a51df6-c61c-4194-a655-f6392c443a55 tempest-VolumesActionsTest-560347811 None] Acquiring lock "cinder-quobyte-ffa86da4-c4e3-4c88-b83e-5d8f497bb815" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:34:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e5a51df6-c61c-4194-a655-f6392c443a55 tempest-VolumesActionsTest-560347811 None] Lock "cinder-quobyte-ffa86da4-c4e3-4c88-b83e-5d8f497bb815" acquired by "delete_volume" :: waited 0.015s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:34:34 devstack sudo[98653]: pam_unix(sudo:session): session closed for user root Jul 11 04:34:34 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16e2fed-552b-48c8-a211-abd5ddd5f472]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:34:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e5a51df6-c61c-4194-a655-f6392c443a55 tempest-VolumesActionsTest-560347811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ffa86da4-c4e3-4c88-b83e-5d8f497bb815 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:34:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-07ce6647-b3bf-444d-b8bd-22d20d9bdbf4 tempest-VolumesActionsTest-1672075969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c" returned: 0 in 0.880s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:34:34 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7019849-ef43-4bef-8883-add92bab8b2b]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:34:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-07ce6647-b3bf-444d-b8bd-22d20d9bdbf4 tempest-VolumesActionsTest-1672075969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:34:34 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ffa86da4-c4e3-4c88-b83e-5d8f497bb815 Jul 11 04:34:34 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:34:34 devstack sudo[98663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c Jul 11 04:34:34 devstack sudo[98663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:34:35 devstack sudo[98659]: pam_unix(sudo:session): session closed for user root Jul 11 04:34:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4fc6e59c-1f4e-4c40-822b-341fbbdac4c2 tempest-ProjectReaderTests-1257901305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.880s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:34:35 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-4fc6e59c-1f4e-4c40-822b-341fbbdac4c2 tempest-ProjectReaderTests-1257901305 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:34:35 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-4fc6e59c-1f4e-4c40-822b-341fbbdac4c2 tempest-ProjectReaderTests-1257901305 None] Deleted volume successfully. Jul 11 04:34:35 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-df06a85b-426f-4bbc-a920-abae07fba9bd tempest-ProjectReaderTests-1257901305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:34:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-df06a85b-426f-4bbc-a920-abae07fba9bd tempest-ProjectReaderTests-1257901305 None] Flow 'volume_create_manager' (4806211b-43f5-4f53-a1b9-b2c329824939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:34:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-df06a85b-426f-4bbc-a920-abae07fba9bd tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87990270-f8cd-411b-9d0c-8db6941832a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:34:35 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4fc6e59c-1f4e-4c40-822b-341fbbdac4c2 tempest-ProjectReaderTests-1257901305 None] Lock "cinder-251239c7-7bcc-4423-bbd8-3f88cd93d9b3-delete_volume" released by "delete_volume" :: held 2.827s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:34:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-df06a85b-426f-4bbc-a920-abae07fba9bd tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87990270-f8cd-411b-9d0c-8db6941832a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1547181933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83e26885-6ee3-40f0-9f73-1c36a9ffb613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ad838d72f4544ce9b5b6f16e9c50f39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:34:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:34:35Z,use_quota=True,user_id='a34d05aeaa8c4abc8cacb89ab3f39e1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:34:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-df06a85b-426f-4bbc-a920-abae07fba9bd tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0f21e67-904e-4e0d-b350-69f5a189efd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:34:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-df06a85b-426f-4bbc-a920-abae07fba9bd tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0f21e67-904e-4e0d-b350-69f5a189efd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:34:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-df06a85b-426f-4bbc-a920-abae07fba9bd tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (401367d8-9546-463b-ba6a-681e93468467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:34:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-df06a85b-426f-4bbc-a920-abae07fba9bd tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (401367d8-9546-463b-ba6a-681e93468467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83e26885-6ee3-40f0-9f73-1c36a9ffb613', 'volume_name': 'volume-83e26885-6ee3-40f0-9f73-1c36a9ffb613', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:34:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-df06a85b-426f-4bbc-a920-abae07fba9bd tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1a4800b-41cc-4631-993d-13b3b6136faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:34:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-df06a85b-426f-4bbc-a920-abae07fba9bd tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1a4800b-41cc-4631-993d-13b3b6136faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:34:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-df06a85b-426f-4bbc-a920-abae07fba9bd tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9332fc1-bb83-426b-a4a9-b31dd1f00ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:34:35 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-df06a85b-426f-4bbc-a920-abae07fba9bd tempest-ProjectReaderTests-1257901305 None] Volume 83e26885-6ee3-40f0-9f73-1c36a9ffb613: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83e26885-6ee3-40f0-9f73-1c36a9ffb613', 'volume_size': 1} Jul 11 04:34:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-df06a85b-426f-4bbc-a920-abae07fba9bd tempest-ProjectReaderTests-1257901305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:34:35 devstack sudo[98663]: pam_unix(sudo:session): session closed for user root Jul 11 04:34:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-07ce6647-b3bf-444d-b8bd-22d20d9bdbf4 tempest-VolumesActionsTest-1672075969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c" returned: 0 in 0.867s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:34:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-07ce6647-b3bf-444d-b8bd-22d20d9bdbf4 tempest-VolumesActionsTest-1672075969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c /opt/stack/data/cinder/conversion/c26d4c8f-0a69-45b0-83db-1bee00a0307c.temp_image.ded589a7-b06e-4bfd-840d-aea724fb50770ak43p55.img {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:34:35 devstack sudo[98673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c /opt/stack/data/cinder/conversion/c26d4c8f-0a69-45b0-83db-1bee00a0307c.temp_image.ded589a7-b06e-4bfd-840d-aea724fb50770ak43p55.img Jul 11 04:34:35 devstack sudo[98673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:34:35 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Jul 11 04:34:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e5a51df6-c61c-4194-a655-f6392c443a55 tempest-VolumesActionsTest-560347811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ffa86da4-c4e3-4c88-b83e-5d8f497bb815" returned: 0 in 0.983s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:34:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e5a51df6-c61c-4194-a655-f6392c443a55 tempest-VolumesActionsTest-560347811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ffa86da4-c4e3-4c88-b83e-5d8f497bb815 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:34:35 devstack sudo[98675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ffa86da4-c4e3-4c88-b83e-5d8f497bb815 Jul 11 04:34:35 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:34:36 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root Jul 11 04:34:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e5a51df6-c61c-4194-a655-f6392c443a55 tempest-VolumesActionsTest-560347811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ffa86da4-c4e3-4c88-b83e-5d8f497bb815" returned: 0 in 0.747s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:34:36 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e5a51df6-c61c-4194-a655-f6392c443a55 tempest-VolumesActionsTest-560347811 None] Lock "cinder-quobyte-ffa86da4-c4e3-4c88-b83e-5d8f497bb815" released by "delete_volume" :: held 1.794s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:34:36 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-e5a51df6-c61c-4194-a655-f6392c443a55 tempest-VolumesActionsTest-560347811 None] Created reservations ['8c58cab0-0024-4891-95ec-5019e1de90ee', '75dce5ca-b06e-45a9-9fc7-148841a394e2', 'e39f50f5-1d54-4065-9f65-c41b733340e2', '54a46455-29f6-4e0e-94b6-419159500a37'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:34:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e5a51df6-c61c-4194-a655-f6392c443a55 tempest-VolumesActionsTest-560347811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:34:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e5a51df6-c61c-4194-a655-f6392c443a55 tempest-VolumesActionsTest-560347811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:34:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e5a51df6-c61c-4194-a655-f6392c443a55 tempest-VolumesActionsTest-560347811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:34:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e5a51df6-c61c-4194-a655-f6392c443a55 tempest-VolumesActionsTest-560347811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:34:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e5a51df6-c61c-4194-a655-f6392c443a55 tempest-VolumesActionsTest-560347811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:34:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e5a51df6-c61c-4194-a655-f6392c443a55 tempest-VolumesActionsTest-560347811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:34:36 devstack sudo[98691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:34:36 devstack sudo[98691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:34:38 devstack sudo[98691]: pam_unix(sudo:session): session closed for user root Jul 11 04:34:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e5a51df6-c61c-4194-a655-f6392c443a55 tempest-VolumesActionsTest-560347811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 1.808s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:34:38 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-e5a51df6-c61c-4194-a655-f6392c443a55 tempest-VolumesActionsTest-560347811 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:34:38 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-e5a51df6-c61c-4194-a655-f6392c443a55 tempest-VolumesActionsTest-560347811 None] Deleted volume successfully. Jul 11 04:34:38 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e5a51df6-c61c-4194-a655-f6392c443a55 tempest-VolumesActionsTest-560347811 None] Lock "cinder-ffa86da4-c4e3-4c88-b83e-5d8f497bb815-delete_volume" released by "delete_volume" :: held 4.108s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:34:38 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-375d932a-df09-450a-9567-dff37f767afb tempest-VolumesActionsTest-1247525239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:34:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-375d932a-df09-450a-9567-dff37f767afb tempest-VolumesActionsTest-1247525239 None] Flow 'volume_create_manager' (953f464b-a9c8-4946-80f9-eb085c342505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:34:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-375d932a-df09-450a-9567-dff37f767afb tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (496164e0-3338-40c5-b0c9-d7750286348a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:34:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-375d932a-df09-450a-9567-dff37f767afb tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (496164e0-3338-40c5-b0c9-d7750286348a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-10747901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e8c577b-fe7b-4a40-939c-18dcd064590e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c69db80db0a34d178f41b637c7919206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:34:38Z,use_quota=True,user_id='375b256be71241e1883629ee3579bc71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:34:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-375d932a-df09-450a-9567-dff37f767afb tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a899af2b-c663-430c-95d3-c5d66afc175f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:34:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-375d932a-df09-450a-9567-dff37f767afb tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a899af2b-c663-430c-95d3-c5d66afc175f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:34:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-375d932a-df09-450a-9567-dff37f767afb tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb29895-033d-43e9-abf3-a333787df48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:34:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-375d932a-df09-450a-9567-dff37f767afb tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb29895-033d-43e9-abf3-a333787df48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e8c577b-fe7b-4a40-939c-18dcd064590e', 'volume_name': 'volume-5e8c577b-fe7b-4a40-939c-18dcd064590e', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:34:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-375d932a-df09-450a-9567-dff37f767afb tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78b00360-5aee-4f7d-a708-debe430df422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:34:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-375d932a-df09-450a-9567-dff37f767afb tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78b00360-5aee-4f7d-a708-debe430df422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:34:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-375d932a-df09-450a-9567-dff37f767afb tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c082e52-a357-4512-bc0b-2bdfc10f3896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:34:38 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-375d932a-df09-450a-9567-dff37f767afb tempest-VolumesActionsTest-1247525239 None] Volume 5e8c577b-fe7b-4a40-939c-18dcd064590e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e8c577b-fe7b-4a40-939c-18dcd064590e', 'volume_size': 1} Jul 11 04:34:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-375d932a-df09-450a-9567-dff37f767afb tempest-VolumesActionsTest-1247525239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:34:41 devstack sudo[98673]: pam_unix(sudo:session): session closed for user root Jul 11 04:34:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-07ce6647-b3bf-444d-b8bd-22d20d9bdbf4 tempest-VolumesActionsTest-1672075969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c /opt/stack/data/cinder/conversion/c26d4c8f-0a69-45b0-83db-1bee00a0307c.temp_image.ded589a7-b06e-4bfd-840d-aea724fb50770ak43p55.img" returned: 0 in 6.147s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:34:41 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa7a002-a08e-4912-b4f5-5fb80b01cf09]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:34:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-07ce6647-b3bf-444d-b8bd-22d20d9bdbf4 tempest-VolumesActionsTest-1672075969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:34:41 devstack sudo[98711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c Jul 11 04:34:41 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:34:42 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root Jul 11 04:34:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-07ce6647-b3bf-444d-b8bd-22d20d9bdbf4 tempest-VolumesActionsTest-1672075969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c" returned: 0 in 0.978s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:34:42 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-07ce6647-b3bf-444d-b8bd-22d20d9bdbf4 tempest-VolumesActionsTest-1672075969 None] Image conversion details: src /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c, size 1024.00 MB, duration 6.15 sec, destination /opt/stack/data/cinder/conversion/c26d4c8f-0a69-45b0-83db-1bee00a0307c.temp_image.ded589a7-b06e-4bfd-840d-aea724fb50770ak43p55.img {{(pid=86964) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 04:34:42 devstack cinder-volume[86964]: INFO cinder.image.image_utils [None req-07ce6647-b3bf-444d-b8bd-22d20d9bdbf4 tempest-VolumesActionsTest-1672075969 None] Converted 1024.00 MB image at 166.57 MB/s Jul 11 04:34:42 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-07ce6647-b3bf-444d-b8bd-22d20d9bdbf4 tempest-VolumesActionsTest-1672075969 None] ded589a7-b06e-4bfd-840d-aea724fb5077 was raw, no need to convert to raw {{(pid=86964) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 11 04:34:48 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=20,cinder:INSERT=8,cinder:UPDATE=32,cinder:DELETE=2 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:34:52 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=24,cinder:INSERT=6,cinder:UPDATE=29,cinder:DELETE=3 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:34:59 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:34:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:34:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:34:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:34:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:34:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:34:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:34:59 devstack sudo[98790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:34:59 devstack sudo[98790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:00 devstack sudo[98790]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.873s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:00 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:35:00 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager._thread_info {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:35:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread count: 28 {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:35:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread info: [<_MainThread(MainThread, started 124675027595392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:35:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-07ce6647-b3bf-444d-b8bd-22d20d9bdbf4 tempest-VolumesActionsTest-1672075969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.730s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:35:03 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-07ce6647-b3bf-444d-b8bd-22d20d9bdbf4 tempest-VolumesActionsTest-1672075969 None] Uploaded volume to glance image-id: ded589a7-b06e-4bfd-840d-aea724fb5077. {{(pid=86964) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 11 04:35:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-df06a85b-426f-4bbc-a920-abae07fba9bd tempest-ProjectReaderTests-1257901305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:35:03 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-df06a85b-426f-4bbc-a920-abae07fba9bd tempest-ProjectReaderTests-1257901305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1547181933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83e26885-6ee3-40f0-9f73-1c36a9ffb613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ad838d72f4544ce9b5b6f16e9c50f39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:34:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:34:35Z,use_quota=True,user_id='a34d05aeaa8c4abc8cacb89ab3f39e1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:35:03 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-df06a85b-426f-4bbc-a920-abae07fba9bd tempest-ProjectReaderTests-1257901305 None] Creating volume 83e26885-6ee3-40f0-9f73-1c36a9ffb613 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:35:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-df06a85b-426f-4bbc-a920-abae07fba9bd tempest-ProjectReaderTests-1257901305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:35:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-df06a85b-426f-4bbc-a920-abae07fba9bd tempest-ProjectReaderTests-1257901305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:35:03 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-df06a85b-426f-4bbc-a920-abae07fba9bd tempest-ProjectReaderTests-1257901305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:35:03 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-df06a85b-426f-4bbc-a920-abae07fba9bd tempest-ProjectReaderTests-1257901305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:35:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-df06a85b-426f-4bbc-a920-abae07fba9bd tempest-ProjectReaderTests-1257901305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:35:03 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-df06a85b-426f-4bbc-a920-abae07fba9bd tempest-ProjectReaderTests-1257901305 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:35:03 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-df06a85b-426f-4bbc-a920-abae07fba9bd tempest-ProjectReaderTests-1257901305 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:35:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-df06a85b-426f-4bbc-a920-abae07fba9bd tempest-ProjectReaderTests-1257901305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-83e26885-6ee3-40f0-9f73-1c36a9ffb613 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:03 devstack sudo[98843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-83e26885-6ee3-40f0-9f73-1c36a9ffb613 1073741824 Jul 11 04:35:03 devstack sudo[98843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:03 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-07ce6647-b3bf-444d-b8bd-22d20d9bdbf4 tempest-VolumesActionsTest-1672075969 None] Copy volume to image completed successfully. Jul 11 04:35:04 devstack sudo[98843]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-df06a85b-426f-4bbc-a920-abae07fba9bd tempest-ProjectReaderTests-1257901305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-83e26885-6ee3-40f0-9f73-1c36a9ffb613 1073741824" returned: 0 in 0.807s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-df06a85b-426f-4bbc-a920-abae07fba9bd tempest-ProjectReaderTests-1257901305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-83e26885-6ee3-40f0-9f73-1c36a9ffb613 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:04 devstack sudo[98851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-83e26885-6ee3-40f0-9f73-1c36a9ffb613 Jul 11 04:35:04 devstack sudo[98851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:04 devstack sudo[98851]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-df06a85b-426f-4bbc-a920-abae07fba9bd tempest-ProjectReaderTests-1257901305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-83e26885-6ee3-40f0-9f73-1c36a9ffb613" returned: 0 in 0.665s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:04 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-df06a85b-426f-4bbc-a920-abae07fba9bd tempest-ProjectReaderTests-1257901305 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:35:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-df06a85b-426f-4bbc-a920-abae07fba9bd tempest-ProjectReaderTests-1257901305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:35:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-375d932a-df09-450a-9567-dff37f767afb tempest-VolumesActionsTest-1247525239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.843s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:35:04 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-375d932a-df09-450a-9567-dff37f767afb tempest-VolumesActionsTest-1247525239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-10747901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e8c577b-fe7b-4a40-939c-18dcd064590e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c69db80db0a34d178f41b637c7919206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:34:38Z,use_quota=True,user_id='375b256be71241e1883629ee3579bc71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:35:04 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-375d932a-df09-450a-9567-dff37f767afb tempest-VolumesActionsTest-1247525239 None] Creating volume 5e8c577b-fe7b-4a40-939c-18dcd064590e {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:35:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-375d932a-df09-450a-9567-dff37f767afb tempest-VolumesActionsTest-1247525239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:35:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-375d932a-df09-450a-9567-dff37f767afb tempest-VolumesActionsTest-1247525239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:35:04 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-375d932a-df09-450a-9567-dff37f767afb tempest-VolumesActionsTest-1247525239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:35:04 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-375d932a-df09-450a-9567-dff37f767afb tempest-VolumesActionsTest-1247525239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:35:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-375d932a-df09-450a-9567-dff37f767afb tempest-VolumesActionsTest-1247525239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:35:04 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-375d932a-df09-450a-9567-dff37f767afb tempest-VolumesActionsTest-1247525239 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:35:04 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-375d932a-df09-450a-9567-dff37f767afb tempest-VolumesActionsTest-1247525239 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:35:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-375d932a-df09-450a-9567-dff37f767afb tempest-VolumesActionsTest-1247525239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5e8c577b-fe7b-4a40-939c-18dcd064590e 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:04 devstack sudo[98854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5e8c577b-fe7b-4a40-939c-18dcd064590e 1073741824 Jul 11 04:35:04 devstack sudo[98854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:04 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-df06a85b-426f-4bbc-a920-abae07fba9bd tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9332fc1-bb83-426b-a4a9-b31dd1f00ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83e26885-6ee3-40f0-9f73-1c36a9ffb613', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:04 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-df06a85b-426f-4bbc-a920-abae07fba9bd tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (598b272c-5373-4f2d-80af-4b6b2a0af798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:04 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-df06a85b-426f-4bbc-a920-abae07fba9bd tempest-ProjectReaderTests-1257901305 None] Volume volume-83e26885-6ee3-40f0-9f73-1c36a9ffb613 (83e26885-6ee3-40f0-9f73-1c36a9ffb613): created successfully Jul 11 04:35:04 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-df06a85b-426f-4bbc-a920-abae07fba9bd tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (598b272c-5373-4f2d-80af-4b6b2a0af798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:04 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-df06a85b-426f-4bbc-a920-abae07fba9bd tempest-ProjectReaderTests-1257901305 None] Flow 'volume_create_manager' (4806211b-43f5-4f53-a1b9-b2c329824939) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:35:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e96bf139-1691-427f-8b2a-3e1df0522516 tempest-VolumesActionsTest-1672075969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:35:04 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-df06a85b-426f-4bbc-a920-abae07fba9bd tempest-ProjectReaderTests-1257901305 None] Created volume successfully. Jul 11 04:35:05 devstack sudo[98854]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-375d932a-df09-450a-9567-dff37f767afb tempest-VolumesActionsTest-1247525239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5e8c577b-fe7b-4a40-939c-18dcd064590e 1073741824" returned: 0 in 0.859s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-375d932a-df09-450a-9567-dff37f767afb tempest-VolumesActionsTest-1247525239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5e8c577b-fe7b-4a40-939c-18dcd064590e {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:05 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fb888493-96a0-4873-95fe-9749be0bb94f tempest-ProjectReaderTests-1257901305 None] Acquiring lock "cinder-83e26885-6ee3-40f0-9f73-1c36a9ffb613-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:35:05 devstack sudo[98861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5e8c577b-fe7b-4a40-939c-18dcd064590e Jul 11 04:35:05 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fb888493-96a0-4873-95fe-9749be0bb94f tempest-ProjectReaderTests-1257901305 None] Lock "cinder-83e26885-6ee3-40f0-9f73-1c36a9ffb613-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:35:05 devstack sudo[98861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:05 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fb888493-96a0-4873-95fe-9749be0bb94f tempest-ProjectReaderTests-1257901305 None] Acquiring lock "cinder-quobyte-83e26885-6ee3-40f0-9f73-1c36a9ffb613" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:35:05 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fb888493-96a0-4873-95fe-9749be0bb94f tempest-ProjectReaderTests-1257901305 None] Lock "cinder-quobyte-83e26885-6ee3-40f0-9f73-1c36a9ffb613" acquired by "delete_volume" :: waited 0.014s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:35:05 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[be83c3f8-fe11-475f-9ee0-5ef32f3633a5]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:35:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb888493-96a0-4873-95fe-9749be0bb94f tempest-ProjectReaderTests-1257901305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-83e26885-6ee3-40f0-9f73-1c36a9ffb613 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:05 devstack sudo[98863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-83e26885-6ee3-40f0-9f73-1c36a9ffb613 Jul 11 04:35:05 devstack sudo[98863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:06 devstack sudo[98861]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-375d932a-df09-450a-9567-dff37f767afb tempest-VolumesActionsTest-1247525239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5e8c577b-fe7b-4a40-939c-18dcd064590e" returned: 0 in 0.665s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-375d932a-df09-450a-9567-dff37f767afb tempest-VolumesActionsTest-1247525239 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:35:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-375d932a-df09-450a-9567-dff37f767afb tempest-VolumesActionsTest-1247525239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:35:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e96bf139-1691-427f-8b2a-3e1df0522516 tempest-VolumesActionsTest-1672075969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.488s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:35:06 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-375d932a-df09-450a-9567-dff37f767afb tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c082e52-a357-4512-bc0b-2bdfc10f3896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e8c577b-fe7b-4a40-939c-18dcd064590e', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:06 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-375d932a-df09-450a-9567-dff37f767afb tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (305c3ba5-6805-49f7-b050-c5f615aa29f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:06 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[1697f5ce-f961-469d-9c1d-ffd2db1981e4]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:35:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e96bf139-1691-427f-8b2a-3e1df0522516 tempest-VolumesActionsTest-1672075969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:06 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-375d932a-df09-450a-9567-dff37f767afb tempest-VolumesActionsTest-1247525239 None] Volume volume-5e8c577b-fe7b-4a40-939c-18dcd064590e (5e8c577b-fe7b-4a40-939c-18dcd064590e): created successfully Jul 11 04:35:06 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-375d932a-df09-450a-9567-dff37f767afb tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (305c3ba5-6805-49f7-b050-c5f615aa29f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:06 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-375d932a-df09-450a-9567-dff37f767afb tempest-VolumesActionsTest-1247525239 None] Flow 'volume_create_manager' (953f464b-a9c8-4946-80f9-eb085c342505) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:35:06 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-375d932a-df09-450a-9567-dff37f767afb tempest-VolumesActionsTest-1247525239 None] Created volume successfully. Jul 11 04:35:06 devstack sudo[98866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c Jul 11 04:35:06 devstack sudo[98866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:06 devstack sudo[98863]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb888493-96a0-4873-95fe-9749be0bb94f tempest-ProjectReaderTests-1257901305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-83e26885-6ee3-40f0-9f73-1c36a9ffb613" returned: 0 in 0.768s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb888493-96a0-4873-95fe-9749be0bb94f tempest-ProjectReaderTests-1257901305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-83e26885-6ee3-40f0-9f73-1c36a9ffb613 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:06 devstack sudo[98873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-83e26885-6ee3-40f0-9f73-1c36a9ffb613 Jul 11 04:35:06 devstack sudo[98873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:07 devstack sudo[98866]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e96bf139-1691-427f-8b2a-3e1df0522516 tempest-VolumesActionsTest-1672075969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c" returned: 0 in 0.754s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:07 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e60d544-ef40-450f-bec9-19bf9da1a3c9]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:35:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e96bf139-1691-427f-8b2a-3e1df0522516 tempest-VolumesActionsTest-1672075969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:07 devstack sudo[98873]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb888493-96a0-4873-95fe-9749be0bb94f tempest-ProjectReaderTests-1257901305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-83e26885-6ee3-40f0-9f73-1c36a9ffb613" returned: 0 in 0.643s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:07 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fb888493-96a0-4873-95fe-9749be0bb94f tempest-ProjectReaderTests-1257901305 None] Lock "cinder-quobyte-83e26885-6ee3-40f0-9f73-1c36a9ffb613" released by "delete_volume" :: held 1.458s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:35:07 devstack sudo[98885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c Jul 11 04:35:07 devstack sudo[98885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:07 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-fb888493-96a0-4873-95fe-9749be0bb94f tempest-ProjectReaderTests-1257901305 None] Created reservations ['40763735-f3bb-4d4d-b2fe-1faa5373a0ec', '8cbc3de9-462b-4bfa-8049-3daad6ac5871', '07dfc3ac-026e-47b7-8a4a-7ff0b92d756d', 'bff4662b-68d3-4b27-87f5-c251e526ebb7'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:35:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fb888493-96a0-4873-95fe-9749be0bb94f tempest-ProjectReaderTests-1257901305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:35:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fb888493-96a0-4873-95fe-9749be0bb94f tempest-ProjectReaderTests-1257901305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:35:07 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-fb888493-96a0-4873-95fe-9749be0bb94f tempest-ProjectReaderTests-1257901305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:35:07 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-fb888493-96a0-4873-95fe-9749be0bb94f tempest-ProjectReaderTests-1257901305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:35:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fb888493-96a0-4873-95fe-9749be0bb94f tempest-ProjectReaderTests-1257901305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:35:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb888493-96a0-4873-95fe-9749be0bb94f tempest-ProjectReaderTests-1257901305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:07 devstack sudo[98887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:35:07 devstack sudo[98887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:08 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1383cd55-ebf2-4f72-9ec3-86db5f223e1a tempest-VolumesActionsTest-560347811 None] Acquiring lock "cinder-5e8c577b-fe7b-4a40-939c-18dcd064590e-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:35:08 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1383cd55-ebf2-4f72-9ec3-86db5f223e1a tempest-VolumesActionsTest-560347811 None] Lock "cinder-5e8c577b-fe7b-4a40-939c-18dcd064590e-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:35:08 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1383cd55-ebf2-4f72-9ec3-86db5f223e1a tempest-VolumesActionsTest-560347811 None] Acquiring lock "cinder-quobyte-5e8c577b-fe7b-4a40-939c-18dcd064590e" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:35:08 devstack sudo[98887]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:08 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1383cd55-ebf2-4f72-9ec3-86db5f223e1a tempest-VolumesActionsTest-560347811 None] Lock "cinder-quobyte-5e8c577b-fe7b-4a40-939c-18dcd064590e" acquired by "delete_volume" :: waited 0.019s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:35:08 devstack sudo[98885]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb888493-96a0-4873-95fe-9749be0bb94f tempest-ProjectReaderTests-1257901305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 1.005s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:08 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-fb888493-96a0-4873-95fe-9749be0bb94f tempest-ProjectReaderTests-1257901305 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:35:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e96bf139-1691-427f-8b2a-3e1df0522516 tempest-VolumesActionsTest-1672075969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c" returned: 0 in 1.253s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e96bf139-1691-427f-8b2a-3e1df0522516 tempest-VolumesActionsTest-1672075969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c /opt/stack/data/cinder/conversion/c26d4c8f-0a69-45b0-83db-1bee00a0307c.temp_image.0969f9c6-f35b-441b-8907-4d7302b5ccf2m6v6gvbh.img {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:08 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-fb888493-96a0-4873-95fe-9749be0bb94f tempest-ProjectReaderTests-1257901305 None] Deleted volume successfully. Jul 11 04:35:08 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f3c798-8d6b-4792-b3bc-b1cf0c51705f]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:35:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1383cd55-ebf2-4f72-9ec3-86db5f223e1a tempest-VolumesActionsTest-560347811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5e8c577b-fe7b-4a40-939c-18dcd064590e {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:08 devstack sudo[98893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c /opt/stack/data/cinder/conversion/c26d4c8f-0a69-45b0-83db-1bee00a0307c.temp_image.0969f9c6-f35b-441b-8907-4d7302b5ccf2m6v6gvbh.img Jul 11 04:35:08 devstack sudo[98893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:08 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fb888493-96a0-4873-95fe-9749be0bb94f tempest-ProjectReaderTests-1257901305 None] Lock "cinder-83e26885-6ee3-40f0-9f73-1c36a9ffb613-delete_volume" released by "delete_volume" :: held 2.788s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:35:08 devstack sudo[98895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5e8c577b-fe7b-4a40-939c-18dcd064590e Jul 11 04:35:08 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:08 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-88435ef6-b55a-4f53-933d-3230050e3cea tempest-ProjectReaderTests-1257901305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:35:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-88435ef6-b55a-4f53-933d-3230050e3cea tempest-ProjectReaderTests-1257901305 None] Flow 'volume_create_manager' (d8cb27da-7be9-4f74-b494-db959e174401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:35:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-88435ef6-b55a-4f53-933d-3230050e3cea tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afaa9b1b-9a30-413a-8d08-9eccbdf72331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-88435ef6-b55a-4f53-933d-3230050e3cea tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afaa9b1b-9a30-413a-8d08-9eccbdf72331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:35:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-15895469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5179ac14-b033-4930-95cf-13c91490248a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ad838d72f4544ce9b5b6f16e9c50f39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:35:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:35:09Z,use_quota=True,user_id='a34d05aeaa8c4abc8cacb89ab3f39e1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-88435ef6-b55a-4f53-933d-3230050e3cea tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beda259b-6360-4af6-9f75-638b0deb3e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-88435ef6-b55a-4f53-933d-3230050e3cea tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beda259b-6360-4af6-9f75-638b0deb3e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-88435ef6-b55a-4f53-933d-3230050e3cea tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0decf758-04e5-4102-9e94-3d52e7143856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-88435ef6-b55a-4f53-933d-3230050e3cea tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0decf758-04e5-4102-9e94-3d52e7143856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5179ac14-b033-4930-95cf-13c91490248a', 'volume_name': 'volume-5179ac14-b033-4930-95cf-13c91490248a', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-88435ef6-b55a-4f53-933d-3230050e3cea tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f1370ea-8fe4-4016-bd68-3f8da9b00bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-88435ef6-b55a-4f53-933d-3230050e3cea tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f1370ea-8fe4-4016-bd68-3f8da9b00bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-88435ef6-b55a-4f53-933d-3230050e3cea tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28a9466-b13d-4c7b-9d93-09674af650ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:08 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-88435ef6-b55a-4f53-933d-3230050e3cea tempest-ProjectReaderTests-1257901305 None] Volume 5179ac14-b033-4930-95cf-13c91490248a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5179ac14-b033-4930-95cf-13c91490248a', 'volume_size': 1} Jul 11 04:35:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-88435ef6-b55a-4f53-933d-3230050e3cea tempest-ProjectReaderTests-1257901305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:35:09 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1383cd55-ebf2-4f72-9ec3-86db5f223e1a tempest-VolumesActionsTest-560347811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5e8c577b-fe7b-4a40-939c-18dcd064590e" returned: 0 in 1.518s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1383cd55-ebf2-4f72-9ec3-86db5f223e1a tempest-VolumesActionsTest-560347811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5e8c577b-fe7b-4a40-939c-18dcd064590e {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:09 devstack sudo[98910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5e8c577b-fe7b-4a40-939c-18dcd064590e Jul 11 04:35:09 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:11 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1383cd55-ebf2-4f72-9ec3-86db5f223e1a tempest-VolumesActionsTest-560347811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5e8c577b-fe7b-4a40-939c-18dcd064590e" returned: 0 in 1.658s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:11 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1383cd55-ebf2-4f72-9ec3-86db5f223e1a tempest-VolumesActionsTest-560347811 None] Lock "cinder-quobyte-5e8c577b-fe7b-4a40-939c-18dcd064590e" released by "delete_volume" :: held 3.282s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:35:11 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-1383cd55-ebf2-4f72-9ec3-86db5f223e1a tempest-VolumesActionsTest-560347811 None] Created reservations ['1ef7d9bb-7c77-4359-be10-2bfbfe38b3ed', '660ef8c7-b02a-4598-bff9-cf53cef15bd4', '855ee288-b108-4f1d-832d-7c4ef16e2d0d', '824803e4-1130-41a3-84ef-2281b2de465a'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:35:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1383cd55-ebf2-4f72-9ec3-86db5f223e1a tempest-VolumesActionsTest-560347811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:35:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1383cd55-ebf2-4f72-9ec3-86db5f223e1a tempest-VolumesActionsTest-560347811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:35:11 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-1383cd55-ebf2-4f72-9ec3-86db5f223e1a tempest-VolumesActionsTest-560347811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:35:11 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-1383cd55-ebf2-4f72-9ec3-86db5f223e1a tempest-VolumesActionsTest-560347811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:35:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1383cd55-ebf2-4f72-9ec3-86db5f223e1a tempest-VolumesActionsTest-560347811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:35:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1383cd55-ebf2-4f72-9ec3-86db5f223e1a tempest-VolumesActionsTest-560347811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:12 devstack sudo[98916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:35:12 devstack sudo[98916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:12 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-52054870-81cd-4c16-a183-fef3e6895dfb tempest-AttachVolumeNegativeTest-930293942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:35:12 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-52054870-81cd-4c16-a183-fef3e6895dfb tempest-AttachVolumeNegativeTest-930293942 None] Flow 'volume_create_manager' (e525fb35-caba-4cc2-91ac-c9b69113bdfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:35:12 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-52054870-81cd-4c16-a183-fef3e6895dfb tempest-AttachVolumeNegativeTest-930293942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (048ce014-94c3-4f44-bd92-f66376408872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:12 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-52054870-81cd-4c16-a183-fef3e6895dfb tempest-AttachVolumeNegativeTest-930293942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (048ce014-94c3-4f44-bd92-f66376408872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-645180215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=591043ca-dd77-4202-bf10-2e61ee35dc7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44e231901653417dbcb1950f52b0f087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:35:12Z,use_quota=True,user_id='8a13d9d5816e46b2a784648c5f438e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:12 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-52054870-81cd-4c16-a183-fef3e6895dfb tempest-AttachVolumeNegativeTest-930293942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc3d512b-3ccd-48cc-adf8-a03af4432980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:12 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-52054870-81cd-4c16-a183-fef3e6895dfb tempest-AttachVolumeNegativeTest-930293942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc3d512b-3ccd-48cc-adf8-a03af4432980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:12 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-52054870-81cd-4c16-a183-fef3e6895dfb tempest-AttachVolumeNegativeTest-930293942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e8d8663-d23f-403d-bc0a-241af88c6f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:12 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-52054870-81cd-4c16-a183-fef3e6895dfb tempest-AttachVolumeNegativeTest-930293942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e8d8663-d23f-403d-bc0a-241af88c6f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '591043ca-dd77-4202-bf10-2e61ee35dc7b', 'volume_name': 'volume-591043ca-dd77-4202-bf10-2e61ee35dc7b', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:12 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-52054870-81cd-4c16-a183-fef3e6895dfb tempest-AttachVolumeNegativeTest-930293942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b09be8ad-760b-46e9-8025-6a40eb3d89d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:12 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-52054870-81cd-4c16-a183-fef3e6895dfb tempest-AttachVolumeNegativeTest-930293942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b09be8ad-760b-46e9-8025-6a40eb3d89d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:12 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-52054870-81cd-4c16-a183-fef3e6895dfb tempest-AttachVolumeNegativeTest-930293942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (392457fb-9297-453a-a1f5-2986e71be7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:12 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-52054870-81cd-4c16-a183-fef3e6895dfb tempest-AttachVolumeNegativeTest-930293942 None] Volume 591043ca-dd77-4202-bf10-2e61ee35dc7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-591043ca-dd77-4202-bf10-2e61ee35dc7b', 'volume_size': 1} Jul 11 04:35:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-52054870-81cd-4c16-a183-fef3e6895dfb tempest-AttachVolumeNegativeTest-930293942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:35:13 devstack sudo[98916]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1383cd55-ebf2-4f72-9ec3-86db5f223e1a tempest-VolumesActionsTest-560347811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 1.756s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:13 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-1383cd55-ebf2-4f72-9ec3-86db5f223e1a tempest-VolumesActionsTest-560347811 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:35:13 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-1383cd55-ebf2-4f72-9ec3-86db5f223e1a tempest-VolumesActionsTest-560347811 None] Deleted volume successfully. Jul 11 04:35:13 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fd0e07c-d898-4f74-8724-f0c5520dbd31 tempest-VolumesActionsTest-1247525239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:35:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1fd0e07c-d898-4f74-8724-f0c5520dbd31 tempest-VolumesActionsTest-1247525239 None] Flow 'volume_create_manager' (ef3924ad-5a13-4508-a917-c9f8c46decda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:35:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1fd0e07c-d898-4f74-8724-f0c5520dbd31 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bd8529f-3015-4f24-b2a3-659c3f0e4f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:13 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1383cd55-ebf2-4f72-9ec3-86db5f223e1a tempest-VolumesActionsTest-560347811 None] Lock "cinder-5e8c577b-fe7b-4a40-939c-18dcd064590e-delete_volume" released by "delete_volume" :: held 5.550s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:35:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1fd0e07c-d898-4f74-8724-f0c5520dbd31 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bd8529f-3015-4f24-b2a3-659c3f0e4f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-299781294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81fadad9-6b85-4589-b5c3-85047c994687,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c69db80db0a34d178f41b637c7919206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:35:14Z,use_quota=True,user_id='375b256be71241e1883629ee3579bc71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1fd0e07c-d898-4f74-8724-f0c5520dbd31 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b71e032-6ea5-4e80-9b57-8354a5de502a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1fd0e07c-d898-4f74-8724-f0c5520dbd31 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b71e032-6ea5-4e80-9b57-8354a5de502a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1fd0e07c-d898-4f74-8724-f0c5520dbd31 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f360827-b228-4ce7-9111-586a595439a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1fd0e07c-d898-4f74-8724-f0c5520dbd31 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f360827-b228-4ce7-9111-586a595439a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81fadad9-6b85-4589-b5c3-85047c994687', 'volume_name': 'volume-81fadad9-6b85-4589-b5c3-85047c994687', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1fd0e07c-d898-4f74-8724-f0c5520dbd31 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf8f5eb7-bdc5-48bf-82ec-91a969c9f71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1fd0e07c-d898-4f74-8724-f0c5520dbd31 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf8f5eb7-bdc5-48bf-82ec-91a969c9f71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1fd0e07c-d898-4f74-8724-f0c5520dbd31 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f60bd2-0bd8-4626-b80b-c711c0928130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:13 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-1fd0e07c-d898-4f74-8724-f0c5520dbd31 tempest-VolumesActionsTest-1247525239 None] Volume 81fadad9-6b85-4589-b5c3-85047c994687: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81fadad9-6b85-4589-b5c3-85047c994687', 'volume_size': 1} Jul 11 04:35:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1fd0e07c-d898-4f74-8724-f0c5520dbd31 tempest-VolumesActionsTest-1247525239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:35:14 devstack sudo[98893]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e96bf139-1691-427f-8b2a-3e1df0522516 tempest-VolumesActionsTest-1672075969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c /opt/stack/data/cinder/conversion/c26d4c8f-0a69-45b0-83db-1bee00a0307c.temp_image.0969f9c6-f35b-441b-8907-4d7302b5ccf2m6v6gvbh.img" returned: 0 in 5.734s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:14 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[e841813d-ca09-419d-9cc8-30ea85c67cd0]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:35:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e96bf139-1691-427f-8b2a-3e1df0522516 tempest-VolumesActionsTest-1672075969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:14 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c Jul 11 04:35:14 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:14 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e96bf139-1691-427f-8b2a-3e1df0522516 tempest-VolumesActionsTest-1672075969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c" returned: 0 in 0.909s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:14 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-e96bf139-1691-427f-8b2a-3e1df0522516 tempest-VolumesActionsTest-1672075969 None] Image conversion details: src /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c, size 1024.00 MB, duration 5.74 sec, destination /opt/stack/data/cinder/conversion/c26d4c8f-0a69-45b0-83db-1bee00a0307c.temp_image.0969f9c6-f35b-441b-8907-4d7302b5ccf2m6v6gvbh.img {{(pid=86964) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 04:35:14 devstack cinder-volume[86964]: INFO cinder.image.image_utils [None req-e96bf139-1691-427f-8b2a-3e1df0522516 tempest-VolumesActionsTest-1672075969 None] Converted 1024.00 MB image at 178.55 MB/s Jul 11 04:35:15 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-e96bf139-1691-427f-8b2a-3e1df0522516 tempest-VolumesActionsTest-1672075969 None] 0969f9c6-f35b-441b-8907-4d7302b5ccf2 was raw, converting to qcow2 {{(pid=86964) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 11 04:35:15 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c29c282-6e52-4d9b-ad73-07a89bc13a53]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:35:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e96bf139-1691-427f-8b2a-3e1df0522516 tempest-VolumesActionsTest-1672075969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c26d4c8f-0a69-45b0-83db-1bee00a0307c.temp_image.0969f9c6-f35b-441b-8907-4d7302b5ccf2m6v6gvbh.img {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:15 devstack sudo[98924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c26d4c8f-0a69-45b0-83db-1bee00a0307c.temp_image.0969f9c6-f35b-441b-8907-4d7302b5ccf2m6v6gvbh.img Jul 11 04:35:15 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:15 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e96bf139-1691-427f-8b2a-3e1df0522516 tempest-VolumesActionsTest-1672075969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c26d4c8f-0a69-45b0-83db-1bee00a0307c.temp_image.0969f9c6-f35b-441b-8907-4d7302b5ccf2m6v6gvbh.img" returned: 0 in 0.702s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e96bf139-1691-427f-8b2a-3e1df0522516 tempest-VolumesActionsTest-1672075969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c26d4c8f-0a69-45b0-83db-1bee00a0307c.temp_image.0969f9c6-f35b-441b-8907-4d7302b5ccf2m6v6gvbh.img {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:15 devstack sudo[98929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c26d4c8f-0a69-45b0-83db-1bee00a0307c.temp_image.0969f9c6-f35b-441b-8907-4d7302b5ccf2m6v6gvbh.img Jul 11 04:35:15 devstack sudo[98929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:16 devstack sudo[98929]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e96bf139-1691-427f-8b2a-3e1df0522516 tempest-VolumesActionsTest-1672075969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c26d4c8f-0a69-45b0-83db-1bee00a0307c.temp_image.0969f9c6-f35b-441b-8907-4d7302b5ccf2m6v6gvbh.img" returned: 1 in 0.708s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e96bf139-1691-427f-8b2a-3e1df0522516 tempest-VolumesActionsTest-1672075969 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c26d4c8f-0a69-45b0-83db-1bee00a0307c.temp_image.0969f9c6-f35b-441b-8907-4d7302b5ccf2m6v6gvbh.img' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:35:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e96bf139-1691-427f-8b2a-3e1df0522516 tempest-VolumesActionsTest-1672075969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c26d4c8f-0a69-45b0-83db-1bee00a0307c.temp_image.0969f9c6-f35b-441b-8907-4d7302b5ccf2m6v6gvbh.img /opt/stack/data/cinder/conversion/vol_upload_59d9609p {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:16 devstack sudo[98934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c26d4c8f-0a69-45b0-83db-1bee00a0307c.temp_image.0969f9c6-f35b-441b-8907-4d7302b5ccf2m6v6gvbh.img /opt/stack/data/cinder/conversion/vol_upload_59d9609p Jul 11 04:35:16 devstack sudo[98934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:17 devstack sudo[98934]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e96bf139-1691-427f-8b2a-3e1df0522516 tempest-VolumesActionsTest-1672075969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c26d4c8f-0a69-45b0-83db-1bee00a0307c.temp_image.0969f9c6-f35b-441b-8907-4d7302b5ccf2m6v6gvbh.img /opt/stack/data/cinder/conversion/vol_upload_59d9609p" returned: 0 in 0.659s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:17 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-e96bf139-1691-427f-8b2a-3e1df0522516 tempest-VolumesActionsTest-1672075969 None] Image conversion details: src /opt/stack/data/cinder/conversion/c26d4c8f-0a69-45b0-83db-1bee00a0307c.temp_image.0969f9c6-f35b-441b-8907-4d7302b5ccf2m6v6gvbh.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_59d9609p {{(pid=86964) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 04:35:17 devstack cinder-volume[86964]: INFO cinder.image.image_utils [None req-e96bf139-1691-427f-8b2a-3e1df0522516 tempest-VolumesActionsTest-1672075969 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 11 04:35:17 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3343be8-d12d-490f-b8b8-d602848abf2b]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:35:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e96bf139-1691-427f-8b2a-3e1df0522516 tempest-VolumesActionsTest-1672075969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_59d9609p {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:17 devstack sudo[98939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_59d9609p Jul 11 04:35:17 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:17 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e96bf139-1691-427f-8b2a-3e1df0522516 tempest-VolumesActionsTest-1672075969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_59d9609p" returned: 0 in 0.721s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e96bf139-1691-427f-8b2a-3e1df0522516 tempest-VolumesActionsTest-1672075969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.730s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:35:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e96bf139-1691-427f-8b2a-3e1df0522516 tempest-VolumesActionsTest-1672075969 None] Uploaded volume to glance image-id: 0969f9c6-f35b-441b-8907-4d7302b5ccf2. {{(pid=86964) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 11 04:35:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-88435ef6-b55a-4f53-933d-3230050e3cea tempest-ProjectReaderTests-1257901305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.163s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:35:19 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-88435ef6-b55a-4f53-933d-3230050e3cea tempest-ProjectReaderTests-1257901305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:35:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-15895469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5179ac14-b033-4930-95cf-13c91490248a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ad838d72f4544ce9b5b6f16e9c50f39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:35:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:35:09Z,use_quota=True,user_id='a34d05aeaa8c4abc8cacb89ab3f39e1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:35:19 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-88435ef6-b55a-4f53-933d-3230050e3cea tempest-ProjectReaderTests-1257901305 None] Creating volume 5179ac14-b033-4930-95cf-13c91490248a {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:35:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-88435ef6-b55a-4f53-933d-3230050e3cea tempest-ProjectReaderTests-1257901305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:35:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-88435ef6-b55a-4f53-933d-3230050e3cea tempest-ProjectReaderTests-1257901305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:35:19 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-88435ef6-b55a-4f53-933d-3230050e3cea tempest-ProjectReaderTests-1257901305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:35:19 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-88435ef6-b55a-4f53-933d-3230050e3cea tempest-ProjectReaderTests-1257901305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:35:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-88435ef6-b55a-4f53-933d-3230050e3cea tempest-ProjectReaderTests-1257901305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:35:19 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-88435ef6-b55a-4f53-933d-3230050e3cea tempest-ProjectReaderTests-1257901305 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:35:19 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-88435ef6-b55a-4f53-933d-3230050e3cea tempest-ProjectReaderTests-1257901305 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:35:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-88435ef6-b55a-4f53-933d-3230050e3cea tempest-ProjectReaderTests-1257901305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5179ac14-b033-4930-95cf-13c91490248a 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:19 devstack sudo[98951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5179ac14-b033-4930-95cf-13c91490248a 1073741824 Jul 11 04:35:19 devstack sudo[98951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:19 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-e96bf139-1691-427f-8b2a-3e1df0522516 tempest-VolumesActionsTest-1672075969 None] Copy volume to image completed successfully. Jul 11 04:35:19 devstack sudo[98951]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-88435ef6-b55a-4f53-933d-3230050e3cea tempest-ProjectReaderTests-1257901305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5179ac14-b033-4930-95cf-13c91490248a 1073741824" returned: 0 in 0.874s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-88435ef6-b55a-4f53-933d-3230050e3cea tempest-ProjectReaderTests-1257901305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5179ac14-b033-4930-95cf-13c91490248a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:19 devstack sudo[98956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5179ac14-b033-4930-95cf-13c91490248a Jul 11 04:35:19 devstack sudo[98956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:20 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-bac76329-5937-48fc-8ba4-0caaedd91662 tempest-VolumesActionsTest-1672075969 None] Acquiring lock "cinder-c26d4c8f-0a69-45b0-83db-1bee00a0307c-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:35:20 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-bac76329-5937-48fc-8ba4-0caaedd91662 tempest-VolumesActionsTest-1672075969 None] Lock "cinder-c26d4c8f-0a69-45b0-83db-1bee00a0307c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:35:20 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-bac76329-5937-48fc-8ba4-0caaedd91662 tempest-VolumesActionsTest-1672075969 None] Acquiring lock "cinder-quobyte-c26d4c8f-0a69-45b0-83db-1bee00a0307c" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:35:20 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-bac76329-5937-48fc-8ba4-0caaedd91662 tempest-VolumesActionsTest-1672075969 None] Lock "cinder-quobyte-c26d4c8f-0a69-45b0-83db-1bee00a0307c" acquired by "delete_volume" :: waited 0.014s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:35:20 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[165a06bc-2177-4518-93d2-11f865e864f3]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:35:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bac76329-5937-48fc-8ba4-0caaedd91662 tempest-VolumesActionsTest-1672075969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:20 devstack sudo[98958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c Jul 11 04:35:20 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:20 devstack sudo[98956]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-88435ef6-b55a-4f53-933d-3230050e3cea tempest-ProjectReaderTests-1257901305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5179ac14-b033-4930-95cf-13c91490248a" returned: 0 in 0.643s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:20 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-88435ef6-b55a-4f53-933d-3230050e3cea tempest-ProjectReaderTests-1257901305 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:35:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-88435ef6-b55a-4f53-933d-3230050e3cea tempest-ProjectReaderTests-1257901305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:35:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-52054870-81cd-4c16-a183-fef3e6895dfb tempest-AttachVolumeNegativeTest-930293942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.776s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:35:20 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-52054870-81cd-4c16-a183-fef3e6895dfb tempest-AttachVolumeNegativeTest-930293942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-645180215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=591043ca-dd77-4202-bf10-2e61ee35dc7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44e231901653417dbcb1950f52b0f087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:35:12Z,use_quota=True,user_id='8a13d9d5816e46b2a784648c5f438e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:35:20 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-52054870-81cd-4c16-a183-fef3e6895dfb tempest-AttachVolumeNegativeTest-930293942 None] Creating volume 591043ca-dd77-4202-bf10-2e61ee35dc7b {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:35:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-52054870-81cd-4c16-a183-fef3e6895dfb tempest-AttachVolumeNegativeTest-930293942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:35:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-52054870-81cd-4c16-a183-fef3e6895dfb tempest-AttachVolumeNegativeTest-930293942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:35:20 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-52054870-81cd-4c16-a183-fef3e6895dfb tempest-AttachVolumeNegativeTest-930293942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:35:20 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-52054870-81cd-4c16-a183-fef3e6895dfb tempest-AttachVolumeNegativeTest-930293942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:35:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-52054870-81cd-4c16-a183-fef3e6895dfb tempest-AttachVolumeNegativeTest-930293942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:35:20 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-52054870-81cd-4c16-a183-fef3e6895dfb tempest-AttachVolumeNegativeTest-930293942 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:35:20 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-52054870-81cd-4c16-a183-fef3e6895dfb tempest-AttachVolumeNegativeTest-930293942 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:35:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-52054870-81cd-4c16-a183-fef3e6895dfb tempest-AttachVolumeNegativeTest-930293942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-591043ca-dd77-4202-bf10-2e61ee35dc7b 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:20 devstack sudo[98961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-591043ca-dd77-4202-bf10-2e61ee35dc7b 1073741824 Jul 11 04:35:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-88435ef6-b55a-4f53-933d-3230050e3cea tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28a9466-b13d-4c7b-9d93-09674af650ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5179ac14-b033-4930-95cf-13c91490248a', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:20 devstack sudo[98961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-88435ef6-b55a-4f53-933d-3230050e3cea tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ce139db-dcd1-4e60-b405-2e8019ee7818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:20 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-88435ef6-b55a-4f53-933d-3230050e3cea tempest-ProjectReaderTests-1257901305 None] Volume volume-5179ac14-b033-4930-95cf-13c91490248a (5179ac14-b033-4930-95cf-13c91490248a): created successfully Jul 11 04:35:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-88435ef6-b55a-4f53-933d-3230050e3cea tempest-ProjectReaderTests-1257901305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ce139db-dcd1-4e60-b405-2e8019ee7818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-88435ef6-b55a-4f53-933d-3230050e3cea tempest-ProjectReaderTests-1257901305 None] Flow 'volume_create_manager' (d8cb27da-7be9-4f74-b494-db959e174401) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:35:20 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-88435ef6-b55a-4f53-933d-3230050e3cea tempest-ProjectReaderTests-1257901305 None] Created volume successfully. Jul 11 04:35:20 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bac76329-5937-48fc-8ba4-0caaedd91662 tempest-VolumesActionsTest-1672075969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c" returned: 0 in 0.798s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bac76329-5937-48fc-8ba4-0caaedd91662 tempest-VolumesActionsTest-1672075969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:20 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-8498a13b-fffd-420b-b00d-c34d7da4d8af tempest-ProjectReaderTests-1257901305 None] Acquiring lock "cinder-5179ac14-b033-4930-95cf-13c91490248a-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:35:20 devstack sudo[98966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c Jul 11 04:35:20 devstack sudo[98966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:21 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-8498a13b-fffd-420b-b00d-c34d7da4d8af tempest-ProjectReaderTests-1257901305 None] Lock "cinder-5179ac14-b033-4930-95cf-13c91490248a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:35:21 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-8498a13b-fffd-420b-b00d-c34d7da4d8af tempest-ProjectReaderTests-1257901305 None] Acquiring lock "cinder-quobyte-5179ac14-b033-4930-95cf-13c91490248a" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:35:21 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-8498a13b-fffd-420b-b00d-c34d7da4d8af tempest-ProjectReaderTests-1257901305 None] Lock "cinder-quobyte-5179ac14-b033-4930-95cf-13c91490248a" acquired by "delete_volume" :: waited 0.016s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:35:21 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff403c7-4406-4c5a-82fc-4c0763f48533]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:35:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8498a13b-fffd-420b-b00d-c34d7da4d8af tempest-ProjectReaderTests-1257901305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5179ac14-b033-4930-95cf-13c91490248a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:21 devstack sudo[98968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5179ac14-b033-4930-95cf-13c91490248a Jul 11 04:35:21 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:21 devstack sudo[98961]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-52054870-81cd-4c16-a183-fef3e6895dfb tempest-AttachVolumeNegativeTest-930293942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-591043ca-dd77-4202-bf10-2e61ee35dc7b 1073741824" returned: 0 in 0.860s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-52054870-81cd-4c16-a183-fef3e6895dfb tempest-AttachVolumeNegativeTest-930293942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-591043ca-dd77-4202-bf10-2e61ee35dc7b {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:21 devstack sudo[98973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-591043ca-dd77-4202-bf10-2e61ee35dc7b Jul 11 04:35:21 devstack sudo[98973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:21 devstack sudo[98966]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bac76329-5937-48fc-8ba4-0caaedd91662 tempest-VolumesActionsTest-1672075969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c26d4c8f-0a69-45b0-83db-1bee00a0307c" returned: 0 in 0.724s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:21 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-bac76329-5937-48fc-8ba4-0caaedd91662 tempest-VolumesActionsTest-1672075969 None] Lock "cinder-quobyte-c26d4c8f-0a69-45b0-83db-1bee00a0307c" released by "delete_volume" :: held 1.566s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:35:21 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-bac76329-5937-48fc-8ba4-0caaedd91662 tempest-VolumesActionsTest-1672075969 None] Created reservations ['7dfedcfb-6bdc-449b-aea0-2237fbfc5664', 'b450db6f-7cb9-4c9f-bc66-5feaf34f9239', '8e34f048-932a-49cc-be31-655c5fd06208', '148cf0ca-498e-435b-abe6-ce1d49182773'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:35:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-bac76329-5937-48fc-8ba4-0caaedd91662 tempest-VolumesActionsTest-1672075969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:35:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-bac76329-5937-48fc-8ba4-0caaedd91662 tempest-VolumesActionsTest-1672075969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:35:21 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-bac76329-5937-48fc-8ba4-0caaedd91662 tempest-VolumesActionsTest-1672075969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:35:21 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-bac76329-5937-48fc-8ba4-0caaedd91662 tempest-VolumesActionsTest-1672075969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:35:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-bac76329-5937-48fc-8ba4-0caaedd91662 tempest-VolumesActionsTest-1672075969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:35:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bac76329-5937-48fc-8ba4-0caaedd91662 tempest-VolumesActionsTest-1672075969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:21 devstack sudo[98979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:35:21 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:21 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8498a13b-fffd-420b-b00d-c34d7da4d8af tempest-ProjectReaderTests-1257901305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5179ac14-b033-4930-95cf-13c91490248a" returned: 0 in 0.851s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8498a13b-fffd-420b-b00d-c34d7da4d8af tempest-ProjectReaderTests-1257901305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5179ac14-b033-4930-95cf-13c91490248a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:21 devstack sudo[98981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5179ac14-b033-4930-95cf-13c91490248a Jul 11 04:35:21 devstack sudo[98981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:22 devstack sudo[98973]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-52054870-81cd-4c16-a183-fef3e6895dfb tempest-AttachVolumeNegativeTest-930293942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-591043ca-dd77-4202-bf10-2e61ee35dc7b" returned: 0 in 0.726s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-52054870-81cd-4c16-a183-fef3e6895dfb tempest-AttachVolumeNegativeTest-930293942 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:35:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-52054870-81cd-4c16-a183-fef3e6895dfb tempest-AttachVolumeNegativeTest-930293942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:35:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1fd0e07c-d898-4f74-8724-f0c5520dbd31 tempest-VolumesActionsTest-1247525239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.357s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:35:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-1fd0e07c-d898-4f74-8724-f0c5520dbd31 tempest-VolumesActionsTest-1247525239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-299781294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81fadad9-6b85-4589-b5c3-85047c994687,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c69db80db0a34d178f41b637c7919206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:35:14Z,use_quota=True,user_id='375b256be71241e1883629ee3579bc71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:35:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-1fd0e07c-d898-4f74-8724-f0c5520dbd31 tempest-VolumesActionsTest-1247525239 None] Creating volume 81fadad9-6b85-4589-b5c3-85047c994687 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:35:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1fd0e07c-d898-4f74-8724-f0c5520dbd31 tempest-VolumesActionsTest-1247525239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:35:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1fd0e07c-d898-4f74-8724-f0c5520dbd31 tempest-VolumesActionsTest-1247525239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:35:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-1fd0e07c-d898-4f74-8724-f0c5520dbd31 tempest-VolumesActionsTest-1247525239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:35:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-1fd0e07c-d898-4f74-8724-f0c5520dbd31 tempest-VolumesActionsTest-1247525239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:35:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1fd0e07c-d898-4f74-8724-f0c5520dbd31 tempest-VolumesActionsTest-1247525239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:35:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-1fd0e07c-d898-4f74-8724-f0c5520dbd31 tempest-VolumesActionsTest-1247525239 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:35:22 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-1fd0e07c-d898-4f74-8724-f0c5520dbd31 tempest-VolumesActionsTest-1247525239 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:35:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1fd0e07c-d898-4f74-8724-f0c5520dbd31 tempest-VolumesActionsTest-1247525239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-81fadad9-6b85-4589-b5c3-85047c994687 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:22 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-52054870-81cd-4c16-a183-fef3e6895dfb tempest-AttachVolumeNegativeTest-930293942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (392457fb-9297-453a-a1f5-2986e71be7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-591043ca-dd77-4202-bf10-2e61ee35dc7b', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:22 devstack sudo[98984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-81fadad9-6b85-4589-b5c3-85047c994687 1073741824 Jul 11 04:35:22 devstack sudo[98984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:22 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-52054870-81cd-4c16-a183-fef3e6895dfb tempest-AttachVolumeNegativeTest-930293942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3f9cc89-7ff4-4a5a-9a0e-fedca996d0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:22 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-52054870-81cd-4c16-a183-fef3e6895dfb tempest-AttachVolumeNegativeTest-930293942 None] Volume volume-591043ca-dd77-4202-bf10-2e61ee35dc7b (591043ca-dd77-4202-bf10-2e61ee35dc7b): created successfully Jul 11 04:35:22 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-52054870-81cd-4c16-a183-fef3e6895dfb tempest-AttachVolumeNegativeTest-930293942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3f9cc89-7ff4-4a5a-9a0e-fedca996d0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:22 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-52054870-81cd-4c16-a183-fef3e6895dfb tempest-AttachVolumeNegativeTest-930293942 None] Flow 'volume_create_manager' (e525fb35-caba-4cc2-91ac-c9b69113bdfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:35:22 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-52054870-81cd-4c16-a183-fef3e6895dfb tempest-AttachVolumeNegativeTest-930293942 None] Created volume successfully. Jul 11 04:35:22 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bac76329-5937-48fc-8ba4-0caaedd91662 tempest-VolumesActionsTest-1672075969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.744s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:22 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-bac76329-5937-48fc-8ba4-0caaedd91662 tempest-VolumesActionsTest-1672075969 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:35:22 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-bac76329-5937-48fc-8ba4-0caaedd91662 tempest-VolumesActionsTest-1672075969 None] Deleted volume successfully. Jul 11 04:35:22 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-bac76329-5937-48fc-8ba4-0caaedd91662 tempest-VolumesActionsTest-1672075969 None] Lock "cinder-c26d4c8f-0a69-45b0-83db-1bee00a0307c-delete_volume" released by "delete_volume" :: held 2.529s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:35:22 devstack sudo[98981]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8498a13b-fffd-420b-b00d-c34d7da4d8af tempest-ProjectReaderTests-1257901305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5179ac14-b033-4930-95cf-13c91490248a" returned: 0 in 0.697s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:22 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-8498a13b-fffd-420b-b00d-c34d7da4d8af tempest-ProjectReaderTests-1257901305 None] Lock "cinder-quobyte-5179ac14-b033-4930-95cf-13c91490248a" released by "delete_volume" :: held 1.592s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:35:22 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-8498a13b-fffd-420b-b00d-c34d7da4d8af tempest-ProjectReaderTests-1257901305 None] Created reservations ['295c9e91-082a-405d-b8dd-c7bf3c8fa8de', 'd4c04edf-4e6b-41ca-aaba-24d6a1cb5a3a', '4f4a7e89-3dce-46d2-8b29-ac3d3bd51dd4', 'f30637f8-b927-4d4a-a3a5-3b48a87e6f36'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:35:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-8498a13b-fffd-420b-b00d-c34d7da4d8af tempest-ProjectReaderTests-1257901305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:35:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-8498a13b-fffd-420b-b00d-c34d7da4d8af tempest-ProjectReaderTests-1257901305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:35:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-8498a13b-fffd-420b-b00d-c34d7da4d8af tempest-ProjectReaderTests-1257901305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:35:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-8498a13b-fffd-420b-b00d-c34d7da4d8af tempest-ProjectReaderTests-1257901305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:35:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-8498a13b-fffd-420b-b00d-c34d7da4d8af tempest-ProjectReaderTests-1257901305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:35:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8498a13b-fffd-420b-b00d-c34d7da4d8af tempest-ProjectReaderTests-1257901305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:22 devstack sudo[98988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:35:22 devstack sudo[98988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:23 devstack sudo[98984]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1fd0e07c-d898-4f74-8724-f0c5520dbd31 tempest-VolumesActionsTest-1247525239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-81fadad9-6b85-4589-b5c3-85047c994687 1073741824" returned: 0 in 1.129s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1fd0e07c-d898-4f74-8724-f0c5520dbd31 tempest-VolumesActionsTest-1247525239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-81fadad9-6b85-4589-b5c3-85047c994687 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:23 devstack sudo[98998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-81fadad9-6b85-4589-b5c3-85047c994687 Jul 11 04:35:23 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:23 devstack sudo[98988]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8498a13b-fffd-420b-b00d-c34d7da4d8af tempest-ProjectReaderTests-1257901305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.753s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:23 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-8498a13b-fffd-420b-b00d-c34d7da4d8af tempest-ProjectReaderTests-1257901305 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:35:23 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-8498a13b-fffd-420b-b00d-c34d7da4d8af tempest-ProjectReaderTests-1257901305 None] Deleted volume successfully. Jul 11 04:35:23 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-8498a13b-fffd-420b-b00d-c34d7da4d8af tempest-ProjectReaderTests-1257901305 None] Lock "cinder-5179ac14-b033-4930-95cf-13c91490248a-delete_volume" released by "delete_volume" :: held 2.564s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:35:24 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1fd0e07c-d898-4f74-8724-f0c5520dbd31 tempest-VolumesActionsTest-1247525239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-81fadad9-6b85-4589-b5c3-85047c994687" returned: 0 in 0.753s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:24 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-1fd0e07c-d898-4f74-8724-f0c5520dbd31 tempest-VolumesActionsTest-1247525239 None] <== create_volume: return (1939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:35:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1fd0e07c-d898-4f74-8724-f0c5520dbd31 tempest-VolumesActionsTest-1247525239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.944s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:35:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1fd0e07c-d898-4f74-8724-f0c5520dbd31 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f60bd2-0bd8-4626-b80b-c711c0928130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81fadad9-6b85-4589-b5c3-85047c994687', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1fd0e07c-d898-4f74-8724-f0c5520dbd31 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e66c6c0b-0b1d-433b-b34c-a6e9d8310440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:24 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-1fd0e07c-d898-4f74-8724-f0c5520dbd31 tempest-VolumesActionsTest-1247525239 None] Volume volume-81fadad9-6b85-4589-b5c3-85047c994687 (81fadad9-6b85-4589-b5c3-85047c994687): created successfully Jul 11 04:35:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1fd0e07c-d898-4f74-8724-f0c5520dbd31 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e66c6c0b-0b1d-433b-b34c-a6e9d8310440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1fd0e07c-d898-4f74-8724-f0c5520dbd31 tempest-VolumesActionsTest-1247525239 None] Flow 'volume_create_manager' (ef3924ad-5a13-4508-a917-c9f8c46decda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:35:24 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-1fd0e07c-d898-4f74-8724-f0c5520dbd31 tempest-VolumesActionsTest-1247525239 None] Created volume successfully. Jul 11 04:35:25 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6ebbfd00-e8ce-4a25-91d2-10cf5c1405f5 tempest-VolumesActionsTest-560347811 None] Acquiring lock "cinder-81fadad9-6b85-4589-b5c3-85047c994687-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:35:25 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6ebbfd00-e8ce-4a25-91d2-10cf5c1405f5 tempest-VolumesActionsTest-560347811 None] Lock "cinder-81fadad9-6b85-4589-b5c3-85047c994687-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:35:25 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6ebbfd00-e8ce-4a25-91d2-10cf5c1405f5 tempest-VolumesActionsTest-560347811 None] Acquiring lock "cinder-quobyte-81fadad9-6b85-4589-b5c3-85047c994687" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:35:25 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6ebbfd00-e8ce-4a25-91d2-10cf5c1405f5 tempest-VolumesActionsTest-560347811 None] Lock "cinder-quobyte-81fadad9-6b85-4589-b5c3-85047c994687" acquired by "delete_volume" :: waited 0.022s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:35:25 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de4a76a-cabc-44bc-a61b-b876e6430b62]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:35:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6ebbfd00-e8ce-4a25-91d2-10cf5c1405f5 tempest-VolumesActionsTest-560347811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-81fadad9-6b85-4589-b5c3-85047c994687 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:25 devstack sudo[99003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-81fadad9-6b85-4589-b5c3-85047c994687 Jul 11 04:35:25 devstack sudo[99003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-1fc1e151-6921-451e-b392-273fed1bf464 req-2557cde9-2fc2-402d-805e-4f0e4b8ac9b9 tempest-AttachVolumeNegativeTest-930293942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:35:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-1fc1e151-6921-451e-b392-273fed1bf464 req-2557cde9-2fc2-402d-805e-4f0e4b8ac9b9 tempest-AttachVolumeNegativeTest-930293942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:35:26 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[071bffa4-2c45-4261-95b5-4ccaf9ba0d9e]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:35:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-1fc1e151-6921-451e-b392-273fed1bf464 req-2557cde9-2fc2-402d-805e-4f0e4b8ac9b9 tempest-AttachVolumeNegativeTest-930293942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-591043ca-dd77-4202-bf10-2e61ee35dc7b {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:26 devstack sudo[99003]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6ebbfd00-e8ce-4a25-91d2-10cf5c1405f5 tempest-VolumesActionsTest-560347811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-81fadad9-6b85-4589-b5c3-85047c994687" returned: 0 in 0.854s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6ebbfd00-e8ce-4a25-91d2-10cf5c1405f5 tempest-VolumesActionsTest-560347811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-81fadad9-6b85-4589-b5c3-85047c994687 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:26 devstack sudo[99019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-81fadad9-6b85-4589-b5c3-85047c994687 Jul 11 04:35:26 devstack sudo[99019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:26 devstack sudo[99018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-591043ca-dd77-4202-bf10-2e61ee35dc7b Jul 11 04:35:26 devstack sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:27 devstack sudo[99019]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6ebbfd00-e8ce-4a25-91d2-10cf5c1405f5 tempest-VolumesActionsTest-560347811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-81fadad9-6b85-4589-b5c3-85047c994687" returned: 0 in 0.726s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:27 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6ebbfd00-e8ce-4a25-91d2-10cf5c1405f5 tempest-VolumesActionsTest-560347811 None] Lock "cinder-quobyte-81fadad9-6b85-4589-b5c3-85047c994687" released by "delete_volume" :: held 1.630s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:35:27 devstack sudo[99018]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-1fc1e151-6921-451e-b392-273fed1bf464 req-2557cde9-2fc2-402d-805e-4f0e4b8ac9b9 tempest-AttachVolumeNegativeTest-930293942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-591043ca-dd77-4202-bf10-2e61ee35dc7b" returned: 0 in 0.808s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-1fc1e151-6921-451e-b392-273fed1bf464 req-2557cde9-2fc2-402d-805e-4f0e4b8ac9b9 tempest-AttachVolumeNegativeTest-930293942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.826s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:35:27 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-6ebbfd00-e8ce-4a25-91d2-10cf5c1405f5 tempest-VolumesActionsTest-560347811 None] Created reservations ['8c63ecc0-62b7-4fa9-b7ee-93365ff0b71a', '0a52ccf4-d4df-46b8-b9d2-52eb742aa20b', 'af636332-882d-4b4d-87d3-919d2f60f976', '3ee05348-d802-4ae4-adc5-46d238e8c246'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:35:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-1fc1e151-6921-451e-b392-273fed1bf464 req-2557cde9-2fc2-402d-805e-4f0e4b8ac9b9 tempest-AttachVolumeNegativeTest-930293942 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95', 'name': 'volume-591043ca-dd77-4202-bf10-2e61ee35dc7b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '43e13328-f963-4db0-8e91-800f64e2948e', 'enforce_multipath': True} {{(pid=86964) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 04:35:27 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-1fc1e151-6921-451e-b392-273fed1bf464 req-2557cde9-2fc2-402d-805e-4f0e4b8ac9b9 tempest-AttachVolumeNegativeTest-930293942 None] attachment_update completed successfully. Jul 11 04:35:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6ebbfd00-e8ce-4a25-91d2-10cf5c1405f5 tempest-VolumesActionsTest-560347811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:35:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6ebbfd00-e8ce-4a25-91d2-10cf5c1405f5 tempest-VolumesActionsTest-560347811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:35:27 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6ebbfd00-e8ce-4a25-91d2-10cf5c1405f5 tempest-VolumesActionsTest-560347811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:35:27 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6ebbfd00-e8ce-4a25-91d2-10cf5c1405f5 tempest-VolumesActionsTest-560347811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:35:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6ebbfd00-e8ce-4a25-91d2-10cf5c1405f5 tempest-VolumesActionsTest-560347811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:35:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6ebbfd00-e8ce-4a25-91d2-10cf5c1405f5 tempest-VolumesActionsTest-560347811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:27 devstack sudo[99026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:35:27 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:28 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6ebbfd00-e8ce-4a25-91d2-10cf5c1405f5 tempest-VolumesActionsTest-560347811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.744s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:28 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-6ebbfd00-e8ce-4a25-91d2-10cf5c1405f5 tempest-VolumesActionsTest-560347811 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:35:28 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-6ebbfd00-e8ce-4a25-91d2-10cf5c1405f5 tempest-VolumesActionsTest-560347811 None] Deleted volume successfully. Jul 11 04:35:28 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6ebbfd00-e8ce-4a25-91d2-10cf5c1405f5 tempest-VolumesActionsTest-560347811 None] Lock "cinder-81fadad9-6b85-4589-b5c3-85047c994687-delete_volume" released by "delete_volume" :: held 2.706s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:35:28 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-eba0cfa1-b202-47a6-baf4-20bac3581c20 tempest-VolumesActionsTest-1247525239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:35:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-eba0cfa1-b202-47a6-baf4-20bac3581c20 tempest-VolumesActionsTest-1247525239 None] Flow 'volume_create_manager' (511fa910-8f37-476b-b358-976c2580be50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:35:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-eba0cfa1-b202-47a6-baf4-20bac3581c20 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d7c0881-b122-4282-ad99-8d9468b562f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-eba0cfa1-b202-47a6-baf4-20bac3581c20 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d7c0881-b122-4282-ad99-8d9468b562f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1566620080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63022330-2ca5-45c3-849b-da8d36742840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c69db80db0a34d178f41b637c7919206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:35:28Z,use_quota=True,user_id='375b256be71241e1883629ee3579bc71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-eba0cfa1-b202-47a6-baf4-20bac3581c20 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e7152c8-0396-4f01-a16d-87842d349d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-eba0cfa1-b202-47a6-baf4-20bac3581c20 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e7152c8-0396-4f01-a16d-87842d349d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-eba0cfa1-b202-47a6-baf4-20bac3581c20 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8abafdb7-da84-4873-8a72-e2b42c0e8a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-eba0cfa1-b202-47a6-baf4-20bac3581c20 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8abafdb7-da84-4873-8a72-e2b42c0e8a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63022330-2ca5-45c3-849b-da8d36742840', 'volume_name': 'volume-63022330-2ca5-45c3-849b-da8d36742840', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-eba0cfa1-b202-47a6-baf4-20bac3581c20 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (061dbf16-0227-4dba-918f-287c891929bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-eba0cfa1-b202-47a6-baf4-20bac3581c20 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (061dbf16-0227-4dba-918f-287c891929bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-eba0cfa1-b202-47a6-baf4-20bac3581c20 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27f19005-2ed2-4a88-b5fb-acd6a4a0c22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:28 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-eba0cfa1-b202-47a6-baf4-20bac3581c20 tempest-VolumesActionsTest-1247525239 None] Volume 63022330-2ca5-45c3-849b-da8d36742840: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63022330-2ca5-45c3-849b-da8d36742840', 'volume_size': 1} Jul 11 04:35:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-eba0cfa1-b202-47a6-baf4-20bac3581c20 tempest-VolumesActionsTest-1247525239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:35:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-eba0cfa1-b202-47a6-baf4-20bac3581c20 tempest-VolumesActionsTest-1247525239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:35:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-eba0cfa1-b202-47a6-baf4-20bac3581c20 tempest-VolumesActionsTest-1247525239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1566620080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63022330-2ca5-45c3-849b-da8d36742840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c69db80db0a34d178f41b637c7919206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:35:28Z,use_quota=True,user_id='375b256be71241e1883629ee3579bc71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:35:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-eba0cfa1-b202-47a6-baf4-20bac3581c20 tempest-VolumesActionsTest-1247525239 None] Creating volume 63022330-2ca5-45c3-849b-da8d36742840 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:35:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-eba0cfa1-b202-47a6-baf4-20bac3581c20 tempest-VolumesActionsTest-1247525239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:35:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-eba0cfa1-b202-47a6-baf4-20bac3581c20 tempest-VolumesActionsTest-1247525239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:35:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-eba0cfa1-b202-47a6-baf4-20bac3581c20 tempest-VolumesActionsTest-1247525239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:35:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-eba0cfa1-b202-47a6-baf4-20bac3581c20 tempest-VolumesActionsTest-1247525239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:35:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-eba0cfa1-b202-47a6-baf4-20bac3581c20 tempest-VolumesActionsTest-1247525239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:35:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-eba0cfa1-b202-47a6-baf4-20bac3581c20 tempest-VolumesActionsTest-1247525239 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:35:28 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-eba0cfa1-b202-47a6-baf4-20bac3581c20 tempest-VolumesActionsTest-1247525239 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:35:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-eba0cfa1-b202-47a6-baf4-20bac3581c20 tempest-VolumesActionsTest-1247525239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-63022330-2ca5-45c3-849b-da8d36742840 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:28 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-63022330-2ca5-45c3-849b-da8d36742840 1073741824 Jul 11 04:35:28 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:29 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-eba0cfa1-b202-47a6-baf4-20bac3581c20 tempest-VolumesActionsTest-1247525239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-63022330-2ca5-45c3-849b-da8d36742840 1073741824" returned: 0 in 0.881s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-eba0cfa1-b202-47a6-baf4-20bac3581c20 tempest-VolumesActionsTest-1247525239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-63022330-2ca5-45c3-849b-da8d36742840 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:29 devstack sudo[99417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-63022330-2ca5-45c3-849b-da8d36742840 Jul 11 04:35:29 devstack sudo[99417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:29 devstack sudo[99417]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-eba0cfa1-b202-47a6-baf4-20bac3581c20 tempest-VolumesActionsTest-1247525239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-63022330-2ca5-45c3-849b-da8d36742840" returned: 0 in 0.654s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:29 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-eba0cfa1-b202-47a6-baf4-20bac3581c20 tempest-VolumesActionsTest-1247525239 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:35:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-eba0cfa1-b202-47a6-baf4-20bac3581c20 tempest-VolumesActionsTest-1247525239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:35:29 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-eba0cfa1-b202-47a6-baf4-20bac3581c20 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27f19005-2ed2-4a88-b5fb-acd6a4a0c22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63022330-2ca5-45c3-849b-da8d36742840', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-eba0cfa1-b202-47a6-baf4-20bac3581c20 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9556499-3c49-4f60-a551-a1111750c5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:30 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-eba0cfa1-b202-47a6-baf4-20bac3581c20 tempest-VolumesActionsTest-1247525239 None] Volume volume-63022330-2ca5-45c3-849b-da8d36742840 (63022330-2ca5-45c3-849b-da8d36742840): created successfully Jul 11 04:35:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-eba0cfa1-b202-47a6-baf4-20bac3581c20 tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9556499-3c49-4f60-a551-a1111750c5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-eba0cfa1-b202-47a6-baf4-20bac3581c20 tempest-VolumesActionsTest-1247525239 None] Flow 'volume_create_manager' (511fa910-8f37-476b-b358-976c2580be50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:35:30 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-eba0cfa1-b202-47a6-baf4-20bac3581c20 tempest-VolumesActionsTest-1247525239 None] Created volume successfully. Jul 11 04:35:30 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-8ed9ab32-c950-4bce-a5c6-cc3e261f0d45 tempest-VolumesActionsTest-560347811 None] Acquiring lock "cinder-63022330-2ca5-45c3-849b-da8d36742840-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:35:30 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-8ed9ab32-c950-4bce-a5c6-cc3e261f0d45 tempest-VolumesActionsTest-560347811 None] Lock "cinder-63022330-2ca5-45c3-849b-da8d36742840-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:35:30 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-8ed9ab32-c950-4bce-a5c6-cc3e261f0d45 tempest-VolumesActionsTest-560347811 None] Acquiring lock "cinder-quobyte-63022330-2ca5-45c3-849b-da8d36742840" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:35:30 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-8ed9ab32-c950-4bce-a5c6-cc3e261f0d45 tempest-VolumesActionsTest-560347811 None] Lock "cinder-quobyte-63022330-2ca5-45c3-849b-da8d36742840" acquired by "delete_volume" :: waited 0.019s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:35:30 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[24381a60-8d1b-4774-98dd-f925073c6664]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:35:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8ed9ab32-c950-4bce-a5c6-cc3e261f0d45 tempest-VolumesActionsTest-560347811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-63022330-2ca5-45c3-849b-da8d36742840 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:30 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-63022330-2ca5-45c3-849b-da8d36742840 Jul 11 04:35:30 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:31 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8ed9ab32-c950-4bce-a5c6-cc3e261f0d45 tempest-VolumesActionsTest-560347811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-63022330-2ca5-45c3-849b-da8d36742840" returned: 0 in 0.772s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8ed9ab32-c950-4bce-a5c6-cc3e261f0d45 tempest-VolumesActionsTest-560347811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-63022330-2ca5-45c3-849b-da8d36742840 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:31 devstack sudo[99425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-63022330-2ca5-45c3-849b-da8d36742840 Jul 11 04:35:31 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:32 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8ed9ab32-c950-4bce-a5c6-cc3e261f0d45 tempest-VolumesActionsTest-560347811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-63022330-2ca5-45c3-849b-da8d36742840" returned: 0 in 0.709s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:32 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-8ed9ab32-c950-4bce-a5c6-cc3e261f0d45 tempest-VolumesActionsTest-560347811 None] Lock "cinder-quobyte-63022330-2ca5-45c3-849b-da8d36742840" released by "delete_volume" :: held 1.529s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:35:32 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-8ed9ab32-c950-4bce-a5c6-cc3e261f0d45 tempest-VolumesActionsTest-560347811 None] Created reservations ['d0bd4d27-6123-4993-9451-78bd8650b098', 'badf0595-4614-43f5-b0d0-b193b9219ce4', '9bb35d25-3dc4-4626-868e-fbb3ca70ed6d', '2c3bec3c-a9a6-4806-9912-0b8e6eda49b4'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:35:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-8ed9ab32-c950-4bce-a5c6-cc3e261f0d45 tempest-VolumesActionsTest-560347811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:35:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-8ed9ab32-c950-4bce-a5c6-cc3e261f0d45 tempest-VolumesActionsTest-560347811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:35:32 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-8ed9ab32-c950-4bce-a5c6-cc3e261f0d45 tempest-VolumesActionsTest-560347811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:35:32 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-8ed9ab32-c950-4bce-a5c6-cc3e261f0d45 tempest-VolumesActionsTest-560347811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:35:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-8ed9ab32-c950-4bce-a5c6-cc3e261f0d45 tempest-VolumesActionsTest-560347811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:35:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8ed9ab32-c950-4bce-a5c6-cc3e261f0d45 tempest-VolumesActionsTest-560347811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:32 devstack sudo[99428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:35:32 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:33 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8ed9ab32-c950-4bce-a5c6-cc3e261f0d45 tempest-VolumesActionsTest-560347811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.721s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:33 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-8ed9ab32-c950-4bce-a5c6-cc3e261f0d45 tempest-VolumesActionsTest-560347811 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:35:33 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-8ed9ab32-c950-4bce-a5c6-cc3e261f0d45 tempest-VolumesActionsTest-560347811 None] Deleted volume successfully. Jul 11 04:35:33 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-8ed9ab32-c950-4bce-a5c6-cc3e261f0d45 tempest-VolumesActionsTest-560347811 None] Lock "cinder-63022330-2ca5-45c3-849b-da8d36742840-delete_volume" released by "delete_volume" :: held 2.526s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:35:33 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-06f28a6c-bd61-426c-bbaa-c39864aac3fa tempest-VolumesActionsTest-1247525239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:35:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-06f28a6c-bd61-426c-bbaa-c39864aac3fa tempest-VolumesActionsTest-1247525239 None] Flow 'volume_create_manager' (11dfe7ed-97dc-4fc1-a43e-bad411fc6e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:35:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-06f28a6c-bd61-426c-bbaa-c39864aac3fa tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08e90301-2ad3-4912-81fc-1a22690cccaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-06f28a6c-bd61-426c-bbaa-c39864aac3fa tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08e90301-2ad3-4912-81fc-1a22690cccaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-185444968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53e16644-2dd2-40a9-985c-fffe18825145,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c69db80db0a34d178f41b637c7919206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:35:33Z,use_quota=True,user_id='375b256be71241e1883629ee3579bc71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-06f28a6c-bd61-426c-bbaa-c39864aac3fa tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (968fe6ab-3c8b-413c-92a5-63c9c61b278d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-06f28a6c-bd61-426c-bbaa-c39864aac3fa tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (968fe6ab-3c8b-413c-92a5-63c9c61b278d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-06f28a6c-bd61-426c-bbaa-c39864aac3fa tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4cc39f6-9a0d-4820-b18b-9bc49d660475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-06f28a6c-bd61-426c-bbaa-c39864aac3fa tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4cc39f6-9a0d-4820-b18b-9bc49d660475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53e16644-2dd2-40a9-985c-fffe18825145', 'volume_name': 'volume-53e16644-2dd2-40a9-985c-fffe18825145', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-06f28a6c-bd61-426c-bbaa-c39864aac3fa tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7186fd11-fa9e-4060-812c-9eb00a165b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-06f28a6c-bd61-426c-bbaa-c39864aac3fa tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7186fd11-fa9e-4060-812c-9eb00a165b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-06f28a6c-bd61-426c-bbaa-c39864aac3fa tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b06f01a-b834-4d8a-bccc-5de2380d98dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:33 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-06f28a6c-bd61-426c-bbaa-c39864aac3fa tempest-VolumesActionsTest-1247525239 None] Volume 53e16644-2dd2-40a9-985c-fffe18825145: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53e16644-2dd2-40a9-985c-fffe18825145', 'volume_size': 1} Jul 11 04:35:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-06f28a6c-bd61-426c-bbaa-c39864aac3fa tempest-VolumesActionsTest-1247525239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:35:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-06f28a6c-bd61-426c-bbaa-c39864aac3fa tempest-VolumesActionsTest-1247525239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:35:33 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-06f28a6c-bd61-426c-bbaa-c39864aac3fa tempest-VolumesActionsTest-1247525239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-185444968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53e16644-2dd2-40a9-985c-fffe18825145,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c69db80db0a34d178f41b637c7919206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:35:33Z,use_quota=True,user_id='375b256be71241e1883629ee3579bc71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:35:33 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-06f28a6c-bd61-426c-bbaa-c39864aac3fa tempest-VolumesActionsTest-1247525239 None] Creating volume 53e16644-2dd2-40a9-985c-fffe18825145 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:35:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-06f28a6c-bd61-426c-bbaa-c39864aac3fa tempest-VolumesActionsTest-1247525239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:35:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-06f28a6c-bd61-426c-bbaa-c39864aac3fa tempest-VolumesActionsTest-1247525239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:35:33 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-06f28a6c-bd61-426c-bbaa-c39864aac3fa tempest-VolumesActionsTest-1247525239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:35:33 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-06f28a6c-bd61-426c-bbaa-c39864aac3fa tempest-VolumesActionsTest-1247525239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:35:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-06f28a6c-bd61-426c-bbaa-c39864aac3fa tempest-VolumesActionsTest-1247525239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:35:33 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-06f28a6c-bd61-426c-bbaa-c39864aac3fa tempest-VolumesActionsTest-1247525239 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:35:33 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-06f28a6c-bd61-426c-bbaa-c39864aac3fa tempest-VolumesActionsTest-1247525239 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:35:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-06f28a6c-bd61-426c-bbaa-c39864aac3fa tempest-VolumesActionsTest-1247525239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-53e16644-2dd2-40a9-985c-fffe18825145 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:33 devstack sudo[99431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-53e16644-2dd2-40a9-985c-fffe18825145 1073741824 Jul 11 04:35:33 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:34 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-0b95011b-7663-4376-ab98-9e1c2cedb3c2 req-33d62b75-9e84-4776-8f99-38a50e789a82 tempest-AttachVolumeNegativeTest-930293942 None] Terminate volume connection completed successfully. Jul 11 04:35:34 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-0b95011b-7663-4376-ab98-9e1c2cedb3c2 req-33d62b75-9e84-4776-8f99-38a50e789a82 tempest-AttachVolumeNegativeTest-930293942 None] Deleting attachment 43e13328-f963-4db0-8e91-800f64e2948e. {{(pid=86964) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 04:35:34 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-06f28a6c-bd61-426c-bbaa-c39864aac3fa tempest-VolumesActionsTest-1247525239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-53e16644-2dd2-40a9-985c-fffe18825145 1073741824" returned: 0 in 0.938s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-06f28a6c-bd61-426c-bbaa-c39864aac3fa tempest-VolumesActionsTest-1247525239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-53e16644-2dd2-40a9-985c-fffe18825145 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:34 devstack sudo[99464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-53e16644-2dd2-40a9-985c-fffe18825145 Jul 11 04:35:34 devstack sudo[99464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:35 devstack sudo[99464]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-06f28a6c-bd61-426c-bbaa-c39864aac3fa tempest-VolumesActionsTest-1247525239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-53e16644-2dd2-40a9-985c-fffe18825145" returned: 0 in 0.700s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:35 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-06f28a6c-bd61-426c-bbaa-c39864aac3fa tempest-VolumesActionsTest-1247525239 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:35:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-06f28a6c-bd61-426c-bbaa-c39864aac3fa tempest-VolumesActionsTest-1247525239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:35:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-06f28a6c-bd61-426c-bbaa-c39864aac3fa tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b06f01a-b834-4d8a-bccc-5de2380d98dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53e16644-2dd2-40a9-985c-fffe18825145', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-06f28a6c-bd61-426c-bbaa-c39864aac3fa tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a78d3e3-b0b8-458d-b539-7cc4053f5eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:35 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-06f28a6c-bd61-426c-bbaa-c39864aac3fa tempest-VolumesActionsTest-1247525239 None] Volume volume-53e16644-2dd2-40a9-985c-fffe18825145 (53e16644-2dd2-40a9-985c-fffe18825145): created successfully Jul 11 04:35:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-06f28a6c-bd61-426c-bbaa-c39864aac3fa tempest-VolumesActionsTest-1247525239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a78d3e3-b0b8-458d-b539-7cc4053f5eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-06f28a6c-bd61-426c-bbaa-c39864aac3fa tempest-VolumesActionsTest-1247525239 None] Flow 'volume_create_manager' (11dfe7ed-97dc-4fc1-a43e-bad411fc6e98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:35:35 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-06f28a6c-bd61-426c-bbaa-c39864aac3fa tempest-VolumesActionsTest-1247525239 None] Created volume successfully. Jul 11 04:35:36 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-9744252e-c695-42f9-ad47-bb516c34d17c tempest-VolumesActionsTest-1247525239 None] Acquiring lock "cinder-53e16644-2dd2-40a9-985c-fffe18825145-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:35:36 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-9744252e-c695-42f9-ad47-bb516c34d17c tempest-VolumesActionsTest-1247525239 None] Lock "cinder-53e16644-2dd2-40a9-985c-fffe18825145-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:35:36 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-9744252e-c695-42f9-ad47-bb516c34d17c tempest-VolumesActionsTest-1247525239 None] Acquiring lock "cinder-quobyte-53e16644-2dd2-40a9-985c-fffe18825145" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:35:36 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-9744252e-c695-42f9-ad47-bb516c34d17c tempest-VolumesActionsTest-1247525239 None] Lock "cinder-quobyte-53e16644-2dd2-40a9-985c-fffe18825145" acquired by "delete_volume" :: waited 0.029s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:35:36 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf8a019-0f8b-4d27-b649-66211367e223]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:35:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9744252e-c695-42f9-ad47-bb516c34d17c tempest-VolumesActionsTest-1247525239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-53e16644-2dd2-40a9-985c-fffe18825145 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:36 devstack sudo[99468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-53e16644-2dd2-40a9-985c-fffe18825145 Jul 11 04:35:36 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:37 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9744252e-c695-42f9-ad47-bb516c34d17c tempest-VolumesActionsTest-1247525239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-53e16644-2dd2-40a9-985c-fffe18825145" returned: 0 in 0.842s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9744252e-c695-42f9-ad47-bb516c34d17c tempest-VolumesActionsTest-1247525239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-53e16644-2dd2-40a9-985c-fffe18825145 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:37 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-53e16644-2dd2-40a9-985c-fffe18825145 Jul 11 04:35:37 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:37 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9744252e-c695-42f9-ad47-bb516c34d17c tempest-VolumesActionsTest-1247525239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-53e16644-2dd2-40a9-985c-fffe18825145" returned: 0 in 0.725s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:37 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-9744252e-c695-42f9-ad47-bb516c34d17c tempest-VolumesActionsTest-1247525239 None] Lock "cinder-quobyte-53e16644-2dd2-40a9-985c-fffe18825145" released by "delete_volume" :: held 1.644s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:35:37 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-9744252e-c695-42f9-ad47-bb516c34d17c tempest-VolumesActionsTest-1247525239 None] Created reservations ['95f83ab7-ce7c-43e7-ad33-1fd4001a532d', '7be3a93d-f7ec-4f31-980c-d94ce9b0cd1c', '53d13d4f-3aad-4251-9403-a234664c3262', 'fa4c686b-32d8-4fa8-90fd-27ff8e524756'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:35:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9744252e-c695-42f9-ad47-bb516c34d17c tempest-VolumesActionsTest-1247525239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:35:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9744252e-c695-42f9-ad47-bb516c34d17c tempest-VolumesActionsTest-1247525239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:35:37 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-9744252e-c695-42f9-ad47-bb516c34d17c tempest-VolumesActionsTest-1247525239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:35:37 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-9744252e-c695-42f9-ad47-bb516c34d17c tempest-VolumesActionsTest-1247525239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:35:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9744252e-c695-42f9-ad47-bb516c34d17c tempest-VolumesActionsTest-1247525239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:35:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9744252e-c695-42f9-ad47-bb516c34d17c tempest-VolumesActionsTest-1247525239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:37 devstack sudo[99484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:35:37 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:38 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9744252e-c695-42f9-ad47-bb516c34d17c tempest-VolumesActionsTest-1247525239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.863s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:38 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-9744252e-c695-42f9-ad47-bb516c34d17c tempest-VolumesActionsTest-1247525239 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:35:38 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-9744252e-c695-42f9-ad47-bb516c34d17c tempest-VolumesActionsTest-1247525239 None] Deleted volume successfully. Jul 11 04:35:38 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-9744252e-c695-42f9-ad47-bb516c34d17c tempest-VolumesActionsTest-1247525239 None] Lock "cinder-53e16644-2dd2-40a9-985c-fffe18825145-delete_volume" released by "delete_volume" :: held 2.766s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:35:43 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-35228603-e458-4243-9a79-1aedeaa6b65a tempest-VolumesSnapshotTestJSON-1323670043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:35:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-35228603-e458-4243-9a79-1aedeaa6b65a tempest-VolumesSnapshotTestJSON-1323670043 None] Flow 'volume_create_manager' (4633a6c0-570d-4890-8cc5-1ce495a78dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:35:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-35228603-e458-4243-9a79-1aedeaa6b65a tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e0e158-5056-401e-b198-017028a3d735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-35228603-e458-4243-9a79-1aedeaa6b65a tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e0e158-5056-401e-b198-017028a3d735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2012475721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45dd46a7-a8fe-4b98-a49c-690c8f0d4765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d7c406e07ce4db495527579b5d7acbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:35:44Z,use_quota=True,user_id='3bdc313bd5cd43f8bb404a890cb0f49c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-35228603-e458-4243-9a79-1aedeaa6b65a tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d52b26bc-2cd9-4916-b5c3-b6735f34d740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-35228603-e458-4243-9a79-1aedeaa6b65a tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d52b26bc-2cd9-4916-b5c3-b6735f34d740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-35228603-e458-4243-9a79-1aedeaa6b65a tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14677d18-fe33-456e-aa7c-635428d95f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-35228603-e458-4243-9a79-1aedeaa6b65a tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14677d18-fe33-456e-aa7c-635428d95f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45dd46a7-a8fe-4b98-a49c-690c8f0d4765', 'volume_name': 'volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-35228603-e458-4243-9a79-1aedeaa6b65a tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b12b3aaf-3cd5-465a-a7a9-b6c791458134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-35228603-e458-4243-9a79-1aedeaa6b65a tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b12b3aaf-3cd5-465a-a7a9-b6c791458134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-35228603-e458-4243-9a79-1aedeaa6b65a tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f0ea4de-e0b2-45b6-bfe3-aa48fc87943c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:43 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-35228603-e458-4243-9a79-1aedeaa6b65a tempest-VolumesSnapshotTestJSON-1323670043 None] Volume 45dd46a7-a8fe-4b98-a49c-690c8f0d4765: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765', 'volume_size': 1} Jul 11 04:35:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-35228603-e458-4243-9a79-1aedeaa6b65a tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:35:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-35228603-e458-4243-9a79-1aedeaa6b65a tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:35:43 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-35228603-e458-4243-9a79-1aedeaa6b65a tempest-VolumesSnapshotTestJSON-1323670043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2012475721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45dd46a7-a8fe-4b98-a49c-690c8f0d4765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d7c406e07ce4db495527579b5d7acbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:35:44Z,use_quota=True,user_id='3bdc313bd5cd43f8bb404a890cb0f49c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:35:43 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-35228603-e458-4243-9a79-1aedeaa6b65a tempest-VolumesSnapshotTestJSON-1323670043 None] Creating volume 45dd46a7-a8fe-4b98-a49c-690c8f0d4765 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:35:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-35228603-e458-4243-9a79-1aedeaa6b65a tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:35:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-35228603-e458-4243-9a79-1aedeaa6b65a tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:35:43 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-35228603-e458-4243-9a79-1aedeaa6b65a tempest-VolumesSnapshotTestJSON-1323670043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:35:43 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-35228603-e458-4243-9a79-1aedeaa6b65a tempest-VolumesSnapshotTestJSON-1323670043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:35:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-35228603-e458-4243-9a79-1aedeaa6b65a tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:35:43 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-35228603-e458-4243-9a79-1aedeaa6b65a tempest-VolumesSnapshotTestJSON-1323670043 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:35:43 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-35228603-e458-4243-9a79-1aedeaa6b65a tempest-VolumesSnapshotTestJSON-1323670043 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:35:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-35228603-e458-4243-9a79-1aedeaa6b65a tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:43 devstack sudo[99508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765 1073741824 Jul 11 04:35:43 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:44 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-35228603-e458-4243-9a79-1aedeaa6b65a tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765 1073741824" returned: 0 in 0.933s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-35228603-e458-4243-9a79-1aedeaa6b65a tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:44 devstack sudo[99515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765 Jul 11 04:35:44 devstack sudo[99515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:45 devstack sudo[99515]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-35228603-e458-4243-9a79-1aedeaa6b65a tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765" returned: 0 in 0.641s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-35228603-e458-4243-9a79-1aedeaa6b65a tempest-VolumesSnapshotTestJSON-1323670043 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:35:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-35228603-e458-4243-9a79-1aedeaa6b65a tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:35:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-35228603-e458-4243-9a79-1aedeaa6b65a tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f0ea4de-e0b2-45b6-bfe3-aa48fc87943c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-35228603-e458-4243-9a79-1aedeaa6b65a tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea69d864-7dbb-487c-a91c-ae03fa7b4c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:45 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-35228603-e458-4243-9a79-1aedeaa6b65a tempest-VolumesSnapshotTestJSON-1323670043 None] Volume volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765 (45dd46a7-a8fe-4b98-a49c-690c8f0d4765): created successfully Jul 11 04:35:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-35228603-e458-4243-9a79-1aedeaa6b65a tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea69d864-7dbb-487c-a91c-ae03fa7b4c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-35228603-e458-4243-9a79-1aedeaa6b65a tempest-VolumesSnapshotTestJSON-1323670043 None] Flow 'volume_create_manager' (4633a6c0-570d-4890-8cc5-1ce495a78dd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:35:45 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-35228603-e458-4243-9a79-1aedeaa6b65a tempest-VolumesSnapshotTestJSON-1323670043 None] Created volume successfully. Jul 11 04:35:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4f31f9f1-c587-4e39-b3ea-ca2605994bc7 tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:35:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4f31f9f1-c587-4e39-b3ea-ca2605994bc7 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:35:46 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-4f31f9f1-c587-4e39-b3ea-ca2605994bc7 tempest-VolumesSnapshotTestJSON-1323670043 None] Creating offline snapshot acb07a5d-9074-421c-b8c1-2ef001018f94 of volume 45dd46a7-a8fe-4b98-a49c-690c8f0d4765 {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:35:46 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[11794ed6-00d9-4ccc-9081-087ca67520b8]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:35:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4f31f9f1-c587-4e39-b3ea-ca2605994bc7 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:46 devstack sudo[99519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765 Jul 11 04:35:46 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:46 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4cbe5fd6-2fe5-4689-a3fe-f617a0235615 tempest-AttachVolumeNegativeTest-930293942 None] Acquiring lock "cinder-591043ca-dd77-4202-bf10-2e61ee35dc7b-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:35:46 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4cbe5fd6-2fe5-4689-a3fe-f617a0235615 tempest-AttachVolumeNegativeTest-930293942 None] Lock "cinder-591043ca-dd77-4202-bf10-2e61ee35dc7b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:35:46 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4cbe5fd6-2fe5-4689-a3fe-f617a0235615 tempest-AttachVolumeNegativeTest-930293942 None] Acquiring lock "cinder-quobyte-591043ca-dd77-4202-bf10-2e61ee35dc7b" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:35:46 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4cbe5fd6-2fe5-4689-a3fe-f617a0235615 tempest-AttachVolumeNegativeTest-930293942 None] Lock "cinder-quobyte-591043ca-dd77-4202-bf10-2e61ee35dc7b" acquired by "delete_volume" :: waited 0.023s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:35:46 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f150efa-b83a-417a-93ff-797b98bf2fdf]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:35:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4cbe5fd6-2fe5-4689-a3fe-f617a0235615 tempest-AttachVolumeNegativeTest-930293942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-591043ca-dd77-4202-bf10-2e61ee35dc7b {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:46 devstack sudo[99521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-591043ca-dd77-4202-bf10-2e61ee35dc7b Jul 11 04:35:46 devstack sudo[99521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:47 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4f31f9f1-c587-4e39-b3ea-ca2605994bc7 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765" returned: 0 in 0.943s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4f31f9f1-c587-4e39-b3ea-ca2605994bc7 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765.acb07a5d-9074-421c-b8c1-2ef001018f94 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:47 devstack sudo[99528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765.acb07a5d-9074-421c-b8c1-2ef001018f94 1G Jul 11 04:35:47 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:47 devstack sudo[99521]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4cbe5fd6-2fe5-4689-a3fe-f617a0235615 tempest-AttachVolumeNegativeTest-930293942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-591043ca-dd77-4202-bf10-2e61ee35dc7b" returned: 0 in 0.841s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4cbe5fd6-2fe5-4689-a3fe-f617a0235615 tempest-AttachVolumeNegativeTest-930293942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-591043ca-dd77-4202-bf10-2e61ee35dc7b {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:47 devstack sudo[99534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-591043ca-dd77-4202-bf10-2e61ee35dc7b Jul 11 04:35:47 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:48 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4f31f9f1-c587-4e39-b3ea-ca2605994bc7 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765.acb07a5d-9074-421c-b8c1-2ef001018f94 1G" returned: 0 in 0.871s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4f31f9f1-c587-4e39-b3ea-ca2605994bc7 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765.acb07a5d-9074-421c-b8c1-2ef001018f94 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:48 devstack sudo[99543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765.acb07a5d-9074-421c-b8c1-2ef001018f94 Jul 11 04:35:48 devstack sudo[99543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:48 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4cbe5fd6-2fe5-4689-a3fe-f617a0235615 tempest-AttachVolumeNegativeTest-930293942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-591043ca-dd77-4202-bf10-2e61ee35dc7b" returned: 0 in 0.714s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:48 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4cbe5fd6-2fe5-4689-a3fe-f617a0235615 tempest-AttachVolumeNegativeTest-930293942 None] Lock "cinder-quobyte-591043ca-dd77-4202-bf10-2e61ee35dc7b" released by "delete_volume" :: held 1.601s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:35:48 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-4cbe5fd6-2fe5-4689-a3fe-f617a0235615 tempest-AttachVolumeNegativeTest-930293942 None] Created reservations ['02fe5c58-616c-4cec-9b8d-7d7517c7bfd8', '09459df6-b176-4e7b-9c94-1537bc6ffde8', 'df100616-90dd-43bb-8e33-5545de711296', '2e8e3ffb-51c2-44ef-91e1-529c741d6c19'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:35:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4cbe5fd6-2fe5-4689-a3fe-f617a0235615 tempest-AttachVolumeNegativeTest-930293942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:35:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4cbe5fd6-2fe5-4689-a3fe-f617a0235615 tempest-AttachVolumeNegativeTest-930293942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:35:48 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4cbe5fd6-2fe5-4689-a3fe-f617a0235615 tempest-AttachVolumeNegativeTest-930293942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:35:48 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4cbe5fd6-2fe5-4689-a3fe-f617a0235615 tempest-AttachVolumeNegativeTest-930293942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:35:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4cbe5fd6-2fe5-4689-a3fe-f617a0235615 tempest-AttachVolumeNegativeTest-930293942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:35:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4cbe5fd6-2fe5-4689-a3fe-f617a0235615 tempest-AttachVolumeNegativeTest-930293942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:48 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:35:48 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:48 devstack sudo[99543]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4f31f9f1-c587-4e39-b3ea-ca2605994bc7 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765.acb07a5d-9074-421c-b8c1-2ef001018f94" returned: 0 in 0.743s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:48 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-4f31f9f1-c587-4e39-b3ea-ca2605994bc7 tempest-VolumesSnapshotTestJSON-1323670043 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765.acb07a5d-9074-421c-b8c1-2ef001018f94 is being set with open permissions: ugo+rw Jul 11 04:35:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4f31f9f1-c587-4e39-b3ea-ca2605994bc7 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765.acb07a5d-9074-421c-b8c1-2ef001018f94 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:48 devstack sudo[99551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765.acb07a5d-9074-421c-b8c1-2ef001018f94 Jul 11 04:35:48 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:49 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d34d5316-cd1e-4747-b119-acd625a6c5ba tempest-AttachVolumeNegativeTest-930293942 None] Acquiring lock "cinder-5fb3e5bb-ab60-44c3-bd5a-8c1dc09ef3e8-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:35:49 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d34d5316-cd1e-4747-b119-acd625a6c5ba tempest-AttachVolumeNegativeTest-930293942 None] Lock "cinder-5fb3e5bb-ab60-44c3-bd5a-8c1dc09ef3e8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:35:49 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d34d5316-cd1e-4747-b119-acd625a6c5ba tempest-AttachVolumeNegativeTest-930293942 None] Acquiring lock "cinder-quobyte-5fb3e5bb-ab60-44c3-bd5a-8c1dc09ef3e8" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:35:49 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d34d5316-cd1e-4747-b119-acd625a6c5ba tempest-AttachVolumeNegativeTest-930293942 None] Lock "cinder-quobyte-5fb3e5bb-ab60-44c3-bd5a-8c1dc09ef3e8" acquired by "delete_volume" :: waited 0.027s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:35:49 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bb8344-d282-41e1-b536-795610d85de9]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:35:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d34d5316-cd1e-4747-b119-acd625a6c5ba tempest-AttachVolumeNegativeTest-930293942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5fb3e5bb-ab60-44c3-bd5a-8c1dc09ef3e8 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:49 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4cbe5fd6-2fe5-4689-a3fe-f617a0235615 tempest-AttachVolumeNegativeTest-930293942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.710s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:49 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-4cbe5fd6-2fe5-4689-a3fe-f617a0235615 tempest-AttachVolumeNegativeTest-930293942 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:35:49 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-4cbe5fd6-2fe5-4689-a3fe-f617a0235615 tempest-AttachVolumeNegativeTest-930293942 None] Deleted volume successfully. Jul 11 04:35:49 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4cbe5fd6-2fe5-4689-a3fe-f617a0235615 tempest-AttachVolumeNegativeTest-930293942 None] Lock "cinder-591043ca-dd77-4202-bf10-2e61ee35dc7b-delete_volume" released by "delete_volume" :: held 2.575s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:35:49 devstack sudo[99554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5fb3e5bb-ab60-44c3-bd5a-8c1dc09ef3e8 Jul 11 04:35:49 devstack sudo[99554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:49 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4f31f9f1-c587-4e39-b3ea-ca2605994bc7 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765.acb07a5d-9074-421c-b8c1-2ef001018f94" returned: 0 in 0.776s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4f31f9f1-c587-4e39-b3ea-ca2605994bc7 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:49 devstack sudo[99557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765.info Jul 11 04:35:49 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:50 devstack sudo[99554]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d34d5316-cd1e-4747-b119-acd625a6c5ba tempest-AttachVolumeNegativeTest-930293942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5fb3e5bb-ab60-44c3-bd5a-8c1dc09ef3e8" returned: 0 in 0.824s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d34d5316-cd1e-4747-b119-acd625a6c5ba tempest-AttachVolumeNegativeTest-930293942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5fb3e5bb-ab60-44c3-bd5a-8c1dc09ef3e8 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:50 devstack sudo[99562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5fb3e5bb-ab60-44c3-bd5a-8c1dc09ef3e8 Jul 11 04:35:50 devstack sudo[99562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:50 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4f31f9f1-c587-4e39-b3ea-ca2605994bc7 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765.info" returned: 0 in 0.691s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:50 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-4f31f9f1-c587-4e39-b3ea-ca2605994bc7 tempest-VolumesSnapshotTestJSON-1323670043 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765.info is being set with open permissions: ugo+rw Jul 11 04:35:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4f31f9f1-c587-4e39-b3ea-ca2605994bc7 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:50 devstack sudo[99565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765.info Jul 11 04:35:50 devstack sudo[99565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:50 devstack sudo[99562]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d34d5316-cd1e-4747-b119-acd625a6c5ba tempest-AttachVolumeNegativeTest-930293942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5fb3e5bb-ab60-44c3-bd5a-8c1dc09ef3e8" returned: 0 in 0.659s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d34d5316-cd1e-4747-b119-acd625a6c5ba tempest-AttachVolumeNegativeTest-930293942 None] Lock "cinder-quobyte-5fb3e5bb-ab60-44c3-bd5a-8c1dc09ef3e8" released by "delete_volume" :: held 1.548s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:35:50 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-d34d5316-cd1e-4747-b119-acd625a6c5ba tempest-AttachVolumeNegativeTest-930293942 None] Created reservations ['9fd4dc31-5a00-4c47-9ec2-ec093bde5c22', 'aedb635c-abbb-468d-978e-d689cefe6a2b', '45e6c19e-1158-4afc-9915-3775d1fde75d', '0c8c7995-ed0c-42fc-90d1-6909cf83ea95'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:35:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d34d5316-cd1e-4747-b119-acd625a6c5ba tempest-AttachVolumeNegativeTest-930293942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:35:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d34d5316-cd1e-4747-b119-acd625a6c5ba tempest-AttachVolumeNegativeTest-930293942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:35:50 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-d34d5316-cd1e-4747-b119-acd625a6c5ba tempest-AttachVolumeNegativeTest-930293942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:35:50 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-d34d5316-cd1e-4747-b119-acd625a6c5ba tempest-AttachVolumeNegativeTest-930293942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:35:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d34d5316-cd1e-4747-b119-acd625a6c5ba tempest-AttachVolumeNegativeTest-930293942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:35:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d34d5316-cd1e-4747-b119-acd625a6c5ba tempest-AttachVolumeNegativeTest-930293942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:50 devstack sudo[99569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:35:50 devstack sudo[99569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:50 devstack sudo[99565]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4f31f9f1-c587-4e39-b3ea-ca2605994bc7 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765.info" returned: 0 in 0.661s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4f31f9f1-c587-4e39-b3ea-ca2605994bc7 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.799s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:35:50 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-4f31f9f1-c587-4e39-b3ea-ca2605994bc7 tempest-VolumesSnapshotTestJSON-1323670043 None] Create snapshot completed successfully Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-0694bb68-b31e-4e54-a88f-65ed83d1a19b tempest-VolumesListAdminTestJSON-1957058011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0694bb68-b31e-4e54-a88f-65ed83d1a19b tempest-VolumesListAdminTestJSON-1957058011 None] Flow 'volume_create_manager' (a81b26f1-619b-49f5-ad5d-65728f86a371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0694bb68-b31e-4e54-a88f-65ed83d1a19b tempest-VolumesListAdminTestJSON-1957058011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (794f3109-f566-4c18-8056-d093ebd0374b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0694bb68-b31e-4e54-a88f-65ed83d1a19b tempest-VolumesListAdminTestJSON-1957058011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (794f3109-f566-4c18-8056-d093ebd0374b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-116020720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7df205c-052e-433b-81a5-998e90806934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8599abc8ba5042cdb904db5bbbb8fe2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:35:51Z,use_quota=True,user_id='6dcd28fd0522434b87bde8ae4e2682a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0694bb68-b31e-4e54-a88f-65ed83d1a19b tempest-VolumesListAdminTestJSON-1957058011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (531963d9-dc9c-4ed5-879e-d95e64b5fbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0694bb68-b31e-4e54-a88f-65ed83d1a19b tempest-VolumesListAdminTestJSON-1957058011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (531963d9-dc9c-4ed5-879e-d95e64b5fbec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0694bb68-b31e-4e54-a88f-65ed83d1a19b tempest-VolumesListAdminTestJSON-1957058011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7876b7f3-ee99-4d58-b651-c732d3eef9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0694bb68-b31e-4e54-a88f-65ed83d1a19b tempest-VolumesListAdminTestJSON-1957058011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7876b7f3-ee99-4d58-b651-c732d3eef9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7df205c-052e-433b-81a5-998e90806934', 'volume_name': 'volume-c7df205c-052e-433b-81a5-998e90806934', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0694bb68-b31e-4e54-a88f-65ed83d1a19b tempest-VolumesListAdminTestJSON-1957058011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8c4fbc3-d17e-4c1a-97d8-aaeba911f87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0694bb68-b31e-4e54-a88f-65ed83d1a19b tempest-VolumesListAdminTestJSON-1957058011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8c4fbc3-d17e-4c1a-97d8-aaeba911f87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0694bb68-b31e-4e54-a88f-65ed83d1a19b tempest-VolumesListAdminTestJSON-1957058011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3233b12-27fb-4d9c-a1cd-0aa49acaa037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:51 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-0694bb68-b31e-4e54-a88f-65ed83d1a19b tempest-VolumesListAdminTestJSON-1957058011 None] Volume c7df205c-052e-433b-81a5-998e90806934: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7df205c-052e-433b-81a5-998e90806934', 'volume_size': 1} Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-0694bb68-b31e-4e54-a88f-65ed83d1a19b tempest-VolumesListAdminTestJSON-1957058011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-0694bb68-b31e-4e54-a88f-65ed83d1a19b tempest-VolumesListAdminTestJSON-1957058011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-0694bb68-b31e-4e54-a88f-65ed83d1a19b tempest-VolumesListAdminTestJSON-1957058011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-116020720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7df205c-052e-433b-81a5-998e90806934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8599abc8ba5042cdb904db5bbbb8fe2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:35:51Z,use_quota=True,user_id='6dcd28fd0522434b87bde8ae4e2682a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-0694bb68-b31e-4e54-a88f-65ed83d1a19b tempest-VolumesListAdminTestJSON-1957058011 None] Creating volume c7df205c-052e-433b-81a5-998e90806934 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-0694bb68-b31e-4e54-a88f-65ed83d1a19b tempest-VolumesListAdminTestJSON-1957058011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-0694bb68-b31e-4e54-a88f-65ed83d1a19b tempest-VolumesListAdminTestJSON-1957058011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-0694bb68-b31e-4e54-a88f-65ed83d1a19b tempest-VolumesListAdminTestJSON-1957058011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-0694bb68-b31e-4e54-a88f-65ed83d1a19b tempest-VolumesListAdminTestJSON-1957058011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-0694bb68-b31e-4e54-a88f-65ed83d1a19b tempest-VolumesListAdminTestJSON-1957058011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-0694bb68-b31e-4e54-a88f-65ed83d1a19b tempest-VolumesListAdminTestJSON-1957058011 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:35:51 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-0694bb68-b31e-4e54-a88f-65ed83d1a19b tempest-VolumesListAdminTestJSON-1957058011 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-0694bb68-b31e-4e54-a88f-65ed83d1a19b tempest-VolumesListAdminTestJSON-1957058011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c7df205c-052e-433b-81a5-998e90806934 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:51 devstack sudo[99572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c7df205c-052e-433b-81a5-998e90806934 1073741824 Jul 11 04:35:51 devstack sudo[99572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-88e07d2a-1aca-4c46-bfe2-fd64ac4253e8 tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "cinder-acb07a5d-9074-421c-b8c1-2ef001018f94-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-88e07d2a-1aca-4c46-bfe2-fd64ac4253e8 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-acb07a5d-9074-421c-b8c1-2ef001018f94-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:35:51 devstack sudo[99569]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-bd696d21-e238-4bc4-bcd3-c3941897ad5e tempest-AttachVolumeNegativeTest-930293942 None] Acquiring lock "cinder-90998e1f-6be1-4fda-8630-c1e9abd1f093-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d34d5316-cd1e-4747-b119-acd625a6c5ba tempest-AttachVolumeNegativeTest-930293942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.795s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-d34d5316-cd1e-4747-b119-acd625a6c5ba tempest-AttachVolumeNegativeTest-930293942 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:35:51 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-d34d5316-cd1e-4747-b119-acd625a6c5ba tempest-AttachVolumeNegativeTest-930293942 None] Deleted volume successfully. Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-bd696d21-e238-4bc4-bcd3-c3941897ad5e tempest-AttachVolumeNegativeTest-930293942 None] Lock "cinder-90998e1f-6be1-4fda-8630-c1e9abd1f093-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d34d5316-cd1e-4747-b119-acd625a6c5ba tempest-AttachVolumeNegativeTest-930293942 None] Lock "cinder-5fb3e5bb-ab60-44c3-bd5a-8c1dc09ef3e8-delete_volume" released by "delete_volume" :: held 2.631s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-88e07d2a-1aca-4c46-bfe2-fd64ac4253e8 tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "cinder-quobyte-45dd46a7-a8fe-4b98-a49c-690c8f0d4765" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-88e07d2a-1aca-4c46-bfe2-fd64ac4253e8 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-quobyte-45dd46a7-a8fe-4b98-a49c-690c8f0d4765" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-88e07d2a-1aca-4c46-bfe2-fd64ac4253e8 tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "cinder-quobyte-acb07a5d-9074-421c-b8c1-2ef001018f94" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-bd696d21-e238-4bc4-bcd3-c3941897ad5e tempest-AttachVolumeNegativeTest-930293942 None] Acquiring lock "cinder-quobyte-90998e1f-6be1-4fda-8630-c1e9abd1f093" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-88e07d2a-1aca-4c46-bfe2-fd64ac4253e8 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-quobyte-acb07a5d-9074-421c-b8c1-2ef001018f94" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-88e07d2a-1aca-4c46-bfe2-fd64ac4253e8 tempest-VolumesSnapshotTestJSON-1323670043 None] Deleting offline snapshot acb07a5d-9074-421c-b8c1-2ef001018f94 of volume 45dd46a7-a8fe-4b98-a49c-690c8f0d4765 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-88e07d2a-1aca-4c46-bfe2-fd64ac4253e8 tempest-VolumesSnapshotTestJSON-1323670043 None] snapshot_file for this snap is: volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765.acb07a5d-9074-421c-b8c1-2ef001018f94 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-bd696d21-e238-4bc4-bcd3-c3941897ad5e tempest-AttachVolumeNegativeTest-930293942 None] Lock "cinder-quobyte-90998e1f-6be1-4fda-8630-c1e9abd1f093" acquired by "delete_volume" :: waited 0.044s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[e078d2e6-0849-4457-8eb9-0832e8285133]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-88e07d2a-1aca-4c46-bfe2-fd64ac4253e8 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765.acb07a5d-9074-421c-b8c1-2ef001018f94 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[9461db19-4fe0-409b-a9b0-64425a57fd36]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:35:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bd696d21-e238-4bc4-bcd3-c3941897ad5e tempest-AttachVolumeNegativeTest-930293942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-90998e1f-6be1-4fda-8630-c1e9abd1f093 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:51 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765.acb07a5d-9074-421c-b8c1-2ef001018f94 Jul 11 04:35:51 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:51 devstack sudo[99576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-90998e1f-6be1-4fda-8630-c1e9abd1f093 Jul 11 04:35:51 devstack sudo[99576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:52 devstack sudo[99572]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-0694bb68-b31e-4e54-a88f-65ed83d1a19b tempest-VolumesListAdminTestJSON-1957058011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c7df205c-052e-433b-81a5-998e90806934 1073741824" returned: 0 in 0.986s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-0694bb68-b31e-4e54-a88f-65ed83d1a19b tempest-VolumesListAdminTestJSON-1957058011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c7df205c-052e-433b-81a5-998e90806934 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:52 devstack sudo[99582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c7df205c-052e-433b-81a5-998e90806934 Jul 11 04:35:52 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:52 devstack sudo[99576]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:52 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-88e07d2a-1aca-4c46-bfe2-fd64ac4253e8 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765.acb07a5d-9074-421c-b8c1-2ef001018f94" returned: 0 in 0.812s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bd696d21-e238-4bc4-bcd3-c3941897ad5e tempest-AttachVolumeNegativeTest-930293942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-90998e1f-6be1-4fda-8630-c1e9abd1f093" returned: 0 in 0.801s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:52 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-88e07d2a-1aca-4c46-bfe2-fd64ac4253e8 tempest-VolumesSnapshotTestJSON-1323670043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:35:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bd696d21-e238-4bc4-bcd3-c3941897ad5e tempest-AttachVolumeNegativeTest-930293942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-90998e1f-6be1-4fda-8630-c1e9abd1f093 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:52 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a4bbf0-d26c-4ac5-9c6a-fcd528a2ba13]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:35:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-88e07d2a-1aca-4c46-bfe2-fd64ac4253e8 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:52 devstack sudo[99590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-90998e1f-6be1-4fda-8630-c1e9abd1f093 Jul 11 04:35:52 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:52 devstack sudo[99591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765 Jul 11 04:35:52 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:53 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-0694bb68-b31e-4e54-a88f-65ed83d1a19b tempest-VolumesListAdminTestJSON-1957058011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c7df205c-052e-433b-81a5-998e90806934" returned: 0 in 0.679s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:53 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-0694bb68-b31e-4e54-a88f-65ed83d1a19b tempest-VolumesListAdminTestJSON-1957058011 None] <== create_volume: return (1714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:35:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-0694bb68-b31e-4e54-a88f-65ed83d1a19b tempest-VolumesListAdminTestJSON-1957058011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:35:53 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=78,cinder:UPDATE=106,cinder:INSERT=22,cinder:DELETE=5 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:35:53 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0694bb68-b31e-4e54-a88f-65ed83d1a19b tempest-VolumesListAdminTestJSON-1957058011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3233b12-27fb-4d9c-a1cd-0aa49acaa037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7df205c-052e-433b-81a5-998e90806934', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:53 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0694bb68-b31e-4e54-a88f-65ed83d1a19b tempest-VolumesListAdminTestJSON-1957058011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (604c9d3a-75b2-4bc7-95cd-76a1f4db796d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:53 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-0694bb68-b31e-4e54-a88f-65ed83d1a19b tempest-VolumesListAdminTestJSON-1957058011 None] Volume volume-c7df205c-052e-433b-81a5-998e90806934 (c7df205c-052e-433b-81a5-998e90806934): created successfully Jul 11 04:35:53 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0694bb68-b31e-4e54-a88f-65ed83d1a19b tempest-VolumesListAdminTestJSON-1957058011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (604c9d3a-75b2-4bc7-95cd-76a1f4db796d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:53 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0694bb68-b31e-4e54-a88f-65ed83d1a19b tempest-VolumesListAdminTestJSON-1957058011 None] Flow 'volume_create_manager' (a81b26f1-619b-49f5-ad5d-65728f86a371) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:35:53 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-0694bb68-b31e-4e54-a88f-65ed83d1a19b tempest-VolumesListAdminTestJSON-1957058011 None] Created volume successfully. Jul 11 04:35:53 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bd696d21-e238-4bc4-bcd3-c3941897ad5e tempest-AttachVolumeNegativeTest-930293942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-90998e1f-6be1-4fda-8630-c1e9abd1f093" returned: 0 in 0.651s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:53 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-bd696d21-e238-4bc4-bcd3-c3941897ad5e tempest-AttachVolumeNegativeTest-930293942 None] Lock "cinder-quobyte-90998e1f-6be1-4fda-8630-c1e9abd1f093" released by "delete_volume" :: held 1.526s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:35:53 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-bd696d21-e238-4bc4-bcd3-c3941897ad5e tempest-AttachVolumeNegativeTest-930293942 None] Created reservations ['48063759-c0e9-427f-ad47-e052fbd1e9fc', '93991ce9-bec3-4a88-b5c2-2cdc628c2592', '1c21416c-a9e6-42e0-840a-da62e73dec16', '895c990c-00ba-48c3-a154-193fd26fc9ce'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:35:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-bd696d21-e238-4bc4-bcd3-c3941897ad5e tempest-AttachVolumeNegativeTest-930293942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:35:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-bd696d21-e238-4bc4-bcd3-c3941897ad5e tempest-AttachVolumeNegativeTest-930293942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:35:53 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-bd696d21-e238-4bc4-bcd3-c3941897ad5e tempest-AttachVolumeNegativeTest-930293942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:35:53 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-bd696d21-e238-4bc4-bcd3-c3941897ad5e tempest-AttachVolumeNegativeTest-930293942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:35:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-bd696d21-e238-4bc4-bcd3-c3941897ad5e tempest-AttachVolumeNegativeTest-930293942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:35:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bd696d21-e238-4bc4-bcd3-c3941897ad5e tempest-AttachVolumeNegativeTest-930293942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:53 devstack sudo[99599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:35:53 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:53 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-88e07d2a-1aca-4c46-bfe2-fd64ac4253e8 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765" returned: 0 in 0.833s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-88e07d2a-1aca-4c46-bfe2-fd64ac4253e8 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765.acb07a5d-9074-421c-b8c1-2ef001018f94 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:53 devstack sudo[99601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765.acb07a5d-9074-421c-b8c1-2ef001018f94 Jul 11 04:35:53 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:54 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-a41a9aea-29b6-47d7-8cf1-dfe4e56634a4 tempest-VolumesListAdminTestJSON-1957058011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:35:54 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a41a9aea-29b6-47d7-8cf1-dfe4e56634a4 tempest-VolumesListAdminTestJSON-1957058011 None] Flow 'volume_create_manager' (056b9f2c-80d1-4300-bc9d-77a9e62b69e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:35:54 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a41a9aea-29b6-47d7-8cf1-dfe4e56634a4 tempest-VolumesListAdminTestJSON-1957058011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12c7f5ac-95eb-4113-964e-7e6af43afd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:54 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a41a9aea-29b6-47d7-8cf1-dfe4e56634a4 tempest-VolumesListAdminTestJSON-1957058011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12c7f5ac-95eb-4113-964e-7e6af43afd10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1278567154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d8dc888-f427-425c-87a7-f92b99586b76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8599abc8ba5042cdb904db5bbbb8fe2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:35:54Z,use_quota=True,user_id='6dcd28fd0522434b87bde8ae4e2682a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:54 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a41a9aea-29b6-47d7-8cf1-dfe4e56634a4 tempest-VolumesListAdminTestJSON-1957058011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3852556f-b794-48aa-a854-fd31eca0033b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:54 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a41a9aea-29b6-47d7-8cf1-dfe4e56634a4 tempest-VolumesListAdminTestJSON-1957058011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3852556f-b794-48aa-a854-fd31eca0033b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:54 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a41a9aea-29b6-47d7-8cf1-dfe4e56634a4 tempest-VolumesListAdminTestJSON-1957058011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a403c3e-b5d3-4c06-9706-66e7f12df3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:54 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a41a9aea-29b6-47d7-8cf1-dfe4e56634a4 tempest-VolumesListAdminTestJSON-1957058011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a403c3e-b5d3-4c06-9706-66e7f12df3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d8dc888-f427-425c-87a7-f92b99586b76', 'volume_name': 'volume-1d8dc888-f427-425c-87a7-f92b99586b76', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:54 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a41a9aea-29b6-47d7-8cf1-dfe4e56634a4 tempest-VolumesListAdminTestJSON-1957058011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9788f3f-ac8a-4888-8d14-0a2c0425d1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:54 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a41a9aea-29b6-47d7-8cf1-dfe4e56634a4 tempest-VolumesListAdminTestJSON-1957058011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9788f3f-ac8a-4888-8d14-0a2c0425d1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:54 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a41a9aea-29b6-47d7-8cf1-dfe4e56634a4 tempest-VolumesListAdminTestJSON-1957058011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e92cc4a-2f9d-4c9b-a117-1179a1aca29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:54 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-a41a9aea-29b6-47d7-8cf1-dfe4e56634a4 tempest-VolumesListAdminTestJSON-1957058011 None] Volume 1d8dc888-f427-425c-87a7-f92b99586b76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d8dc888-f427-425c-87a7-f92b99586b76', 'volume_size': 1} Jul 11 04:35:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a41a9aea-29b6-47d7-8cf1-dfe4e56634a4 tempest-VolumesListAdminTestJSON-1957058011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:35:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a41a9aea-29b6-47d7-8cf1-dfe4e56634a4 tempest-VolumesListAdminTestJSON-1957058011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:35:54 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-a41a9aea-29b6-47d7-8cf1-dfe4e56634a4 tempest-VolumesListAdminTestJSON-1957058011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1278567154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d8dc888-f427-425c-87a7-f92b99586b76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8599abc8ba5042cdb904db5bbbb8fe2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:35:54Z,use_quota=True,user_id='6dcd28fd0522434b87bde8ae4e2682a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:35:54 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-a41a9aea-29b6-47d7-8cf1-dfe4e56634a4 tempest-VolumesListAdminTestJSON-1957058011 None] Creating volume 1d8dc888-f427-425c-87a7-f92b99586b76 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:35:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a41a9aea-29b6-47d7-8cf1-dfe4e56634a4 tempest-VolumesListAdminTestJSON-1957058011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:35:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a41a9aea-29b6-47d7-8cf1-dfe4e56634a4 tempest-VolumesListAdminTestJSON-1957058011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:35:54 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-a41a9aea-29b6-47d7-8cf1-dfe4e56634a4 tempest-VolumesListAdminTestJSON-1957058011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:35:54 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-a41a9aea-29b6-47d7-8cf1-dfe4e56634a4 tempest-VolumesListAdminTestJSON-1957058011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:35:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a41a9aea-29b6-47d7-8cf1-dfe4e56634a4 tempest-VolumesListAdminTestJSON-1957058011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:35:54 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-a41a9aea-29b6-47d7-8cf1-dfe4e56634a4 tempest-VolumesListAdminTestJSON-1957058011 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:35:54 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-a41a9aea-29b6-47d7-8cf1-dfe4e56634a4 tempest-VolumesListAdminTestJSON-1957058011 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:35:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a41a9aea-29b6-47d7-8cf1-dfe4e56634a4 tempest-VolumesListAdminTestJSON-1957058011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1d8dc888-f427-425c-87a7-f92b99586b76 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:54 devstack sudo[99604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1d8dc888-f427-425c-87a7-f92b99586b76 1073741824 Jul 11 04:35:54 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:54 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bd696d21-e238-4bc4-bcd3-c3941897ad5e tempest-AttachVolumeNegativeTest-930293942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.749s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:54 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-bd696d21-e238-4bc4-bcd3-c3941897ad5e tempest-AttachVolumeNegativeTest-930293942 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:35:54 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-bd696d21-e238-4bc4-bcd3-c3941897ad5e tempest-AttachVolumeNegativeTest-930293942 None] Deleted volume successfully. Jul 11 04:35:54 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-bd696d21-e238-4bc4-bcd3-c3941897ad5e tempest-AttachVolumeNegativeTest-930293942 None] Lock "cinder-90998e1f-6be1-4fda-8630-c1e9abd1f093-delete_volume" released by "delete_volume" :: held 2.603s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:35:54 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-88e07d2a-1aca-4c46-bfe2-fd64ac4253e8 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765.acb07a5d-9074-421c-b8c1-2ef001018f94" returned: 0 in 0.862s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-88e07d2a-1aca-4c46-bfe2-fd64ac4253e8 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765.acb07a5d-9074-421c-b8c1-2ef001018f94 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:54 devstack sudo[99614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765.acb07a5d-9074-421c-b8c1-2ef001018f94 Jul 11 04:35:54 devstack sudo[99614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:55 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a41a9aea-29b6-47d7-8cf1-dfe4e56634a4 tempest-VolumesListAdminTestJSON-1957058011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1d8dc888-f427-425c-87a7-f92b99586b76 1073741824" returned: 0 in 0.960s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:55 devstack sudo[99614]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-88e07d2a-1aca-4c46-bfe2-fd64ac4253e8 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765.acb07a5d-9074-421c-b8c1-2ef001018f94" returned: 0 in 0.696s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a41a9aea-29b6-47d7-8cf1-dfe4e56634a4 tempest-VolumesListAdminTestJSON-1957058011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1d8dc888-f427-425c-87a7-f92b99586b76 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:55 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-88e07d2a-1aca-4c46-bfe2-fd64ac4253e8 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-quobyte-acb07a5d-9074-421c-b8c1-2ef001018f94" released by "_delete_snapshot" :: held 3.369s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:35:55 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-88e07d2a-1aca-4c46-bfe2-fd64ac4253e8 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-quobyte-45dd46a7-a8fe-4b98-a49c-690c8f0d4765" released by "delete_snapshot" :: held 3.400s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:35:55 devstack sudo[99621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1d8dc888-f427-425c-87a7-f92b99586b76 Jul 11 04:35:55 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:55 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-88e07d2a-1aca-4c46-bfe2-fd64ac4253e8 tempest-VolumesSnapshotTestJSON-1323670043 None] Created reservations ['4236a5df-be6f-4f9a-89a2-d85229c1d676', '7e9a9c44-27d9-4103-92ff-8fa180f9d332', 'e78adc52-9f65-44bd-bdc4-fec05f8094bf', '87f20d2b-be5c-43cd-aa9c-01a6aa282ac4'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:35:55 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-88e07d2a-1aca-4c46-bfe2-fd64ac4253e8 tempest-VolumesSnapshotTestJSON-1323670043 None] Delete snapshot completed successfully. Jul 11 04:35:55 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-88e07d2a-1aca-4c46-bfe2-fd64ac4253e8 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-acb07a5d-9074-421c-b8c1-2ef001018f94-delete_snapshot" released by "delete_snapshot" :: held 3.697s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:35:55 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a41a9aea-29b6-47d7-8cf1-dfe4e56634a4 tempest-VolumesListAdminTestJSON-1957058011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1d8dc888-f427-425c-87a7-f92b99586b76" returned: 0 in 0.696s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:55 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-a41a9aea-29b6-47d7-8cf1-dfe4e56634a4 tempest-VolumesListAdminTestJSON-1957058011 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:35:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a41a9aea-29b6-47d7-8cf1-dfe4e56634a4 tempest-VolumesListAdminTestJSON-1957058011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:35:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a41a9aea-29b6-47d7-8cf1-dfe4e56634a4 tempest-VolumesListAdminTestJSON-1957058011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e92cc4a-2f9d-4c9b-a117-1179a1aca29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d8dc888-f427-425c-87a7-f92b99586b76', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a41a9aea-29b6-47d7-8cf1-dfe4e56634a4 tempest-VolumesListAdminTestJSON-1957058011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (645c14d8-3fae-44b0-a39e-b51364ef3ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:55 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-a41a9aea-29b6-47d7-8cf1-dfe4e56634a4 tempest-VolumesListAdminTestJSON-1957058011 None] Volume volume-1d8dc888-f427-425c-87a7-f92b99586b76 (1d8dc888-f427-425c-87a7-f92b99586b76): created successfully Jul 11 04:35:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a41a9aea-29b6-47d7-8cf1-dfe4e56634a4 tempest-VolumesListAdminTestJSON-1957058011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (645c14d8-3fae-44b0-a39e-b51364ef3ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a41a9aea-29b6-47d7-8cf1-dfe4e56634a4 tempest-VolumesListAdminTestJSON-1957058011 None] Flow 'volume_create_manager' (056b9f2c-80d1-4300-bc9d-77a9e62b69e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:35:55 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-a41a9aea-29b6-47d7-8cf1-dfe4e56634a4 tempest-VolumesListAdminTestJSON-1957058011 None] Created volume successfully. Jul 11 04:35:56 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ff6b841-664c-40de-930b-786b6fe70bb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:35:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4ff6b841-664c-40de-930b-786b6fe70bb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Flow 'volume_create_manager' (8d38492e-ba6a-4d3f-be43-ac08f4f72b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:35:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4ff6b841-664c-40de-930b-786b6fe70bb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab22b734-0cf6-41fb-b613-416e03df45df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4ff6b841-664c-40de-930b-786b6fe70bb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab22b734-0cf6-41fb-b613-416e03df45df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1852313697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e7bf50c-b20e-4dab-9a2c-2be2b21a556d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d7c406e07ce4db495527579b5d7acbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:35:56Z,use_quota=True,user_id='3bdc313bd5cd43f8bb404a890cb0f49c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4ff6b841-664c-40de-930b-786b6fe70bb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe9b104b-1157-42ad-8a6a-f7f46f99a91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4ff6b841-664c-40de-930b-786b6fe70bb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe9b104b-1157-42ad-8a6a-f7f46f99a91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4ff6b841-664c-40de-930b-786b6fe70bb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d285fe7-40b2-4bc6-bad5-ad1f62a6e53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4ff6b841-664c-40de-930b-786b6fe70bb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d285fe7-40b2-4bc6-bad5-ad1f62a6e53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e7bf50c-b20e-4dab-9a2c-2be2b21a556d', 'volume_name': 'volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4ff6b841-664c-40de-930b-786b6fe70bb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10db44eb-1094-4a72-b176-5ec63dc74766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4ff6b841-664c-40de-930b-786b6fe70bb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10db44eb-1094-4a72-b176-5ec63dc74766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4ff6b841-664c-40de-930b-786b6fe70bb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e79373f-5819-429e-8846-f9b8586a2f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:56 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-4ff6b841-664c-40de-930b-786b6fe70bb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Volume 6e7bf50c-b20e-4dab-9a2c-2be2b21a556d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d', 'volume_size': 1} Jul 11 04:35:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4ff6b841-664c-40de-930b-786b6fe70bb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:35:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4ff6b841-664c-40de-930b-786b6fe70bb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:35:56 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4ff6b841-664c-40de-930b-786b6fe70bb0 tempest-VolumesSnapshotTestJSON-1323670043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1852313697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e7bf50c-b20e-4dab-9a2c-2be2b21a556d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d7c406e07ce4db495527579b5d7acbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:35:56Z,use_quota=True,user_id='3bdc313bd5cd43f8bb404a890cb0f49c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:35:56 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-4ff6b841-664c-40de-930b-786b6fe70bb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Creating volume 6e7bf50c-b20e-4dab-9a2c-2be2b21a556d {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:35:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4ff6b841-664c-40de-930b-786b6fe70bb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:35:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4ff6b841-664c-40de-930b-786b6fe70bb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:35:56 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4ff6b841-664c-40de-930b-786b6fe70bb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:35:56 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4ff6b841-664c-40de-930b-786b6fe70bb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:35:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4ff6b841-664c-40de-930b-786b6fe70bb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:35:56 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4ff6b841-664c-40de-930b-786b6fe70bb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:35:56 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-4ff6b841-664c-40de-930b-786b6fe70bb0 tempest-VolumesSnapshotTestJSON-1323670043 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:35:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4ff6b841-664c-40de-930b-786b6fe70bb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:56 devstack sudo[99626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d 1073741824 Jul 11 04:35:56 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:56 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b3dcb03-ef33-4e0c-8c0b-c5fd285edb14 tempest-VolumesListAdminTestJSON-1957058011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:35:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9b3dcb03-ef33-4e0c-8c0b-c5fd285edb14 tempest-VolumesListAdminTestJSON-1957058011 None] Flow 'volume_create_manager' (ab736145-9cf8-4d6c-a5cd-fcc4e313742c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:35:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9b3dcb03-ef33-4e0c-8c0b-c5fd285edb14 tempest-VolumesListAdminTestJSON-1957058011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beb95bae-9bb2-4824-9998-21abe3fe372c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9b3dcb03-ef33-4e0c-8c0b-c5fd285edb14 tempest-VolumesListAdminTestJSON-1957058011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beb95bae-9bb2-4824-9998-21abe3fe372c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1455835915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ba9678b-6323-4f0f-8c6b-cc939145b8b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8599abc8ba5042cdb904db5bbbb8fe2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:35:57Z,use_quota=True,user_id='6dcd28fd0522434b87bde8ae4e2682a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9b3dcb03-ef33-4e0c-8c0b-c5fd285edb14 tempest-VolumesListAdminTestJSON-1957058011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2783368-243e-4c52-a9ee-b10e7d7df04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9b3dcb03-ef33-4e0c-8c0b-c5fd285edb14 tempest-VolumesListAdminTestJSON-1957058011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2783368-243e-4c52-a9ee-b10e7d7df04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9b3dcb03-ef33-4e0c-8c0b-c5fd285edb14 tempest-VolumesListAdminTestJSON-1957058011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aa4514c-899e-48cf-b261-25f798b7055a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9b3dcb03-ef33-4e0c-8c0b-c5fd285edb14 tempest-VolumesListAdminTestJSON-1957058011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aa4514c-899e-48cf-b261-25f798b7055a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ba9678b-6323-4f0f-8c6b-cc939145b8b0', 'volume_name': 'volume-3ba9678b-6323-4f0f-8c6b-cc939145b8b0', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9b3dcb03-ef33-4e0c-8c0b-c5fd285edb14 tempest-VolumesListAdminTestJSON-1957058011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cad3dc24-988f-4d99-804c-c01d0825f8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9b3dcb03-ef33-4e0c-8c0b-c5fd285edb14 tempest-VolumesListAdminTestJSON-1957058011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cad3dc24-988f-4d99-804c-c01d0825f8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9b3dcb03-ef33-4e0c-8c0b-c5fd285edb14 tempest-VolumesListAdminTestJSON-1957058011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2bfa904-23c1-4a50-9682-e3dc020fe9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:56 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-9b3dcb03-ef33-4e0c-8c0b-c5fd285edb14 tempest-VolumesListAdminTestJSON-1957058011 None] Volume 3ba9678b-6323-4f0f-8c6b-cc939145b8b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ba9678b-6323-4f0f-8c6b-cc939145b8b0', 'volume_size': 1} Jul 11 04:35:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9b3dcb03-ef33-4e0c-8c0b-c5fd285edb14 tempest-VolumesListAdminTestJSON-1957058011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:35:57 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4ff6b841-664c-40de-930b-786b6fe70bb0 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d 1073741824" returned: 0 in 0.904s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4ff6b841-664c-40de-930b-786b6fe70bb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:57 devstack sudo[99632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d Jul 11 04:35:57 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:58 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4ff6b841-664c-40de-930b-786b6fe70bb0 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d" returned: 0 in 0.673s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4ff6b841-664c-40de-930b-786b6fe70bb0 tempest-VolumesSnapshotTestJSON-1323670043 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:35:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4ff6b841-664c-40de-930b-786b6fe70bb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:35:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9b3dcb03-ef33-4e0c-8c0b-c5fd285edb14 tempest-VolumesListAdminTestJSON-1957058011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.376s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:35:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-9b3dcb03-ef33-4e0c-8c0b-c5fd285edb14 tempest-VolumesListAdminTestJSON-1957058011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1455835915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ba9678b-6323-4f0f-8c6b-cc939145b8b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8599abc8ba5042cdb904db5bbbb8fe2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:35:57Z,use_quota=True,user_id='6dcd28fd0522434b87bde8ae4e2682a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:35:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-9b3dcb03-ef33-4e0c-8c0b-c5fd285edb14 tempest-VolumesListAdminTestJSON-1957058011 None] Creating volume 3ba9678b-6323-4f0f-8c6b-cc939145b8b0 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:35:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9b3dcb03-ef33-4e0c-8c0b-c5fd285edb14 tempest-VolumesListAdminTestJSON-1957058011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:35:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9b3dcb03-ef33-4e0c-8c0b-c5fd285edb14 tempest-VolumesListAdminTestJSON-1957058011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:35:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-9b3dcb03-ef33-4e0c-8c0b-c5fd285edb14 tempest-VolumesListAdminTestJSON-1957058011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:35:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-9b3dcb03-ef33-4e0c-8c0b-c5fd285edb14 tempest-VolumesListAdminTestJSON-1957058011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:35:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9b3dcb03-ef33-4e0c-8c0b-c5fd285edb14 tempest-VolumesListAdminTestJSON-1957058011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:35:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-9b3dcb03-ef33-4e0c-8c0b-c5fd285edb14 tempest-VolumesListAdminTestJSON-1957058011 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:35:58 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-9b3dcb03-ef33-4e0c-8c0b-c5fd285edb14 tempest-VolumesListAdminTestJSON-1957058011 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:35:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9b3dcb03-ef33-4e0c-8c0b-c5fd285edb14 tempest-VolumesListAdminTestJSON-1957058011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3ba9678b-6323-4f0f-8c6b-cc939145b8b0 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4ff6b841-664c-40de-930b-786b6fe70bb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e79373f-5819-429e-8846-f9b8586a2f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:58 devstack sudo[99636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3ba9678b-6323-4f0f-8c6b-cc939145b8b0 1073741824 Jul 11 04:35:58 devstack sudo[99636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4ff6b841-664c-40de-930b-786b6fe70bb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88a5bb1d-a0a3-4809-b5e7-b8c15a907102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:58 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-4ff6b841-664c-40de-930b-786b6fe70bb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Volume volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d (6e7bf50c-b20e-4dab-9a2c-2be2b21a556d): created successfully Jul 11 04:35:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4ff6b841-664c-40de-930b-786b6fe70bb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88a5bb1d-a0a3-4809-b5e7-b8c15a907102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4ff6b841-664c-40de-930b-786b6fe70bb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Flow 'volume_create_manager' (8d38492e-ba6a-4d3f-be43-ac08f4f72b8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:35:58 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-4ff6b841-664c-40de-930b-786b6fe70bb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Created volume successfully. Jul 11 04:35:58 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=98,cinder:UPDATE=120,cinder:INSERT=28,cinder:DELETE=15 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:35:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d8d01b7b-fb56-4f7a-8527-0d051f7c6788 tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:35:59 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:35:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:35:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:35:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:35:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:35:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:35:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:59 devstack sudo[99636]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:59 devstack sudo[99642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:35:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9b3dcb03-ef33-4e0c-8c0b-c5fd285edb14 tempest-VolumesListAdminTestJSON-1957058011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3ba9678b-6323-4f0f-8c6b-cc939145b8b0 1073741824" returned: 0 in 0.919s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:59 devstack sudo[99642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9b3dcb03-ef33-4e0c-8c0b-c5fd285edb14 tempest-VolumesListAdminTestJSON-1957058011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3ba9678b-6323-4f0f-8c6b-cc939145b8b0 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:35:59 devstack sudo[99644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3ba9678b-6323-4f0f-8c6b-cc939145b8b0 Jul 11 04:35:59 devstack sudo[99644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:35:59 devstack sudo[99642]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.708s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:59 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:35:59 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager._thread_info {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:35:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread count: 28 {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:35:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread info: [<_MainThread(MainThread, started 124675027595392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:35:59 devstack sudo[99644]: pam_unix(sudo:session): session closed for user root Jul 11 04:35:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9b3dcb03-ef33-4e0c-8c0b-c5fd285edb14 tempest-VolumesListAdminTestJSON-1957058011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3ba9678b-6323-4f0f-8c6b-cc939145b8b0" returned: 0 in 0.733s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:35:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-9b3dcb03-ef33-4e0c-8c0b-c5fd285edb14 tempest-VolumesListAdminTestJSON-1957058011 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:35:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9b3dcb03-ef33-4e0c-8c0b-c5fd285edb14 tempest-VolumesListAdminTestJSON-1957058011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.699s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:35:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d8d01b7b-fb56-4f7a-8527-0d051f7c6788 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.211s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:35:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9b3dcb03-ef33-4e0c-8c0b-c5fd285edb14 tempest-VolumesListAdminTestJSON-1957058011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2bfa904-23c1-4a50-9682-e3dc020fe9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ba9678b-6323-4f0f-8c6b-cc939145b8b0', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:35:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9b3dcb03-ef33-4e0c-8c0b-c5fd285edb14 tempest-VolumesListAdminTestJSON-1957058011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bf1ce1f-ace8-4dcf-a388-fcca46f738bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:35:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-d8d01b7b-fb56-4f7a-8527-0d051f7c6788 tempest-VolumesSnapshotTestJSON-1323670043 None] Creating offline snapshot 36085e96-09e5-4d02-b20e-3624c7c45a7a of volume 6e7bf50c-b20e-4dab-9a2c-2be2b21a556d {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:36:00 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-9b3dcb03-ef33-4e0c-8c0b-c5fd285edb14 tempest-VolumesListAdminTestJSON-1957058011 None] Volume volume-3ba9678b-6323-4f0f-8c6b-cc939145b8b0 (3ba9678b-6323-4f0f-8c6b-cc939145b8b0): created successfully Jul 11 04:36:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9b3dcb03-ef33-4e0c-8c0b-c5fd285edb14 tempest-VolumesListAdminTestJSON-1957058011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bf1ce1f-ace8-4dcf-a388-fcca46f738bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-9b3dcb03-ef33-4e0c-8c0b-c5fd285edb14 tempest-VolumesListAdminTestJSON-1957058011 None] Flow 'volume_create_manager' (ab736145-9cf8-4d6c-a5cd-fcc4e313742c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:36:00 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c5bbde-6c10-4323-bc63-be655f9b158d]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:36:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d8d01b7b-fb56-4f7a-8527-0d051f7c6788 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:00 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-9b3dcb03-ef33-4e0c-8c0b-c5fd285edb14 tempest-VolumesListAdminTestJSON-1957058011 None] Created volume successfully. Jul 11 04:36:00 devstack sudo[99648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d Jul 11 04:36:00 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:00 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d8d01b7b-fb56-4f7a-8527-0d051f7c6788 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d" returned: 0 in 0.786s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d8d01b7b-fb56-4f7a-8527-0d051f7c6788 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d.36085e96-09e5-4d02-b20e-3624c7c45a7a 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:00 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d.36085e96-09e5-4d02-b20e-3624c7c45a7a 1G Jul 11 04:36:00 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:01 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [req-ee1a2aec-36cb-4657-adfd-5ccc07e87a19 req-2ee2a7ae-ced0-4f1d-9138-1ef24c3189f6 tempest-VolumesSnapshotsTestJSON-1566251898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:36:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-ee1a2aec-36cb-4657-adfd-5ccc07e87a19 req-2ee2a7ae-ced0-4f1d-9138-1ef24c3189f6 tempest-VolumesSnapshotsTestJSON-1566251898 None] Flow 'volume_create_manager' (a7f6bb2c-e38c-4bd1-bd41-834916be4846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:36:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-ee1a2aec-36cb-4657-adfd-5ccc07e87a19 req-2ee2a7ae-ced0-4f1d-9138-1ef24c3189f6 tempest-VolumesSnapshotsTestJSON-1566251898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3a2bb25-ead3-41b9-9cb7-eabff3b193b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-ee1a2aec-36cb-4657-adfd-5ccc07e87a19 req-2ee2a7ae-ced0-4f1d-9138-1ef24c3189f6 tempest-VolumesSnapshotsTestJSON-1566251898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3a2bb25-ead3-41b9-9cb7-eabff3b193b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1784844256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60e52110-4540-4f21-bf2a-be9e503b4afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='521108e7eebe414c8ad55ae4afb98b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:36:01Z,use_quota=True,user_id='3f75d67c7ef044c1a7a9e63fdded7f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-ee1a2aec-36cb-4657-adfd-5ccc07e87a19 req-2ee2a7ae-ced0-4f1d-9138-1ef24c3189f6 tempest-VolumesSnapshotsTestJSON-1566251898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9959506f-fd9a-41eb-83d7-ae8fc6725750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-ee1a2aec-36cb-4657-adfd-5ccc07e87a19 req-2ee2a7ae-ced0-4f1d-9138-1ef24c3189f6 tempest-VolumesSnapshotsTestJSON-1566251898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9959506f-fd9a-41eb-83d7-ae8fc6725750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-ee1a2aec-36cb-4657-adfd-5ccc07e87a19 req-2ee2a7ae-ced0-4f1d-9138-1ef24c3189f6 tempest-VolumesSnapshotsTestJSON-1566251898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68dce2cb-2797-4d4a-8504-828df776653d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-ee1a2aec-36cb-4657-adfd-5ccc07e87a19 req-2ee2a7ae-ced0-4f1d-9138-1ef24c3189f6 tempest-VolumesSnapshotsTestJSON-1566251898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68dce2cb-2797-4d4a-8504-828df776653d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60e52110-4540-4f21-bf2a-be9e503b4afe', 'volume_name': 'volume-60e52110-4540-4f21-bf2a-be9e503b4afe', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-ee1a2aec-36cb-4657-adfd-5ccc07e87a19 req-2ee2a7ae-ced0-4f1d-9138-1ef24c3189f6 tempest-VolumesSnapshotsTestJSON-1566251898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d1a17cc-03b3-47bd-b598-c8145767f596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-ee1a2aec-36cb-4657-adfd-5ccc07e87a19 req-2ee2a7ae-ced0-4f1d-9138-1ef24c3189f6 tempest-VolumesSnapshotsTestJSON-1566251898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d1a17cc-03b3-47bd-b598-c8145767f596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-ee1a2aec-36cb-4657-adfd-5ccc07e87a19 req-2ee2a7ae-ced0-4f1d-9138-1ef24c3189f6 tempest-VolumesSnapshotsTestJSON-1566251898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce11cecf-5033-4510-8ff2-6a4c304fc802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:01 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [req-ee1a2aec-36cb-4657-adfd-5ccc07e87a19 req-2ee2a7ae-ced0-4f1d-9138-1ef24c3189f6 tempest-VolumesSnapshotsTestJSON-1566251898 None] Volume 60e52110-4540-4f21-bf2a-be9e503b4afe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60e52110-4540-4f21-bf2a-be9e503b4afe', 'volume_size': 1} Jul 11 04:36:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-ee1a2aec-36cb-4657-adfd-5ccc07e87a19 req-2ee2a7ae-ced0-4f1d-9138-1ef24c3189f6 tempest-VolumesSnapshotsTestJSON-1566251898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:36:01 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d8d01b7b-fb56-4f7a-8527-0d051f7c6788 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d.36085e96-09e5-4d02-b20e-3624c7c45a7a 1G" returned: 0 in 0.892s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d8d01b7b-fb56-4f7a-8527-0d051f7c6788 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d.36085e96-09e5-4d02-b20e-3624c7c45a7a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:01 devstack sudo[99659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d.36085e96-09e5-4d02-b20e-3624c7c45a7a Jul 11 04:36:01 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:01 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-85e7b3c2-9272-4b36-b3b3-4cb58038f394 tempest-VolumesListAdminTestJSON-527160316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:36:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-85e7b3c2-9272-4b36-b3b3-4cb58038f394 tempest-VolumesListAdminTestJSON-527160316 None] Flow 'volume_create_manager' (e7569d16-dedb-459c-9065-7046f939efd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:36:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-85e7b3c2-9272-4b36-b3b3-4cb58038f394 tempest-VolumesListAdminTestJSON-527160316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c78564-164c-4133-8bc7-37a48efe68f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-85e7b3c2-9272-4b36-b3b3-4cb58038f394 tempest-VolumesListAdminTestJSON-527160316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c78564-164c-4133-8bc7-37a48efe68f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c76318e-0b82-4df8-9111-06dc8649a9a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83128e4f64a24482a21248c5d0486604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:36:02Z,use_quota=True,user_id='93754e39cf8c429f80b0a5a071aec18d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-85e7b3c2-9272-4b36-b3b3-4cb58038f394 tempest-VolumesListAdminTestJSON-527160316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef2a65f8-d2dc-4427-b341-ff24b5fb4dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-85e7b3c2-9272-4b36-b3b3-4cb58038f394 tempest-VolumesListAdminTestJSON-527160316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef2a65f8-d2dc-4427-b341-ff24b5fb4dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-85e7b3c2-9272-4b36-b3b3-4cb58038f394 tempest-VolumesListAdminTestJSON-527160316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3bb0f07-4b16-494a-8893-87726ce82d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-85e7b3c2-9272-4b36-b3b3-4cb58038f394 tempest-VolumesListAdminTestJSON-527160316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3bb0f07-4b16-494a-8893-87726ce82d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c76318e-0b82-4df8-9111-06dc8649a9a9', 'volume_name': 'volume-8c76318e-0b82-4df8-9111-06dc8649a9a9', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-85e7b3c2-9272-4b36-b3b3-4cb58038f394 tempest-VolumesListAdminTestJSON-527160316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ed338bc-d532-4feb-945d-1b9b81da1b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-85e7b3c2-9272-4b36-b3b3-4cb58038f394 tempest-VolumesListAdminTestJSON-527160316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ed338bc-d532-4feb-945d-1b9b81da1b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-85e7b3c2-9272-4b36-b3b3-4cb58038f394 tempest-VolumesListAdminTestJSON-527160316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09c7f241-96dc-4477-8a92-b6057f9f0ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:01 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-85e7b3c2-9272-4b36-b3b3-4cb58038f394 tempest-VolumesListAdminTestJSON-527160316 None] Volume 8c76318e-0b82-4df8-9111-06dc8649a9a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c76318e-0b82-4df8-9111-06dc8649a9a9', 'volume_size': 1} Jul 11 04:36:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-85e7b3c2-9272-4b36-b3b3-4cb58038f394 tempest-VolumesListAdminTestJSON-527160316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:36:02 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d8d01b7b-fb56-4f7a-8527-0d051f7c6788 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d.36085e96-09e5-4d02-b20e-3624c7c45a7a" returned: 0 in 0.720s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:02 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-d8d01b7b-fb56-4f7a-8527-0d051f7c6788 tempest-VolumesSnapshotTestJSON-1323670043 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d.36085e96-09e5-4d02-b20e-3624c7c45a7a is being set with open permissions: ugo+rw Jul 11 04:36:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d8d01b7b-fb56-4f7a-8527-0d051f7c6788 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d.36085e96-09e5-4d02-b20e-3624c7c45a7a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:02 devstack sudo[99665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d.36085e96-09e5-4d02-b20e-3624c7c45a7a Jul 11 04:36:02 devstack sudo[99665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:03 devstack sudo[99665]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d8d01b7b-fb56-4f7a-8527-0d051f7c6788 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d.36085e96-09e5-4d02-b20e-3624c7c45a7a" returned: 0 in 0.645s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d8d01b7b-fb56-4f7a-8527-0d051f7c6788 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:03 devstack sudo[99668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d.info Jul 11 04:36:03 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:03 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d8d01b7b-fb56-4f7a-8527-0d051f7c6788 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d.info" returned: 0 in 0.658s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:03 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-d8d01b7b-fb56-4f7a-8527-0d051f7c6788 tempest-VolumesSnapshotTestJSON-1323670043 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d.info is being set with open permissions: ugo+rw Jul 11 04:36:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d8d01b7b-fb56-4f7a-8527-0d051f7c6788 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:03 devstack sudo[99707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d.info Jul 11 04:36:03 devstack sudo[99707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:04 devstack sudo[99707]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d8d01b7b-fb56-4f7a-8527-0d051f7c6788 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d.info" returned: 0 in 0.616s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d8d01b7b-fb56-4f7a-8527-0d051f7c6788 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.430s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:36:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-ee1a2aec-36cb-4657-adfd-5ccc07e87a19 req-2ee2a7ae-ced0-4f1d-9138-1ef24c3189f6 tempest-VolumesSnapshotsTestJSON-1566251898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.980s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:36:04 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [req-ee1a2aec-36cb-4657-adfd-5ccc07e87a19 req-2ee2a7ae-ced0-4f1d-9138-1ef24c3189f6 tempest-VolumesSnapshotsTestJSON-1566251898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1784844256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60e52110-4540-4f21-bf2a-be9e503b4afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='521108e7eebe414c8ad55ae4afb98b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:36:01Z,use_quota=True,user_id='3f75d67c7ef044c1a7a9e63fdded7f40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:36:04 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [req-ee1a2aec-36cb-4657-adfd-5ccc07e87a19 req-2ee2a7ae-ced0-4f1d-9138-1ef24c3189f6 tempest-VolumesSnapshotsTestJSON-1566251898 None] Creating volume 60e52110-4540-4f21-bf2a-be9e503b4afe {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:36:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-ee1a2aec-36cb-4657-adfd-5ccc07e87a19 req-2ee2a7ae-ced0-4f1d-9138-1ef24c3189f6 tempest-VolumesSnapshotsTestJSON-1566251898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:36:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-ee1a2aec-36cb-4657-adfd-5ccc07e87a19 req-2ee2a7ae-ced0-4f1d-9138-1ef24c3189f6 tempest-VolumesSnapshotsTestJSON-1566251898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:36:04 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [req-ee1a2aec-36cb-4657-adfd-5ccc07e87a19 req-2ee2a7ae-ced0-4f1d-9138-1ef24c3189f6 tempest-VolumesSnapshotsTestJSON-1566251898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:36:04 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [req-ee1a2aec-36cb-4657-adfd-5ccc07e87a19 req-2ee2a7ae-ced0-4f1d-9138-1ef24c3189f6 tempest-VolumesSnapshotsTestJSON-1566251898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:36:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-ee1a2aec-36cb-4657-adfd-5ccc07e87a19 req-2ee2a7ae-ced0-4f1d-9138-1ef24c3189f6 tempest-VolumesSnapshotsTestJSON-1566251898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:36:04 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [req-ee1a2aec-36cb-4657-adfd-5ccc07e87a19 req-2ee2a7ae-ced0-4f1d-9138-1ef24c3189f6 tempest-VolumesSnapshotsTestJSON-1566251898 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:36:04 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [req-ee1a2aec-36cb-4657-adfd-5ccc07e87a19 req-2ee2a7ae-ced0-4f1d-9138-1ef24c3189f6 tempest-VolumesSnapshotsTestJSON-1566251898 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:36:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-ee1a2aec-36cb-4657-adfd-5ccc07e87a19 req-2ee2a7ae-ced0-4f1d-9138-1ef24c3189f6 tempest-VolumesSnapshotsTestJSON-1566251898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:04 devstack sudo[99710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe 1073741824 Jul 11 04:36:04 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:04 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-d8d01b7b-fb56-4f7a-8527-0d051f7c6788 tempest-VolumesSnapshotTestJSON-1323670043 None] Create snapshot completed successfully Jul 11 04:36:05 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-ee1a2aec-36cb-4657-adfd-5ccc07e87a19 req-2ee2a7ae-ced0-4f1d-9138-1ef24c3189f6 tempest-VolumesSnapshotsTestJSON-1566251898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe 1073741824" returned: 0 in 0.825s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-ee1a2aec-36cb-4657-adfd-5ccc07e87a19 req-2ee2a7ae-ced0-4f1d-9138-1ef24c3189f6 tempest-VolumesSnapshotsTestJSON-1566251898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:05 devstack sudo[99716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe Jul 11 04:36:05 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:05 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:36:05 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Flow 'volume_create_manager' (a8ada03e-b35f-4533-b5d1-5e8246e5795f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:36:05 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67186692-4533-4feb-a11c-877525b550ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:05 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67186692-4533-4feb-a11c-877525b550ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-724877299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=368233ae-99f6-4318-8495-0b59c6cc7e57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d7c406e07ce4db495527579b5d7acbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:36:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=36085e96-09e5-4d02-b20e-3624c7c45a7a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:36:06Z,use_quota=True,user_id='3bdc313bd5cd43f8bb404a890cb0f49c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:05 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2821207-3fa6-497d-b1a4-ddf8021ef413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:05 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2821207-3fa6-497d-b1a4-ddf8021ef413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:05 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc7c0d5f-182a-43f6-8d0b-1febe3c4ffd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:05 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc7c0d5f-182a-43f6-8d0b-1febe3c4ffd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '368233ae-99f6-4318-8495-0b59c6cc7e57', 'volume_name': 'volume-368233ae-99f6-4318-8495-0b59c6cc7e57', 'volume_size': 2, 'snapshot_id': '36085e96-09e5-4d02-b20e-3624c7c45a7a'}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:05 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cf438e1-6ef2-48aa-8821-676a93a08582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:05 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cf438e1-6ef2-48aa-8821-676a93a08582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:05 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (743ddc4a-49a1-4b10-b626-0f91e24b0a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:05 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Volume 368233ae-99f6-4318-8495-0b59c6cc7e57: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-368233ae-99f6-4318-8495-0b59c6cc7e57', 'volume_size': 2, 'snapshot_id': '36085e96-09e5-4d02-b20e-3624c7c45a7a'} Jul 11 04:36:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:36:05 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-ee1a2aec-36cb-4657-adfd-5ccc07e87a19 req-2ee2a7ae-ced0-4f1d-9138-1ef24c3189f6 tempest-VolumesSnapshotsTestJSON-1566251898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe" returned: 0 in 0.657s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:05 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [req-ee1a2aec-36cb-4657-adfd-5ccc07e87a19 req-2ee2a7ae-ced0-4f1d-9138-1ef24c3189f6 tempest-VolumesSnapshotsTestJSON-1566251898 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:36:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-ee1a2aec-36cb-4657-adfd-5ccc07e87a19 req-2ee2a7ae-ced0-4f1d-9138-1ef24c3189f6 tempest-VolumesSnapshotsTestJSON-1566251898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:36:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-85e7b3c2-9272-4b36-b3b3-4cb58038f394 tempest-VolumesListAdminTestJSON-527160316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.968s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:36:05 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-85e7b3c2-9272-4b36-b3b3-4cb58038f394 tempest-VolumesListAdminTestJSON-527160316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c76318e-0b82-4df8-9111-06dc8649a9a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83128e4f64a24482a21248c5d0486604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:36:02Z,use_quota=True,user_id='93754e39cf8c429f80b0a5a071aec18d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:36:05 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-85e7b3c2-9272-4b36-b3b3-4cb58038f394 tempest-VolumesListAdminTestJSON-527160316 None] Creating volume 8c76318e-0b82-4df8-9111-06dc8649a9a9 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:36:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-85e7b3c2-9272-4b36-b3b3-4cb58038f394 tempest-VolumesListAdminTestJSON-527160316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:36:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-85e7b3c2-9272-4b36-b3b3-4cb58038f394 tempest-VolumesListAdminTestJSON-527160316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:36:05 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-85e7b3c2-9272-4b36-b3b3-4cb58038f394 tempest-VolumesListAdminTestJSON-527160316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:36:05 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-85e7b3c2-9272-4b36-b3b3-4cb58038f394 tempest-VolumesListAdminTestJSON-527160316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:36:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-85e7b3c2-9272-4b36-b3b3-4cb58038f394 tempest-VolumesListAdminTestJSON-527160316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:36:05 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-85e7b3c2-9272-4b36-b3b3-4cb58038f394 tempest-VolumesListAdminTestJSON-527160316 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:36:05 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-85e7b3c2-9272-4b36-b3b3-4cb58038f394 tempest-VolumesListAdminTestJSON-527160316 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:36:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-85e7b3c2-9272-4b36-b3b3-4cb58038f394 tempest-VolumesListAdminTestJSON-527160316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8c76318e-0b82-4df8-9111-06dc8649a9a9 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:05 devstack sudo[99720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8c76318e-0b82-4df8-9111-06dc8649a9a9 1073741824 Jul 11 04:36:05 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:05 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-ee1a2aec-36cb-4657-adfd-5ccc07e87a19 req-2ee2a7ae-ced0-4f1d-9138-1ef24c3189f6 tempest-VolumesSnapshotsTestJSON-1566251898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce11cecf-5033-4510-8ff2-6a4c304fc802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60e52110-4540-4f21-bf2a-be9e503b4afe', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:05 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-ee1a2aec-36cb-4657-adfd-5ccc07e87a19 req-2ee2a7ae-ced0-4f1d-9138-1ef24c3189f6 tempest-VolumesSnapshotsTestJSON-1566251898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2a2056a-4dfc-4a7a-a579-fc8ad038b507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:05 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [req-ee1a2aec-36cb-4657-adfd-5ccc07e87a19 req-2ee2a7ae-ced0-4f1d-9138-1ef24c3189f6 tempest-VolumesSnapshotsTestJSON-1566251898 None] Volume volume-60e52110-4540-4f21-bf2a-be9e503b4afe (60e52110-4540-4f21-bf2a-be9e503b4afe): created successfully Jul 11 04:36:05 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-ee1a2aec-36cb-4657-adfd-5ccc07e87a19 req-2ee2a7ae-ced0-4f1d-9138-1ef24c3189f6 tempest-VolumesSnapshotsTestJSON-1566251898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2a2056a-4dfc-4a7a-a579-fc8ad038b507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:05 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-ee1a2aec-36cb-4657-adfd-5ccc07e87a19 req-2ee2a7ae-ced0-4f1d-9138-1ef24c3189f6 tempest-VolumesSnapshotsTestJSON-1566251898 None] Flow 'volume_create_manager' (a7f6bb2c-e38c-4bd1-bd41-834916be4846) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:36:06 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-ee1a2aec-36cb-4657-adfd-5ccc07e87a19 req-2ee2a7ae-ced0-4f1d-9138-1ef24c3189f6 tempest-VolumesSnapshotsTestJSON-1566251898 None] Created volume successfully. Jul 11 04:36:06 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-85e7b3c2-9272-4b36-b3b3-4cb58038f394 tempest-VolumesListAdminTestJSON-527160316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8c76318e-0b82-4df8-9111-06dc8649a9a9 1073741824" returned: 0 in 0.811s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-85e7b3c2-9272-4b36-b3b3-4cb58038f394 tempest-VolumesListAdminTestJSON-527160316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8c76318e-0b82-4df8-9111-06dc8649a9a9 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:06 devstack sudo[99728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8c76318e-0b82-4df8-9111-06dc8649a9a9 Jul 11 04:36:06 devstack sudo[99728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-241a9f58-b044-4c2f-b4a7-bbec74d47d28 req-8dbd7e65-c081-4ec9-9422-a7a9a31d0aee tempest-VolumesSnapshotsTestJSON-1566251898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:36:07 devstack sudo[99728]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-85e7b3c2-9272-4b36-b3b3-4cb58038f394 tempest-VolumesListAdminTestJSON-527160316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8c76318e-0b82-4df8-9111-06dc8649a9a9" returned: 0 in 0.650s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:07 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-85e7b3c2-9272-4b36-b3b3-4cb58038f394 tempest-VolumesListAdminTestJSON-527160316 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:36:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-85e7b3c2-9272-4b36-b3b3-4cb58038f394 tempest-VolumesListAdminTestJSON-527160316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:36:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.753s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:36:07 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "cinder-quobyte-36085e96-09e5-4d02-b20e-3624c7c45a7a-368233ae-99f6-4318-8495-0b59c6cc7e57" by "_create_volume_from_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:07 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-85e7b3c2-9272-4b36-b3b3-4cb58038f394 tempest-VolumesListAdminTestJSON-527160316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09c7f241-96dc-4477-8a92-b6057f9f0ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c76318e-0b82-4df8-9111-06dc8649a9a9', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:07 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-85e7b3c2-9272-4b36-b3b3-4cb58038f394 tempest-VolumesListAdminTestJSON-527160316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b46947ee-bcb9-4a2f-890f-81f35ba953a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:07 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-quobyte-36085e96-09e5-4d02-b20e-3624c7c45a7a-368233ae-99f6-4318-8495-0b59c6cc7e57" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:07 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Creating volume 368233ae-99f6-4318-8495-0b59c6cc7e57 from snapshot 36085e96-09e5-4d02-b20e-3624c7c45a7a {{(pid=86964) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 04:36:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:36:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:36:07 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:36:07 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:36:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:36:07 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:36:07 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "cinder-quobyte-368233ae-99f6-4318-8495-0b59c6cc7e57" by "_copy_volume_from_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:07 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-85e7b3c2-9272-4b36-b3b3-4cb58038f394 tempest-VolumesListAdminTestJSON-527160316 None] Volume volume-8c76318e-0b82-4df8-9111-06dc8649a9a9 (8c76318e-0b82-4df8-9111-06dc8649a9a9): created successfully Jul 11 04:36:07 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-85e7b3c2-9272-4b36-b3b3-4cb58038f394 tempest-VolumesListAdminTestJSON-527160316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b46947ee-bcb9-4a2f-890f-81f35ba953a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:07 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-85e7b3c2-9272-4b36-b3b3-4cb58038f394 tempest-VolumesListAdminTestJSON-527160316 None] Flow 'volume_create_manager' (e7569d16-dedb-459c-9065-7046f939efd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:36:07 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-quobyte-368233ae-99f6-4318-8495-0b59c6cc7e57" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:07 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] snapshot: 36085e96-09e5-4d02-b20e-3624c7c45a7a, volume: 368233ae-99f6-4318-8495-0b59c6cc7e57, {{(pid=86964) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 04:36:07 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-85e7b3c2-9272-4b36-b3b3-4cb58038f394 tempest-VolumesListAdminTestJSON-527160316 None] Created volume successfully. Jul 11 04:36:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:36:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:36:07 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:36:07 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:36:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:36:07 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd16c13-8688-48e7-aade-aed422d9ea6f]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:36:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d.36085e96-09e5-4d02-b20e-3624c7c45a7a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:07 devstack sudo[99731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d.36085e96-09e5-4d02-b20e-3624c7c45a7a Jul 11 04:36:07 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:08 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a84d69d5-36d6-42a1-9fe2-4fdb8988367c tempest-VolumesListAdminTestJSON-527160316 None] Acquiring lock "cinder-8c76318e-0b82-4df8-9111-06dc8649a9a9-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:08 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d.36085e96-09e5-4d02-b20e-3624c7c45a7a" returned: 0 in 0.781s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:08 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:36:08 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d {{(pid=86964) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 04:36:08 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Creating direct copy from snapshot {{(pid=86964) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 04:36:08 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a84d69d5-36d6-42a1-9fe2-4fdb8988367c tempest-VolumesListAdminTestJSON-527160316 None] Lock "cinder-8c76318e-0b82-4df8-9111-06dc8649a9a9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:08 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bb6936-8bcb-4263-8b05-3072fc158530]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:36:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:08 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a84d69d5-36d6-42a1-9fe2-4fdb8988367c tempest-VolumesListAdminTestJSON-527160316 None] Acquiring lock "cinder-quobyte-8c76318e-0b82-4df8-9111-06dc8649a9a9" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:08 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a84d69d5-36d6-42a1-9fe2-4fdb8988367c tempest-VolumesListAdminTestJSON-527160316 None] Lock "cinder-quobyte-8c76318e-0b82-4df8-9111-06dc8649a9a9" acquired by "delete_volume" :: waited 0.017s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:08 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfaaf16-2b67-42da-b534-9153bab026fc]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:36:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a84d69d5-36d6-42a1-9fe2-4fdb8988367c tempest-VolumesListAdminTestJSON-527160316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8c76318e-0b82-4df8-9111-06dc8649a9a9 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:08 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-075c8b69-35de-46d1-b770-c9f9176cf0a6 tempest-VolumesListAdminTestJSON-1957058011 None] Acquiring lock "cinder-3ba9678b-6323-4f0f-8c6b-cc939145b8b0-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:08 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d Jul 11 04:36:08 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:08 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-075c8b69-35de-46d1-b770-c9f9176cf0a6 tempest-VolumesListAdminTestJSON-1957058011 None] Lock "cinder-3ba9678b-6323-4f0f-8c6b-cc939145b8b0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:08 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-075c8b69-35de-46d1-b770-c9f9176cf0a6 tempest-VolumesListAdminTestJSON-1957058011 None] Acquiring lock "cinder-quobyte-3ba9678b-6323-4f0f-8c6b-cc939145b8b0" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:08 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-075c8b69-35de-46d1-b770-c9f9176cf0a6 tempest-VolumesListAdminTestJSON-1957058011 None] Lock "cinder-quobyte-3ba9678b-6323-4f0f-8c6b-cc939145b8b0" acquired by "delete_volume" :: waited 0.031s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:08 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78de932-12e5-4157-a9d6-f24550704c07]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:36:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-075c8b69-35de-46d1-b770-c9f9176cf0a6 tempest-VolumesListAdminTestJSON-1957058011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3ba9678b-6323-4f0f-8c6b-cc939145b8b0 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:08 devstack sudo[99737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8c76318e-0b82-4df8-9111-06dc8649a9a9 Jul 11 04:36:08 devstack sudo[99737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:08 devstack sudo[99739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3ba9678b-6323-4f0f-8c6b-cc939145b8b0 Jul 11 04:36:08 devstack sudo[99739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:09 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d" returned: 0 in 0.842s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:09 devstack cinder-volume[86964]: DEBUG cinder.utils [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Path /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-368233ae-99f6-4318-8495-0b59c6cc7e57 not found in is_blk_device check {{(pid=86964) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 04:36:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-368233ae-99f6-4318-8495-0b59c6cc7e57 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:09 devstack sudo[99748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-368233ae-99f6-4318-8495-0b59c6cc7e57 Jul 11 04:36:09 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:09 devstack sudo[99737]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a84d69d5-36d6-42a1-9fe2-4fdb8988367c tempest-VolumesListAdminTestJSON-527160316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8c76318e-0b82-4df8-9111-06dc8649a9a9" returned: 0 in 0.871s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a84d69d5-36d6-42a1-9fe2-4fdb8988367c tempest-VolumesListAdminTestJSON-527160316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8c76318e-0b82-4df8-9111-06dc8649a9a9 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:09 devstack sudo[99753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8c76318e-0b82-4df8-9111-06dc8649a9a9 Jul 11 04:36:09 devstack sudo[99753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:09 devstack sudo[99739]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-075c8b69-35de-46d1-b770-c9f9176cf0a6 tempest-VolumesListAdminTestJSON-1957058011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3ba9678b-6323-4f0f-8c6b-cc939145b8b0" returned: 0 in 0.819s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-075c8b69-35de-46d1-b770-c9f9176cf0a6 tempest-VolumesListAdminTestJSON-1957058011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3ba9678b-6323-4f0f-8c6b-cc939145b8b0 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:09 devstack sudo[99755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3ba9678b-6323-4f0f-8c6b-cc939145b8b0 Jul 11 04:36:09 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:10 devstack sudo[99753]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a84d69d5-36d6-42a1-9fe2-4fdb8988367c tempest-VolumesListAdminTestJSON-527160316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8c76318e-0b82-4df8-9111-06dc8649a9a9" returned: 0 in 0.697s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:10 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a84d69d5-36d6-42a1-9fe2-4fdb8988367c tempest-VolumesListAdminTestJSON-527160316 None] Lock "cinder-quobyte-8c76318e-0b82-4df8-9111-06dc8649a9a9" released by "delete_volume" :: held 1.628s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:36:10 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-a84d69d5-36d6-42a1-9fe2-4fdb8988367c tempest-VolumesListAdminTestJSON-527160316 None] Created reservations ['31cfe36f-8093-4615-846e-2e4821765f74', '74bd0ad7-d8a2-4380-8f68-e83a7c987cf5', '1b07f4a7-1c24-4f27-bd06-62e17e737f33', '79b6fd06-054c-4fa5-baa6-8bbfd09b7d96'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:36:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a84d69d5-36d6-42a1-9fe2-4fdb8988367c tempest-VolumesListAdminTestJSON-527160316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:36:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a84d69d5-36d6-42a1-9fe2-4fdb8988367c tempest-VolumesListAdminTestJSON-527160316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:36:10 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-a84d69d5-36d6-42a1-9fe2-4fdb8988367c tempest-VolumesListAdminTestJSON-527160316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:36:10 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-a84d69d5-36d6-42a1-9fe2-4fdb8988367c tempest-VolumesListAdminTestJSON-527160316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:36:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a84d69d5-36d6-42a1-9fe2-4fdb8988367c tempest-VolumesListAdminTestJSON-527160316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:36:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a84d69d5-36d6-42a1-9fe2-4fdb8988367c tempest-VolumesListAdminTestJSON-527160316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:10 devstack sudo[99769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:36:10 devstack sudo[99769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:10 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-075c8b69-35de-46d1-b770-c9f9176cf0a6 tempest-VolumesListAdminTestJSON-1957058011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3ba9678b-6323-4f0f-8c6b-cc939145b8b0" returned: 0 in 1.150s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:10 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-075c8b69-35de-46d1-b770-c9f9176cf0a6 tempest-VolumesListAdminTestJSON-1957058011 None] Lock "cinder-quobyte-3ba9678b-6323-4f0f-8c6b-cc939145b8b0" released by "delete_volume" :: held 2.047s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:36:10 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-075c8b69-35de-46d1-b770-c9f9176cf0a6 tempest-VolumesListAdminTestJSON-1957058011 None] Created reservations ['90dd9ed3-8eef-42d1-a987-d54b82c1e18a', '4d15aa71-12b0-4e53-b809-778b77ff72e7', 'c25efe75-05ba-4acc-8b8c-1bf79c91531f', 'e635bce8-ef23-48b9-b5f0-3ec00fb487df'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:36:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-075c8b69-35de-46d1-b770-c9f9176cf0a6 tempest-VolumesListAdminTestJSON-1957058011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:36:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-075c8b69-35de-46d1-b770-c9f9176cf0a6 tempest-VolumesListAdminTestJSON-1957058011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:36:10 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-075c8b69-35de-46d1-b770-c9f9176cf0a6 tempest-VolumesListAdminTestJSON-1957058011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:36:10 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-075c8b69-35de-46d1-b770-c9f9176cf0a6 tempest-VolumesListAdminTestJSON-1957058011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:36:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-075c8b69-35de-46d1-b770-c9f9176cf0a6 tempest-VolumesListAdminTestJSON-1957058011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:36:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-075c8b69-35de-46d1-b770-c9f9176cf0a6 tempest-VolumesListAdminTestJSON-1957058011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:11 devstack sudo[99771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:36:11 devstack sudo[99771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:11 devstack sudo[99769]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a84d69d5-36d6-42a1-9fe2-4fdb8988367c tempest-VolumesListAdminTestJSON-527160316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 1.379s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:11 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-a84d69d5-36d6-42a1-9fe2-4fdb8988367c tempest-VolumesListAdminTestJSON-527160316 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:36:11 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-a84d69d5-36d6-42a1-9fe2-4fdb8988367c tempest-VolumesListAdminTestJSON-527160316 None] Deleted volume successfully. Jul 11 04:36:11 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a84d69d5-36d6-42a1-9fe2-4fdb8988367c tempest-VolumesListAdminTestJSON-527160316 None] Lock "cinder-8c76318e-0b82-4df8-9111-06dc8649a9a9-delete_volume" released by "delete_volume" :: held 3.459s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:36:12 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-7f62caa6-a154-4b52-bfa0-3be37ecc2641 tempest-VolumesListAdminTestJSON-1957058011 None] Acquiring lock "cinder-1d8dc888-f427-425c-87a7-f92b99586b76-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:12 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-7f62caa6-a154-4b52-bfa0-3be37ecc2641 tempest-VolumesListAdminTestJSON-1957058011 None] Lock "cinder-1d8dc888-f427-425c-87a7-f92b99586b76-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:12 devstack sudo[99771]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:12 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-7f62caa6-a154-4b52-bfa0-3be37ecc2641 tempest-VolumesListAdminTestJSON-1957058011 None] Acquiring lock "cinder-quobyte-1d8dc888-f427-425c-87a7-f92b99586b76" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-075c8b69-35de-46d1-b770-c9f9176cf0a6 tempest-VolumesListAdminTestJSON-1957058011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 1.446s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:12 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-075c8b69-35de-46d1-b770-c9f9176cf0a6 tempest-VolumesListAdminTestJSON-1957058011 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:36:12 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-075c8b69-35de-46d1-b770-c9f9176cf0a6 tempest-VolumesListAdminTestJSON-1957058011 None] Deleted volume successfully. Jul 11 04:36:12 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-7f62caa6-a154-4b52-bfa0-3be37ecc2641 tempest-VolumesListAdminTestJSON-1957058011 None] Lock "cinder-quobyte-1d8dc888-f427-425c-87a7-f92b99586b76" acquired by "delete_volume" :: waited 0.066s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:12 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[72dc075f-d2d0-4497-99d2-1b53c60fa6fe]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:36:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7f62caa6-a154-4b52-bfa0-3be37ecc2641 tempest-VolumesListAdminTestJSON-1957058011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1d8dc888-f427-425c-87a7-f92b99586b76 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:12 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-075c8b69-35de-46d1-b770-c9f9176cf0a6 tempest-VolumesListAdminTestJSON-1957058011 None] Lock "cinder-3ba9678b-6323-4f0f-8c6b-cc939145b8b0-delete_volume" released by "delete_volume" :: held 4.051s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:36:12 devstack sudo[99776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1d8dc888-f427-425c-87a7-f92b99586b76 Jul 11 04:36:12 devstack sudo[99776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:13 devstack sudo[99776]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7f62caa6-a154-4b52-bfa0-3be37ecc2641 tempest-VolumesListAdminTestJSON-1957058011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1d8dc888-f427-425c-87a7-f92b99586b76" returned: 0 in 1.144s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7f62caa6-a154-4b52-bfa0-3be37ecc2641 tempest-VolumesListAdminTestJSON-1957058011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1d8dc888-f427-425c-87a7-f92b99586b76 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:13 devstack sudo[99781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1d8dc888-f427-425c-87a7-f92b99586b76 Jul 11 04:36:13 devstack sudo[99781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:14 devstack sudo[99781]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7f62caa6-a154-4b52-bfa0-3be37ecc2641 tempest-VolumesListAdminTestJSON-1957058011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1d8dc888-f427-425c-87a7-f92b99586b76" returned: 0 in 1.115s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:14 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-368233ae-99f6-4318-8495-0b59c6cc7e57" returned: 0 in 5.588s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:14 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-7f62caa6-a154-4b52-bfa0-3be37ecc2641 tempest-VolumesListAdminTestJSON-1957058011 None] Lock "cinder-quobyte-1d8dc888-f427-425c-87a7-f92b99586b76" released by "delete_volume" :: held 2.347s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:36:14 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92fc12d-6a99-483a-aa42-cf6c09adf7d7]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:36:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:14 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-7f62caa6-a154-4b52-bfa0-3be37ecc2641 tempest-VolumesListAdminTestJSON-1957058011 None] Created reservations ['f0ca0ff2-d423-4b40-b1b7-a47dbe28d1b8', 'f74782a9-7aaf-4700-9146-d7e9bdde258f', '01059734-7627-41ed-8924-1b5a2ae86ec5', '0cdac6e6-76ca-462b-abf8-e3c29a7497b7'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:36:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7f62caa6-a154-4b52-bfa0-3be37ecc2641 tempest-VolumesListAdminTestJSON-1957058011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:36:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7f62caa6-a154-4b52-bfa0-3be37ecc2641 tempest-VolumesListAdminTestJSON-1957058011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:36:14 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7f62caa6-a154-4b52-bfa0-3be37ecc2641 tempest-VolumesListAdminTestJSON-1957058011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:36:14 devstack sudo[99784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d Jul 11 04:36:14 devstack sudo[99784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:14 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7f62caa6-a154-4b52-bfa0-3be37ecc2641 tempest-VolumesListAdminTestJSON-1957058011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:36:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7f62caa6-a154-4b52-bfa0-3be37ecc2641 tempest-VolumesListAdminTestJSON-1957058011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:36:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7f62caa6-a154-4b52-bfa0-3be37ecc2641 tempest-VolumesListAdminTestJSON-1957058011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:14 devstack sudo[99786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:36:14 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:15 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7f62caa6-a154-4b52-bfa0-3be37ecc2641 tempest-VolumesListAdminTestJSON-1957058011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.656s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:15 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-7f62caa6-a154-4b52-bfa0-3be37ecc2641 tempest-VolumesListAdminTestJSON-1957058011 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:36:15 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-7f62caa6-a154-4b52-bfa0-3be37ecc2641 tempest-VolumesListAdminTestJSON-1957058011 None] Deleted volume successfully. Jul 11 04:36:15 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-7f62caa6-a154-4b52-bfa0-3be37ecc2641 tempest-VolumesListAdminTestJSON-1957058011 None] Lock "cinder-1d8dc888-f427-425c-87a7-f92b99586b76-delete_volume" released by "delete_volume" :: held 3.371s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:36:15 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d27cb772-974f-4acd-bafa-70d3710b3e90 tempest-VolumesListAdminTestJSON-1957058011 None] Acquiring lock "cinder-c7df205c-052e-433b-81a5-998e90806934-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:15 devstack sudo[99784]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:15 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d27cb772-974f-4acd-bafa-70d3710b3e90 tempest-VolumesListAdminTestJSON-1957058011 None] Lock "cinder-c7df205c-052e-433b-81a5-998e90806934-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d" returned: 0 in 0.945s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:15 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Image conversion details: src /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d, size 1024.00 MB, duration 5.59 sec, destination /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-368233ae-99f6-4318-8495-0b59c6cc7e57 {{(pid=86964) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 04:36:15 devstack cinder-volume[86964]: INFO cinder.image.image_utils [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Converted 1024.00 MB image at 183.21 MB/s Jul 11 04:36:15 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-368233ae-99f6-4318-8495-0b59c6cc7e57 is being set with open permissions: ugo+rw Jul 11 04:36:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-368233ae-99f6-4318-8495-0b59c6cc7e57 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:15 devstack sudo[99794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-368233ae-99f6-4318-8495-0b59c6cc7e57 Jul 11 04:36:15 devstack sudo[99794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:15 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d27cb772-974f-4acd-bafa-70d3710b3e90 tempest-VolumesListAdminTestJSON-1957058011 None] Acquiring lock "cinder-quobyte-c7df205c-052e-433b-81a5-998e90806934" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:15 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d27cb772-974f-4acd-bafa-70d3710b3e90 tempest-VolumesListAdminTestJSON-1957058011 None] Lock "cinder-quobyte-c7df205c-052e-433b-81a5-998e90806934" acquired by "delete_volume" :: waited 0.018s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:15 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9c8265-0a85-46c2-a361-5cd911de169c]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:36:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d27cb772-974f-4acd-bafa-70d3710b3e90 tempest-VolumesListAdminTestJSON-1957058011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c7df205c-052e-433b-81a5-998e90806934 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:15 devstack sudo[99796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c7df205c-052e-433b-81a5-998e90806934 Jul 11 04:36:15 devstack sudo[99796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:16 devstack sudo[99794]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-368233ae-99f6-4318-8495-0b59c6cc7e57" returned: 0 in 0.645s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:16 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-quobyte-368233ae-99f6-4318-8495-0b59c6cc7e57" released by "_copy_volume_from_snapshot" :: held 8.929s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:36:16 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-quobyte-36085e96-09e5-4d02-b20e-3624c7c45a7a-368233ae-99f6-4318-8495-0b59c6cc7e57" released by "_create_volume_from_snapshot" :: held 8.986s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:36:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.013s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:36:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-241a9f58-b044-4c2f-b4a7-bbec74d47d28 req-8dbd7e65-c081-4ec9-9422-a7a9a31d0aee tempest-VolumesSnapshotsTestJSON-1566251898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.536s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:36:16 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [req-241a9f58-b044-4c2f-b4a7-bbec74d47d28 req-8dbd7e65-c081-4ec9-9422-a7a9a31d0aee tempest-VolumesSnapshotsTestJSON-1566251898 None] Creating offline snapshot ba00d6dc-5f51-405d-b213-16adea489924 of volume 60e52110-4540-4f21-bf2a-be9e503b4afe {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:36:16 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (743ddc4a-49a1-4b10-b626-0f91e24b0a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-368233ae-99f6-4318-8495-0b59c6cc7e57', 'volume_size': 2, 'snapshot_id': '36085e96-09e5-4d02-b20e-3624c7c45a7a'}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:16 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc527b29-fa00-405b-85d5-dbe9802e4eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:16 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[357ae7fe-fbdc-4794-9ef5-188c50ecc074]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:36:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-241a9f58-b044-4c2f-b4a7-bbec74d47d28 req-8dbd7e65-c081-4ec9-9422-a7a9a31d0aee tempest-VolumesSnapshotsTestJSON-1566251898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:16 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Volume volume-368233ae-99f6-4318-8495-0b59c6cc7e57 (368233ae-99f6-4318-8495-0b59c6cc7e57): created successfully Jul 11 04:36:16 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc527b29-fa00-405b-85d5-dbe9802e4eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:16 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Flow 'volume_create_manager' (a8ada03e-b35f-4533-b5d1-5e8246e5795f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:36:16 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-b1ed0a63-42a0-4be0-bd4b-658a5608e30a tempest-VolumesSnapshotTestJSON-1323670043 None] Created volume successfully. Jul 11 04:36:16 devstack sudo[99801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe Jul 11 04:36:16 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:16 devstack sudo[99796]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d27cb772-974f-4acd-bafa-70d3710b3e90 tempest-VolumesListAdminTestJSON-1957058011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c7df205c-052e-433b-81a5-998e90806934" returned: 0 in 0.775s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d27cb772-974f-4acd-bafa-70d3710b3e90 tempest-VolumesListAdminTestJSON-1957058011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c7df205c-052e-433b-81a5-998e90806934 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:16 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c7df205c-052e-433b-81a5-998e90806934 Jul 11 04:36:16 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:17 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d27cb772-974f-4acd-bafa-70d3710b3e90 tempest-VolumesListAdminTestJSON-1957058011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c7df205c-052e-433b-81a5-998e90806934" returned: 0 in 0.681s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:17 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-241a9f58-b044-4c2f-b4a7-bbec74d47d28 req-8dbd7e65-c081-4ec9-9422-a7a9a31d0aee tempest-VolumesSnapshotsTestJSON-1566251898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe" returned: 0 in 0.836s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-241a9f58-b044-4c2f-b4a7-bbec74d47d28 req-8dbd7e65-c081-4ec9-9422-a7a9a31d0aee tempest-VolumesSnapshotsTestJSON-1566251898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe.ba00d6dc-5f51-405d-b213-16adea489924 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d27cb772-974f-4acd-bafa-70d3710b3e90 tempest-VolumesListAdminTestJSON-1957058011 None] Lock "cinder-quobyte-c7df205c-052e-433b-81a5-998e90806934" released by "delete_volume" :: held 1.501s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:36:17 devstack sudo[99811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe.ba00d6dc-5f51-405d-b213-16adea489924 1G Jul 11 04:36:17 devstack sudo[99811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:17 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-d27cb772-974f-4acd-bafa-70d3710b3e90 tempest-VolumesListAdminTestJSON-1957058011 None] Created reservations ['2b1ef3dc-95d8-4a7c-af06-5d80726a81c0', 'be057fbd-7a38-4687-abe9-168154d3a977', '2ebb9dca-b68a-4a97-80a8-654d622e4ea7', 'e7660eec-aa31-45e9-9b7e-d5ae5994ddc8'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:36:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d27cb772-974f-4acd-bafa-70d3710b3e90 tempest-VolumesListAdminTestJSON-1957058011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:36:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d27cb772-974f-4acd-bafa-70d3710b3e90 tempest-VolumesListAdminTestJSON-1957058011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:36:17 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-d27cb772-974f-4acd-bafa-70d3710b3e90 tempest-VolumesListAdminTestJSON-1957058011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:36:17 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-d27cb772-974f-4acd-bafa-70d3710b3e90 tempest-VolumesListAdminTestJSON-1957058011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:36:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d27cb772-974f-4acd-bafa-70d3710b3e90 tempest-VolumesListAdminTestJSON-1957058011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:36:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d27cb772-974f-4acd-bafa-70d3710b3e90 tempest-VolumesListAdminTestJSON-1957058011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:17 devstack sudo[99813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:36:17 devstack sudo[99813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-88773810-aa85-4cac-9f2c-9b01cbe483bc tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "cinder-368233ae-99f6-4318-8495-0b59c6cc7e57-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-88773810-aa85-4cac-9f2c-9b01cbe483bc tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-368233ae-99f6-4318-8495-0b59c6cc7e57-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-88773810-aa85-4cac-9f2c-9b01cbe483bc tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "cinder-quobyte-368233ae-99f6-4318-8495-0b59c6cc7e57" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-88773810-aa85-4cac-9f2c-9b01cbe483bc tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-quobyte-368233ae-99f6-4318-8495-0b59c6cc7e57" acquired by "delete_volume" :: waited 0.013s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:17 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28ca062-ce3d-4e67-acc7-980b1fb41e7b]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:36:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-88773810-aa85-4cac-9f2c-9b01cbe483bc tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-368233ae-99f6-4318-8495-0b59c6cc7e57 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:17 devstack sudo[99815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-368233ae-99f6-4318-8495-0b59c6cc7e57 Jul 11 04:36:17 devstack sudo[99815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:18 devstack sudo[99813]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d27cb772-974f-4acd-bafa-70d3710b3e90 tempest-VolumesListAdminTestJSON-1957058011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.725s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:18 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-d27cb772-974f-4acd-bafa-70d3710b3e90 tempest-VolumesListAdminTestJSON-1957058011 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:36:18 devstack sudo[99811]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:18 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-d27cb772-974f-4acd-bafa-70d3710b3e90 tempest-VolumesListAdminTestJSON-1957058011 None] Deleted volume successfully. Jul 11 04:36:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-241a9f58-b044-4c2f-b4a7-bbec74d47d28 req-8dbd7e65-c081-4ec9-9422-a7a9a31d0aee tempest-VolumesSnapshotsTestJSON-1566251898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe.ba00d6dc-5f51-405d-b213-16adea489924 1G" returned: 0 in 0.889s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-241a9f58-b044-4c2f-b4a7-bbec74d47d28 req-8dbd7e65-c081-4ec9-9422-a7a9a31d0aee tempest-VolumesSnapshotsTestJSON-1566251898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60e52110-4540-4f21-bf2a-be9e503b4afe -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe.ba00d6dc-5f51-405d-b213-16adea489924 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:18 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d27cb772-974f-4acd-bafa-70d3710b3e90 tempest-VolumesListAdminTestJSON-1957058011 None] Lock "cinder-c7df205c-052e-433b-81a5-998e90806934-delete_volume" released by "delete_volume" :: held 2.496s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:36:18 devstack sudo[99821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60e52110-4540-4f21-bf2a-be9e503b4afe -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe.ba00d6dc-5f51-405d-b213-16adea489924 Jul 11 04:36:18 devstack sudo[99821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:18 devstack sudo[99815]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-88773810-aa85-4cac-9f2c-9b01cbe483bc tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-368233ae-99f6-4318-8495-0b59c6cc7e57" returned: 0 in 0.821s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-88773810-aa85-4cac-9f2c-9b01cbe483bc tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-368233ae-99f6-4318-8495-0b59c6cc7e57 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:18 devstack sudo[99827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-368233ae-99f6-4318-8495-0b59c6cc7e57 Jul 11 04:36:18 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:19 devstack sudo[99821]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-241a9f58-b044-4c2f-b4a7-bbec74d47d28 req-8dbd7e65-c081-4ec9-9422-a7a9a31d0aee tempest-VolumesSnapshotsTestJSON-1566251898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60e52110-4540-4f21-bf2a-be9e503b4afe -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe.ba00d6dc-5f51-405d-b213-16adea489924" returned: 0 in 0.792s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:19 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [req-241a9f58-b044-4c2f-b4a7-bbec74d47d28 req-8dbd7e65-c081-4ec9-9422-a7a9a31d0aee tempest-VolumesSnapshotsTestJSON-1566251898 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe.ba00d6dc-5f51-405d-b213-16adea489924 is being set with open permissions: ugo+rw Jul 11 04:36:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-241a9f58-b044-4c2f-b4a7-bbec74d47d28 req-8dbd7e65-c081-4ec9-9422-a7a9a31d0aee tempest-VolumesSnapshotsTestJSON-1566251898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe.ba00d6dc-5f51-405d-b213-16adea489924 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:19 devstack sudo[99838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe.ba00d6dc-5f51-405d-b213-16adea489924 Jul 11 04:36:19 devstack sudo[99838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:19 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-88773810-aa85-4cac-9f2c-9b01cbe483bc tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-368233ae-99f6-4318-8495-0b59c6cc7e57" returned: 0 in 0.725s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:19 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-88773810-aa85-4cac-9f2c-9b01cbe483bc tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-quobyte-368233ae-99f6-4318-8495-0b59c6cc7e57" released by "delete_volume" :: held 1.602s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:36:19 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-88773810-aa85-4cac-9f2c-9b01cbe483bc tempest-VolumesSnapshotTestJSON-1323670043 None] Created reservations ['9597847f-3a6f-4251-9223-043406507e13', 'd2270d80-9c98-4dd6-9663-16383725c5cb', '0326d20d-1539-42c2-bda6-9ad285452748', 'd24377b1-7b0d-41bf-861d-9f555f0af9d7'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:36:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-88773810-aa85-4cac-9f2c-9b01cbe483bc tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:36:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-88773810-aa85-4cac-9f2c-9b01cbe483bc tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:36:19 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-88773810-aa85-4cac-9f2c-9b01cbe483bc tempest-VolumesSnapshotTestJSON-1323670043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:36:19 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-88773810-aa85-4cac-9f2c-9b01cbe483bc tempest-VolumesSnapshotTestJSON-1323670043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:36:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-88773810-aa85-4cac-9f2c-9b01cbe483bc tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:36:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-88773810-aa85-4cac-9f2c-9b01cbe483bc tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:19 devstack sudo[99841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:36:19 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:19 devstack sudo[99838]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-241a9f58-b044-4c2f-b4a7-bbec74d47d28 req-8dbd7e65-c081-4ec9-9422-a7a9a31d0aee tempest-VolumesSnapshotsTestJSON-1566251898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe.ba00d6dc-5f51-405d-b213-16adea489924" returned: 0 in 0.683s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-241a9f58-b044-4c2f-b4a7-bbec74d47d28 req-8dbd7e65-c081-4ec9-9422-a7a9a31d0aee tempest-VolumesSnapshotsTestJSON-1566251898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:19 devstack sudo[99844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe.info Jul 11 04:36:19 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:19 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6e8117a6-8267-4588-b6eb-918e2df5a8a5 tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "cinder-36085e96-09e5-4d02-b20e-3624c7c45a7a-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:20 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6e8117a6-8267-4588-b6eb-918e2df5a8a5 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-36085e96-09e5-4d02-b20e-3624c7c45a7a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:20 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6e8117a6-8267-4588-b6eb-918e2df5a8a5 tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "cinder-quobyte-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:20 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6e8117a6-8267-4588-b6eb-918e2df5a8a5 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-quobyte-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:20 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6e8117a6-8267-4588-b6eb-918e2df5a8a5 tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "cinder-quobyte-36085e96-09e5-4d02-b20e-3624c7c45a7a" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:20 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6e8117a6-8267-4588-b6eb-918e2df5a8a5 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-quobyte-36085e96-09e5-4d02-b20e-3624c7c45a7a" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:20 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-6e8117a6-8267-4588-b6eb-918e2df5a8a5 tempest-VolumesSnapshotTestJSON-1323670043 None] Deleting offline snapshot 36085e96-09e5-4d02-b20e-3624c7c45a7a of volume 6e7bf50c-b20e-4dab-9a2c-2be2b21a556d {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:36:20 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-6e8117a6-8267-4588-b6eb-918e2df5a8a5 tempest-VolumesSnapshotTestJSON-1323670043 None] snapshot_file for this snap is: volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d.36085e96-09e5-4d02-b20e-3624c7c45a7a {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:36:20 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[8229e313-c277-4b83-8972-abb7966e6293]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:36:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6e8117a6-8267-4588-b6eb-918e2df5a8a5 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d.36085e96-09e5-4d02-b20e-3624c7c45a7a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:20 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-88773810-aa85-4cac-9f2c-9b01cbe483bc tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.783s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:20 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-88773810-aa85-4cac-9f2c-9b01cbe483bc tempest-VolumesSnapshotTestJSON-1323670043 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:36:20 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-88773810-aa85-4cac-9f2c-9b01cbe483bc tempest-VolumesSnapshotTestJSON-1323670043 None] Deleted volume successfully. Jul 11 04:36:20 devstack sudo[99847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d.36085e96-09e5-4d02-b20e-3624c7c45a7a Jul 11 04:36:20 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:20 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-88773810-aa85-4cac-9f2c-9b01cbe483bc tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-368233ae-99f6-4318-8495-0b59c6cc7e57-delete_volume" released by "delete_volume" :: held 2.616s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:36:20 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-241a9f58-b044-4c2f-b4a7-bbec74d47d28 req-8dbd7e65-c081-4ec9-9422-a7a9a31d0aee tempest-VolumesSnapshotsTestJSON-1566251898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe.info" returned: 0 in 0.900s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:20 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [req-241a9f58-b044-4c2f-b4a7-bbec74d47d28 req-8dbd7e65-c081-4ec9-9422-a7a9a31d0aee tempest-VolumesSnapshotsTestJSON-1566251898 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe.info is being set with open permissions: ugo+rw Jul 11 04:36:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-241a9f58-b044-4c2f-b4a7-bbec74d47d28 req-8dbd7e65-c081-4ec9-9422-a7a9a31d0aee tempest-VolumesSnapshotsTestJSON-1566251898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:20 devstack sudo[99850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe.info Jul 11 04:36:20 devstack sudo[99850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:20 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6e8117a6-8267-4588-b6eb-918e2df5a8a5 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d.36085e96-09e5-4d02-b20e-3624c7c45a7a" returned: 0 in 0.813s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:20 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-6e8117a6-8267-4588-b6eb-918e2df5a8a5 tempest-VolumesSnapshotTestJSON-1323670043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:36:21 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[aade6bf9-c841-4480-8fa7-e532b6754d2e]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:36:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6e8117a6-8267-4588-b6eb-918e2df5a8a5 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:21 devstack sudo[99855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d Jul 11 04:36:21 devstack sudo[99855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:21 devstack sudo[99850]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-241a9f58-b044-4c2f-b4a7-bbec74d47d28 req-8dbd7e65-c081-4ec9-9422-a7a9a31d0aee tempest-VolumesSnapshotsTestJSON-1566251898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe.info" returned: 0 in 0.675s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-241a9f58-b044-4c2f-b4a7-bbec74d47d28 req-8dbd7e65-c081-4ec9-9422-a7a9a31d0aee tempest-VolumesSnapshotsTestJSON-1566251898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.896s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:36:21 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-241a9f58-b044-4c2f-b4a7-bbec74d47d28 req-8dbd7e65-c081-4ec9-9422-a7a9a31d0aee tempest-VolumesSnapshotsTestJSON-1566251898 None] Create snapshot completed successfully Jul 11 04:36:21 devstack sudo[99855]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6e8117a6-8267-4588-b6eb-918e2df5a8a5 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d" returned: 0 in 0.786s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6e8117a6-8267-4588-b6eb-918e2df5a8a5 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d.36085e96-09e5-4d02-b20e-3624c7c45a7a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:21 devstack sudo[99861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d.36085e96-09e5-4d02-b20e-3624c7c45a7a Jul 11 04:36:21 devstack sudo[99861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:22 devstack cinder-volume[86964]: DEBUG cinder.coordination [req-c3b94266-4a76-41bf-a76b-ff2fcb518201 req-9c0304e3-062d-4bad-9754-e30610069f06 tempest-VolumesSnapshotsTestJSON-1566251898 None] Acquiring lock "cinder-ba00d6dc-5f51-405d-b213-16adea489924-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:22 devstack cinder-volume[86964]: DEBUG cinder.coordination [req-c3b94266-4a76-41bf-a76b-ff2fcb518201 req-9c0304e3-062d-4bad-9754-e30610069f06 tempest-VolumesSnapshotsTestJSON-1566251898 None] Lock "cinder-ba00d6dc-5f51-405d-b213-16adea489924-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:22 devstack cinder-volume[86964]: DEBUG cinder.coordination [req-c3b94266-4a76-41bf-a76b-ff2fcb518201 req-9c0304e3-062d-4bad-9754-e30610069f06 tempest-VolumesSnapshotsTestJSON-1566251898 None] Acquiring lock "cinder-quobyte-60e52110-4540-4f21-bf2a-be9e503b4afe" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:22 devstack cinder-volume[86964]: DEBUG cinder.coordination [req-c3b94266-4a76-41bf-a76b-ff2fcb518201 req-9c0304e3-062d-4bad-9754-e30610069f06 tempest-VolumesSnapshotsTestJSON-1566251898 None] Lock "cinder-quobyte-60e52110-4540-4f21-bf2a-be9e503b4afe" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:22 devstack cinder-volume[86964]: DEBUG cinder.coordination [req-c3b94266-4a76-41bf-a76b-ff2fcb518201 req-9c0304e3-062d-4bad-9754-e30610069f06 tempest-VolumesSnapshotsTestJSON-1566251898 None] Acquiring lock "cinder-quobyte-ba00d6dc-5f51-405d-b213-16adea489924" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:22 devstack cinder-volume[86964]: DEBUG cinder.coordination [req-c3b94266-4a76-41bf-a76b-ff2fcb518201 req-9c0304e3-062d-4bad-9754-e30610069f06 tempest-VolumesSnapshotsTestJSON-1566251898 None] Lock "cinder-quobyte-ba00d6dc-5f51-405d-b213-16adea489924" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [req-c3b94266-4a76-41bf-a76b-ff2fcb518201 req-9c0304e3-062d-4bad-9754-e30610069f06 tempest-VolumesSnapshotsTestJSON-1566251898 None] Deleting offline snapshot ba00d6dc-5f51-405d-b213-16adea489924 of volume 60e52110-4540-4f21-bf2a-be9e503b4afe {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:36:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [req-c3b94266-4a76-41bf-a76b-ff2fcb518201 req-9c0304e3-062d-4bad-9754-e30610069f06 tempest-VolumesSnapshotsTestJSON-1566251898 None] snapshot_file for this snap is: volume-60e52110-4540-4f21-bf2a-be9e503b4afe.ba00d6dc-5f51-405d-b213-16adea489924 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:36:22 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[3555f35c-c077-4738-b5ec-c26af40eb447]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:36:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-c3b94266-4a76-41bf-a76b-ff2fcb518201 req-9c0304e3-062d-4bad-9754-e30610069f06 tempest-VolumesSnapshotsTestJSON-1566251898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe.ba00d6dc-5f51-405d-b213-16adea489924 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:22 devstack sudo[99866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe.ba00d6dc-5f51-405d-b213-16adea489924 Jul 11 04:36:22 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:22 devstack sudo[99861]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6e8117a6-8267-4588-b6eb-918e2df5a8a5 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d.36085e96-09e5-4d02-b20e-3624c7c45a7a" returned: 0 in 0.849s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6e8117a6-8267-4588-b6eb-918e2df5a8a5 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d.36085e96-09e5-4d02-b20e-3624c7c45a7a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:22 devstack sudo[99868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d.36085e96-09e5-4d02-b20e-3624c7c45a7a Jul 11 04:36:22 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:22 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:36:22 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Flow 'volume_create_manager' (ab13d4f7-c2f0-4349-a4c2-eb0dd45f7cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:36:22 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6868a2c4-6f9a-43c1-a3df-4b4031e925da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:22 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6868a2c4-6f9a-43c1-a3df-4b4031e925da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-621612579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b197ed7f-2b35-499d-ba1b-965f0dc9f499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='428e096cc0474c14b0fd0e565e7b14a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:36:23Z,use_quota=True,user_id='82093da713144fc6ad7be1c904ce57f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:22 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49374afe-31d8-4673-91d3-db917d25c119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:22 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49374afe-31d8-4673-91d3-db917d25c119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:22 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a596dc8a-9695-4160-aa25-1f55a4b0d4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:22 devstack cinder-volume[86964]: DEBUG cinder.image.glance [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Creating Keystone auth plugin from conf {{(pid=86964) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 04:36:23 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a596dc8a-9695-4160-aa25-1f55a4b0d4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b197ed7f-2b35-499d-ba1b-965f0dc9f499', 'volume_name': 'volume-b197ed7f-2b35-499d-ba1b-965f0dc9f499', 'volume_size': 1, 'image_id': 'a34636df-e58a-4a3a-9b16-7e804af976d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a34636df-e58a-4a3a-9b16-7e804af976d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ffa684dc47340c1a363723e49759fc3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a34636df-e58a-4a3a-9b16-7e804af976d8', 'created_at': datetime.datetime(2026, 7, 11, 2, 18, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 18, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a34636df-e58a-4a3a-9b16-7e804af976d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:23 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1e5d6b4-5ebe-4ee5-b619-7861113f1400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:23 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1e5d6b4-5ebe-4ee5-b619-7861113f1400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:23 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ae2bc61-a353-4169-9b8f-8c315ac9ad1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:23 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Volume b197ed7f-2b35-499d-ba1b-965f0dc9f499: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b197ed7f-2b35-499d-ba1b-965f0dc9f499', 'volume_size': 1, 'image_id': 'a34636df-e58a-4a3a-9b16-7e804af976d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a34636df-e58a-4a3a-9b16-7e804af976d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ffa684dc47340c1a363723e49759fc3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a34636df-e58a-4a3a-9b16-7e804af976d8', 'created_at': datetime.datetime(2026, 7, 11, 2, 18, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 18, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a34636df-e58a-4a3a-9b16-7e804af976d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 11 04:36:23 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Trying to clone b197ed7f-2b35-499d-ba1b-965f0dc9f499 from image a34636df-e58a-4a3a-9b16-7e804af976d8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a34636df-e58a-4a3a-9b16-7e804af976d8', 'metadata': {}}]). {{(pid=86964) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 04:36:23 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-c3b94266-4a76-41bf-a76b-ff2fcb518201 req-9c0304e3-062d-4bad-9754-e30610069f06 tempest-VolumesSnapshotsTestJSON-1566251898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe.ba00d6dc-5f51-405d-b213-16adea489924" returned: 0 in 0.828s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:23 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [req-c3b94266-4a76-41bf-a76b-ff2fcb518201 req-9c0304e3-062d-4bad-9754-e30610069f06 tempest-VolumesSnapshotsTestJSON-1566251898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60e52110-4540-4f21-bf2a-be9e503b4afe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:36:23 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c8b1e6-470a-4c52-b60b-fa9b7c013c57]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:36:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-c3b94266-4a76-41bf-a76b-ff2fcb518201 req-9c0304e3-062d-4bad-9754-e30610069f06 tempest-VolumesSnapshotsTestJSON-1566251898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:23 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6e8117a6-8267-4588-b6eb-918e2df5a8a5 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d.36085e96-09e5-4d02-b20e-3624c7c45a7a" returned: 0 in 0.734s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:23 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6e8117a6-8267-4588-b6eb-918e2df5a8a5 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-quobyte-36085e96-09e5-4d02-b20e-3624c7c45a7a" released by "_delete_snapshot" :: held 3.341s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:36:23 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6e8117a6-8267-4588-b6eb-918e2df5a8a5 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-quobyte-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d" released by "delete_snapshot" :: held 3.406s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:36:23 devstack sudo[99874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe Jul 11 04:36:23 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:23 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_jejnorvodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86964) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 11 04:36:23 devstack cinder-volume[86964]: INFO cinder.image.image_utils [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Image download 20.69 MB at 20.69 MB/s Jul 11 04:36:23 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[be19d887-8920-409f-9557-86652d9464c2]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:36:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_jejnorvodevstack@QuobyteHD {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:23 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-6e8117a6-8267-4588-b6eb-918e2df5a8a5 tempest-VolumesSnapshotTestJSON-1323670043 None] Created reservations ['528fb7ec-b518-4316-9251-9ae284d6207b', '3b4c41f0-6259-4f04-996f-c9fde7f55bb7', 'eb3803f3-9dfa-498f-9c70-8363d0d22c08', '46e8625f-6eb6-449d-b77b-d6faf5eefe45'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:36:23 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-6e8117a6-8267-4588-b6eb-918e2df5a8a5 tempest-VolumesSnapshotTestJSON-1323670043 None] Delete snapshot completed successfully. Jul 11 04:36:23 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6e8117a6-8267-4588-b6eb-918e2df5a8a5 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-36085e96-09e5-4d02-b20e-3624c7c45a7a-delete_snapshot" released by "delete_snapshot" :: held 3.649s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:36:23 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_jejnorvodevstack@QuobyteHD Jul 11 04:36:23 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:24 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-c3b94266-4a76-41bf-a76b-ff2fcb518201 req-9c0304e3-062d-4bad-9754-e30610069f06 tempest-VolumesSnapshotsTestJSON-1566251898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe" returned: 0 in 0.826s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-c3b94266-4a76-41bf-a76b-ff2fcb518201 req-9c0304e3-062d-4bad-9754-e30610069f06 tempest-VolumesSnapshotsTestJSON-1566251898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe.ba00d6dc-5f51-405d-b213-16adea489924 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:24 devstack sudo[99882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe.ba00d6dc-5f51-405d-b213-16adea489924 Jul 11 04:36:24 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:24 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6df483b8-a165-490a-9a50-12810e4f9f9a tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "cinder-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:24 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_jejnorvodevstack@QuobyteHD" returned: 0 in 0.747s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:24 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Temporary image a34636df-e58a-4a3a-9b16-7e804af976d8 is fetched for user 82093da713144fc6ad7be1c904ce57f7. {{(pid=86964) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 11 04:36:24 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6df483b8-a165-490a-9a50-12810e4f9f9a tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:24 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6df483b8-a165-490a-9a50-12810e4f9f9a tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "cinder-quobyte-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:24 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6df483b8-a165-490a-9a50-12810e4f9f9a tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-quobyte-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d" acquired by "delete_volume" :: waited 0.020s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:24 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59adfe9-4d0c-4be7-acdf-d08f3c2bd4c9]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:36:24 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9c1a68-5ca8-4de2-8323-0594181bb1ac]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:36:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_jejnorvodevstack@QuobyteHD {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6df483b8-a165-490a-9a50-12810e4f9f9a tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:24 devstack sudo[99888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_jejnorvodevstack@QuobyteHD Jul 11 04:36:24 devstack sudo[99888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:24 devstack sudo[99889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d Jul 11 04:36:24 devstack sudo[99889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:25 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-c3b94266-4a76-41bf-a76b-ff2fcb518201 req-9c0304e3-062d-4bad-9754-e30610069f06 tempest-VolumesSnapshotsTestJSON-1566251898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe.ba00d6dc-5f51-405d-b213-16adea489924" returned: 0 in 0.819s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-c3b94266-4a76-41bf-a76b-ff2fcb518201 req-9c0304e3-062d-4bad-9754-e30610069f06 tempest-VolumesSnapshotsTestJSON-1566251898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe.ba00d6dc-5f51-405d-b213-16adea489924 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:25 devstack sudo[99896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe.ba00d6dc-5f51-405d-b213-16adea489924 Jul 11 04:36:25 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:25 devstack sudo[99888]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_jejnorvodevstack@QuobyteHD" returned: 0 in 0.734s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:36:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:36:25 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-621612579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b197ed7f-2b35-499d-ba1b-965f0dc9f499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='428e096cc0474c14b0fd0e565e7b14a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:36:23Z,use_quota=True,user_id='82093da713144fc6ad7be1c904ce57f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:36:25 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Creating volume b197ed7f-2b35-499d-ba1b-965f0dc9f499 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:36:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:36:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:36:25 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:36:25 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:36:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:36:25 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:36:25 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:36:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b197ed7f-2b35-499d-ba1b-965f0dc9f499 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:25 devstack sudo[99904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b197ed7f-2b35-499d-ba1b-965f0dc9f499 1073741824 Jul 11 04:36:25 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:25 devstack sudo[99889]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6df483b8-a165-490a-9a50-12810e4f9f9a tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d" returned: 0 in 0.778s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6df483b8-a165-490a-9a50-12810e4f9f9a tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:25 devstack sudo[99906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d Jul 11 04:36:25 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:25 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-c3b94266-4a76-41bf-a76b-ff2fcb518201 req-9c0304e3-062d-4bad-9754-e30610069f06 tempest-VolumesSnapshotsTestJSON-1566251898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe.ba00d6dc-5f51-405d-b213-16adea489924" returned: 0 in 0.753s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:25 devstack cinder-volume[86964]: DEBUG cinder.coordination [req-c3b94266-4a76-41bf-a76b-ff2fcb518201 req-9c0304e3-062d-4bad-9754-e30610069f06 tempest-VolumesSnapshotsTestJSON-1566251898 None] Lock "cinder-quobyte-ba00d6dc-5f51-405d-b213-16adea489924" released by "_delete_snapshot" :: held 3.348s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:36:25 devstack cinder-volume[86964]: DEBUG cinder.coordination [req-c3b94266-4a76-41bf-a76b-ff2fcb518201 req-9c0304e3-062d-4bad-9754-e30610069f06 tempest-VolumesSnapshotsTestJSON-1566251898 None] Lock "cinder-quobyte-60e52110-4540-4f21-bf2a-be9e503b4afe" released by "delete_snapshot" :: held 3.385s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:36:25 devstack cinder-volume[86964]: DEBUG cinder.quota [req-c3b94266-4a76-41bf-a76b-ff2fcb518201 req-9c0304e3-062d-4bad-9754-e30610069f06 tempest-VolumesSnapshotsTestJSON-1566251898 None] Created reservations ['443afb88-5534-49d8-9a69-35323279c615', 'b6bf3203-de19-4a25-ad98-2c3e8330cfc8', 'ccec5841-608a-47f3-8e13-09a57ad436bb', 'dae9f314-a83e-48db-8abf-d8802791d523'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:36:25 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6df483b8-a165-490a-9a50-12810e4f9f9a tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d" returned: 0 in 0.701s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:25 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-c3b94266-4a76-41bf-a76b-ff2fcb518201 req-9c0304e3-062d-4bad-9754-e30610069f06 tempest-VolumesSnapshotsTestJSON-1566251898 None] Delete snapshot completed successfully. Jul 11 04:36:25 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6df483b8-a165-490a-9a50-12810e4f9f9a tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-quobyte-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d" released by "delete_volume" :: held 1.556s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:36:25 devstack cinder-volume[86964]: DEBUG cinder.coordination [req-c3b94266-4a76-41bf-a76b-ff2fcb518201 req-9c0304e3-062d-4bad-9754-e30610069f06 tempest-VolumesSnapshotsTestJSON-1566251898 None] Lock "cinder-ba00d6dc-5f51-405d-b213-16adea489924-delete_snapshot" released by "delete_snapshot" :: held 3.567s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:36:26 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-6df483b8-a165-490a-9a50-12810e4f9f9a tempest-VolumesSnapshotTestJSON-1323670043 None] Created reservations ['24a2b768-c594-425b-a2b9-6c146681139e', 'f15923ca-ae31-4f13-aaa5-28c401cf0586', '097894c9-f005-45fd-a482-3282576c4af0', '5d561421-edec-4cd5-988c-494a113466ae'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:36:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6df483b8-a165-490a-9a50-12810e4f9f9a tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:36:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6df483b8-a165-490a-9a50-12810e4f9f9a tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:36:26 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6df483b8-a165-490a-9a50-12810e4f9f9a tempest-VolumesSnapshotTestJSON-1323670043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:36:26 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6df483b8-a165-490a-9a50-12810e4f9f9a tempest-VolumesSnapshotTestJSON-1323670043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:36:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6df483b8-a165-490a-9a50-12810e4f9f9a tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:36:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6df483b8-a165-490a-9a50-12810e4f9f9a tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:26 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b197ed7f-2b35-499d-ba1b-965f0dc9f499 1073741824" returned: 0 in 0.888s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:26 devstack sudo[99914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:36:26 devstack sudo[99914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b197ed7f-2b35-499d-ba1b-965f0dc9f499 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:26 devstack sudo[99916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b197ed7f-2b35-499d-ba1b-965f0dc9f499 Jul 11 04:36:26 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:26 devstack sudo[99914]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6df483b8-a165-490a-9a50-12810e4f9f9a tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.698s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:26 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-6df483b8-a165-490a-9a50-12810e4f9f9a tempest-VolumesSnapshotTestJSON-1323670043 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:36:26 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:26 devstack cinder-volume[86964]: DEBUG cinder.coordination [req-433537cf-9410-404f-b20d-696089ae1708 req-bcf720e5-2e68-405d-aba0-2ffdb3fe0ad2 tempest-VolumesSnapshotsTestJSON-1566251898 None] Acquiring lock "cinder-60e52110-4540-4f21-bf2a-be9e503b4afe-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:26 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-6df483b8-a165-490a-9a50-12810e4f9f9a tempest-VolumesSnapshotTestJSON-1323670043 None] Deleted volume successfully. Jul 11 04:36:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b197ed7f-2b35-499d-ba1b-965f0dc9f499" returned: 0 in 0.680s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:26 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:36:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:36:26 devstack cinder-volume[86964]: DEBUG cinder.coordination [req-433537cf-9410-404f-b20d-696089ae1708 req-bcf720e5-2e68-405d-aba0-2ffdb3fe0ad2 tempest-VolumesSnapshotsTestJSON-1566251898 None] Lock "cinder-60e52110-4540-4f21-bf2a-be9e503b4afe-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:26 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6df483b8-a165-490a-9a50-12810e4f9f9a tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-6e7bf50c-b20e-4dab-9a2c-2be2b21a556d-delete_volume" released by "delete_volume" :: held 2.505s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:36:26 devstack cinder-volume[86964]: DEBUG cinder.volume.volume_utils [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Attempting download of a34636df-e58a-4a3a-9b16-7e804af976d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/a34636df-e58a-4a3a-9b16-7e804af976d8', 'metadata': {}}])) to volume b197ed7f-2b35-499d-ba1b-965f0dc9f499. {{(pid=86964) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 04:36:26 devstack cinder-volume[86964]: DEBUG cinder.coordination [req-433537cf-9410-404f-b20d-696089ae1708 req-bcf720e5-2e68-405d-aba0-2ffdb3fe0ad2 tempest-VolumesSnapshotsTestJSON-1566251898 None] Acquiring lock "cinder-quobyte-60e52110-4540-4f21-bf2a-be9e503b4afe" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:26 devstack cinder-volume[86964]: DEBUG cinder.coordination [req-433537cf-9410-404f-b20d-696089ae1708 req-bcf720e5-2e68-405d-aba0-2ffdb3fe0ad2 tempest-VolumesSnapshotsTestJSON-1566251898 None] Lock "cinder-quobyte-60e52110-4540-4f21-bf2a-be9e503b4afe" acquired by "delete_volume" :: waited 0.018s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:26 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f88cb3-b5e3-4b56-8e4c-2ae82066679f]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:36:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a34636df-e58a-4a3a-9b16-7e804af976d8_43ep6pbu {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:26 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[c562c244-909a-41e6-9143-d58ac3f37b1a]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:36:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-433537cf-9410-404f-b20d-696089ae1708 req-bcf720e5-2e68-405d-aba0-2ffdb3fe0ad2 tempest-VolumesSnapshotsTestJSON-1566251898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:27 devstack sudo[99921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe Jul 11 04:36:27 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:27 devstack sudo[99920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a34636df-e58a-4a3a-9b16-7e804af976d8_43ep6pbu Jul 11 04:36:27 devstack sudo[99920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:27 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-934a3c97-d3c3-41a2-9a9b-c61b805da472 tempest-VolumesSnapshotTestJSON-1323670043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:36:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-934a3c97-d3c3-41a2-9a9b-c61b805da472 tempest-VolumesSnapshotTestJSON-1323670043 None] Flow 'volume_create_manager' (38811b76-db90-4905-9be3-ea664e8b4d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:36:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-934a3c97-d3c3-41a2-9a9b-c61b805da472 tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c6b26ec-2f1e-43d7-a921-67a24c5bf12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-934a3c97-d3c3-41a2-9a9b-c61b805da472 tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c6b26ec-2f1e-43d7-a921-67a24c5bf12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1615802930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a01fd913-954a-4423-82a5-fc3460ce3b67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d7c406e07ce4db495527579b5d7acbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:36:27Z,use_quota=True,user_id='3bdc313bd5cd43f8bb404a890cb0f49c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-934a3c97-d3c3-41a2-9a9b-c61b805da472 tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d39d500-fc99-4532-a810-f8cbd6fd575c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-934a3c97-d3c3-41a2-9a9b-c61b805da472 tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d39d500-fc99-4532-a810-f8cbd6fd575c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-934a3c97-d3c3-41a2-9a9b-c61b805da472 tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9b79c36-e66c-491f-b83b-71a7891a4311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-934a3c97-d3c3-41a2-9a9b-c61b805da472 tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9b79c36-e66c-491f-b83b-71a7891a4311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a01fd913-954a-4423-82a5-fc3460ce3b67', 'volume_name': 'volume-a01fd913-954a-4423-82a5-fc3460ce3b67', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-934a3c97-d3c3-41a2-9a9b-c61b805da472 tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d61eee8e-9ede-4815-9a9f-d11db8b7dc53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-934a3c97-d3c3-41a2-9a9b-c61b805da472 tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d61eee8e-9ede-4815-9a9f-d11db8b7dc53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-934a3c97-d3c3-41a2-9a9b-c61b805da472 tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (400c28f5-ced3-4a25-8392-c539e4214f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:27 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-934a3c97-d3c3-41a2-9a9b-c61b805da472 tempest-VolumesSnapshotTestJSON-1323670043 None] Volume a01fd913-954a-4423-82a5-fc3460ce3b67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a01fd913-954a-4423-82a5-fc3460ce3b67', 'volume_size': 1} Jul 11 04:36:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-934a3c97-d3c3-41a2-9a9b-c61b805da472 tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:36:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-934a3c97-d3c3-41a2-9a9b-c61b805da472 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:36:27 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-934a3c97-d3c3-41a2-9a9b-c61b805da472 tempest-VolumesSnapshotTestJSON-1323670043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1615802930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a01fd913-954a-4423-82a5-fc3460ce3b67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d7c406e07ce4db495527579b5d7acbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:36:27Z,use_quota=True,user_id='3bdc313bd5cd43f8bb404a890cb0f49c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:36:27 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-934a3c97-d3c3-41a2-9a9b-c61b805da472 tempest-VolumesSnapshotTestJSON-1323670043 None] Creating volume a01fd913-954a-4423-82a5-fc3460ce3b67 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:36:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-934a3c97-d3c3-41a2-9a9b-c61b805da472 tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:36:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-934a3c97-d3c3-41a2-9a9b-c61b805da472 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:36:27 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-934a3c97-d3c3-41a2-9a9b-c61b805da472 tempest-VolumesSnapshotTestJSON-1323670043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:36:27 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-934a3c97-d3c3-41a2-9a9b-c61b805da472 tempest-VolumesSnapshotTestJSON-1323670043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:36:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-934a3c97-d3c3-41a2-9a9b-c61b805da472 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:36:27 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-934a3c97-d3c3-41a2-9a9b-c61b805da472 tempest-VolumesSnapshotTestJSON-1323670043 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:36:27 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-934a3c97-d3c3-41a2-9a9b-c61b805da472 tempest-VolumesSnapshotTestJSON-1323670043 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:36:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-934a3c97-d3c3-41a2-9a9b-c61b805da472 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:27 devstack sudo[99924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67 1073741824 Jul 11 04:36:27 devstack sudo[99924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:27 devstack sudo[99920]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a34636df-e58a-4a3a-9b16-7e804af976d8_43ep6pbu" returned: 0 in 0.779s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a34636df-e58a-4a3a-9b16-7e804af976d8_43ep6pbu {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:27 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-433537cf-9410-404f-b20d-696089ae1708 req-bcf720e5-2e68-405d-aba0-2ffdb3fe0ad2 tempest-VolumesSnapshotsTestJSON-1566251898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe" returned: 0 in 0.778s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-433537cf-9410-404f-b20d-696089ae1708 req-bcf720e5-2e68-405d-aba0-2ffdb3fe0ad2 tempest-VolumesSnapshotsTestJSON-1566251898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:27 devstack sudo[99932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe Jul 11 04:36:27 devstack sudo[99932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:27 devstack sudo[99931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a34636df-e58a-4a3a-9b16-7e804af976d8_43ep6pbu Jul 11 04:36:27 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:28 devstack sudo[99924]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-934a3c97-d3c3-41a2-9a9b-c61b805da472 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67 1073741824" returned: 0 in 0.893s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-934a3c97-d3c3-41a2-9a9b-c61b805da472 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:28 devstack sudo[99938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67 Jul 11 04:36:28 devstack sudo[99938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:28 devstack sudo[99932]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-433537cf-9410-404f-b20d-696089ae1708 req-bcf720e5-2e68-405d-aba0-2ffdb3fe0ad2 tempest-VolumesSnapshotsTestJSON-1566251898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60e52110-4540-4f21-bf2a-be9e503b4afe" returned: 0 in 0.682s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:28 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a34636df-e58a-4a3a-9b16-7e804af976d8_43ep6pbu" returned: 1 in 0.711s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a34636df-e58a-4a3a-9b16-7e804af976d8_43ep6pbu' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:36:28 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10fda84-336a-4917-9285-f3e6478a16e6]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:36:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_jejnorvodevstack@QuobyteHD {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:28 devstack cinder-volume[86964]: DEBUG cinder.coordination [req-433537cf-9410-404f-b20d-696089ae1708 req-bcf720e5-2e68-405d-aba0-2ffdb3fe0ad2 tempest-VolumesSnapshotsTestJSON-1566251898 None] Lock "cinder-quobyte-60e52110-4540-4f21-bf2a-be9e503b4afe" released by "delete_volume" :: held 1.550s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:36:28 devstack cinder-volume[86964]: DEBUG cinder.quota [req-433537cf-9410-404f-b20d-696089ae1708 req-bcf720e5-2e68-405d-aba0-2ffdb3fe0ad2 tempest-VolumesSnapshotsTestJSON-1566251898 None] Created reservations ['c9f34ba7-cb3d-445b-9e97-38530a1c445e', 'eb1fdf51-2ba4-40f2-ab47-83dab693d7e0', '101afa59-64c6-4c31-90e0-ba32c249b26c', 'd7ddb084-2307-485a-ad4f-23fa77f83b19'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:36:28 devstack sudo[99943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_jejnorvodevstack@QuobyteHD Jul 11 04:36:28 devstack sudo[99943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-433537cf-9410-404f-b20d-696089ae1708 req-bcf720e5-2e68-405d-aba0-2ffdb3fe0ad2 tempest-VolumesSnapshotsTestJSON-1566251898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:36:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-433537cf-9410-404f-b20d-696089ae1708 req-bcf720e5-2e68-405d-aba0-2ffdb3fe0ad2 tempest-VolumesSnapshotsTestJSON-1566251898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:36:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [req-433537cf-9410-404f-b20d-696089ae1708 req-bcf720e5-2e68-405d-aba0-2ffdb3fe0ad2 tempest-VolumesSnapshotsTestJSON-1566251898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:36:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [req-433537cf-9410-404f-b20d-696089ae1708 req-bcf720e5-2e68-405d-aba0-2ffdb3fe0ad2 tempest-VolumesSnapshotsTestJSON-1566251898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:36:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-433537cf-9410-404f-b20d-696089ae1708 req-bcf720e5-2e68-405d-aba0-2ffdb3fe0ad2 tempest-VolumesSnapshotsTestJSON-1566251898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:36:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-433537cf-9410-404f-b20d-696089ae1708 req-bcf720e5-2e68-405d-aba0-2ffdb3fe0ad2 tempest-VolumesSnapshotsTestJSON-1566251898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:28 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:36:28 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:28 devstack sudo[99938]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-934a3c97-d3c3-41a2-9a9b-c61b805da472 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67" returned: 0 in 0.670s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-934a3c97-d3c3-41a2-9a9b-c61b805da472 tempest-VolumesSnapshotTestJSON-1323670043 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:36:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-934a3c97-d3c3-41a2-9a9b-c61b805da472 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:36:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-934a3c97-d3c3-41a2-9a9b-c61b805da472 tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (400c28f5-ced3-4a25-8392-c539e4214f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a01fd913-954a-4423-82a5-fc3460ce3b67', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-934a3c97-d3c3-41a2-9a9b-c61b805da472 tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71fe8f93-b470-4693-b913-aef066fe09c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:28 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-934a3c97-d3c3-41a2-9a9b-c61b805da472 tempest-VolumesSnapshotTestJSON-1323670043 None] Volume volume-a01fd913-954a-4423-82a5-fc3460ce3b67 (a01fd913-954a-4423-82a5-fc3460ce3b67): created successfully Jul 11 04:36:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-934a3c97-d3c3-41a2-9a9b-c61b805da472 tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71fe8f93-b470-4693-b913-aef066fe09c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-934a3c97-d3c3-41a2-9a9b-c61b805da472 tempest-VolumesSnapshotTestJSON-1323670043 None] Flow 'volume_create_manager' (38811b76-db90-4905-9be3-ea664e8b4d9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:36:28 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-934a3c97-d3c3-41a2-9a9b-c61b805da472 tempest-VolumesSnapshotTestJSON-1323670043 None] Created volume successfully. Jul 11 04:36:29 devstack sudo[99943]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_jejnorvodevstack@QuobyteHD" returned: 0 in 0.794s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:29 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] a34636df-e58a-4a3a-9b16-7e804af976d8 was qcow2, converting to raw {{(pid=86964) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 11 04:36:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_jejnorvodevstack@QuobyteHD /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b197ed7f-2b35-499d-ba1b-965f0dc9f499 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:29 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-433537cf-9410-404f-b20d-696089ae1708 req-bcf720e5-2e68-405d-aba0-2ffdb3fe0ad2 tempest-VolumesSnapshotsTestJSON-1566251898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.679s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:29 devstack cinder-volume[86964]: DEBUG cinder.manager [req-433537cf-9410-404f-b20d-696089ae1708 req-bcf720e5-2e68-405d-aba0-2ffdb3fe0ad2 tempest-VolumesSnapshotsTestJSON-1566251898 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:36:29 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-433537cf-9410-404f-b20d-696089ae1708 req-bcf720e5-2e68-405d-aba0-2ffdb3fe0ad2 tempest-VolumesSnapshotsTestJSON-1566251898 None] Deleted volume successfully. Jul 11 04:36:29 devstack sudo[99952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_jejnorvodevstack@QuobyteHD /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b197ed7f-2b35-499d-ba1b-965f0dc9f499 Jul 11 04:36:29 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:29 devstack cinder-volume[86964]: DEBUG cinder.coordination [req-433537cf-9410-404f-b20d-696089ae1708 req-bcf720e5-2e68-405d-aba0-2ffdb3fe0ad2 tempest-VolumesSnapshotsTestJSON-1566251898 None] Lock "cinder-60e52110-4540-4f21-bf2a-be9e503b4afe-delete_volume" released by "delete_volume" :: held 2.475s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:36:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2ae537e3-6ded-4e92-977f-99267881ba98 tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:36:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2ae537e3-6ded-4e92-977f-99267881ba98 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:36:29 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-2ae537e3-6ded-4e92-977f-99267881ba98 tempest-VolumesSnapshotTestJSON-1323670043 None] Creating offline snapshot 180a5435-9b1c-4e71-a371-a32f84e53cab of volume a01fd913-954a-4423-82a5-fc3460ce3b67 {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:36:29 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e118799-2e99-4df7-a17a-a6e7cad6765d]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:36:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2ae537e3-6ded-4e92-977f-99267881ba98 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:29 devstack sudo[99954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67 Jul 11 04:36:29 devstack sudo[99954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:30 devstack sudo[99954]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2ae537e3-6ded-4e92-977f-99267881ba98 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67" returned: 0 in 0.868s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2ae537e3-6ded-4e92-977f-99267881ba98 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67.180a5435-9b1c-4e71-a371-a32f84e53cab 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:30 devstack sudo[99965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67.180a5435-9b1c-4e71-a371-a32f84e53cab 1G Jul 11 04:36:30 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:31 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2ae537e3-6ded-4e92-977f-99267881ba98 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67.180a5435-9b1c-4e71-a371-a32f84e53cab 1G" returned: 0 in 0.982s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2ae537e3-6ded-4e92-977f-99267881ba98 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a01fd913-954a-4423-82a5-fc3460ce3b67 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67.180a5435-9b1c-4e71-a371-a32f84e53cab {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:31 devstack sudo[99972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a01fd913-954a-4423-82a5-fc3460ce3b67 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67.180a5435-9b1c-4e71-a371-a32f84e53cab Jul 11 04:36:31 devstack sudo[99972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:31 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_jejnorvodevstack@QuobyteHD /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b197ed7f-2b35-499d-ba1b-965f0dc9f499" returned: 0 in 2.149s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:31 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_jejnorvodevstack@QuobyteHD, size 112.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b197ed7f-2b35-499d-ba1b-965f0dc9f499 {{(pid=86964) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 04:36:31 devstack cinder-volume[86964]: INFO cinder.image.image_utils [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Converted 112.00 MB image at 52.08 MB/s Jul 11 04:36:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b197ed7f-2b35-499d-ba1b-965f0dc9f499 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:31 devstack sudo[99974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b197ed7f-2b35-499d-ba1b-965f0dc9f499 1G Jul 11 04:36:31 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:32 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b197ed7f-2b35-499d-ba1b-965f0dc9f499 1G" returned: 0 in 0.691s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:32 devstack sudo[99972]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2ae537e3-6ded-4e92-977f-99267881ba98 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a01fd913-954a-4423-82a5-fc3460ce3b67 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67.180a5435-9b1c-4e71-a371-a32f84e53cab" returned: 0 in 0.778s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:32 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-2ae537e3-6ded-4e92-977f-99267881ba98 tempest-VolumesSnapshotTestJSON-1323670043 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67.180a5435-9b1c-4e71-a371-a32f84e53cab is being set with open permissions: ugo+rw Jul 11 04:36:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2ae537e3-6ded-4e92-977f-99267881ba98 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67.180a5435-9b1c-4e71-a371-a32f84e53cab {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:32 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7dee93-2c5a-4428-81fb-09ed88c0f3e7]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:36:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b197ed7f-2b35-499d-ba1b-965f0dc9f499 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:32 devstack sudo[99982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67.180a5435-9b1c-4e71-a371-a32f84e53cab Jul 11 04:36:32 devstack sudo[99982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:32 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b197ed7f-2b35-499d-ba1b-965f0dc9f499 Jul 11 04:36:32 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:32 devstack sudo[99982]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2ae537e3-6ded-4e92-977f-99267881ba98 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67.180a5435-9b1c-4e71-a371-a32f84e53cab" returned: 0 in 0.686s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2ae537e3-6ded-4e92-977f-99267881ba98 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:32 devstack sudo[99989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67.info Jul 11 04:36:32 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:32 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b197ed7f-2b35-499d-ba1b-965f0dc9f499" returned: 0 in 0.804s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b197ed7f-2b35-499d-ba1b-965f0dc9f499 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:33 devstack sudo[99991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b197ed7f-2b35-499d-ba1b-965f0dc9f499 Jul 11 04:36:33 devstack sudo[99991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:33 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [req-af8bd4b5-1ec5-4cb9-9c43-2684932795b9 req-3870c9db-86dd-40a0-87f4-f35668e00db6 tempest-VolumesGetTestJSON-1851406784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:36:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-af8bd4b5-1ec5-4cb9-9c43-2684932795b9 req-3870c9db-86dd-40a0-87f4-f35668e00db6 tempest-VolumesGetTestJSON-1851406784 None] Flow 'volume_create_manager' (e1f0210f-97a9-4beb-94a3-dc2f400fa4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:36:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-af8bd4b5-1ec5-4cb9-9c43-2684932795b9 req-3870c9db-86dd-40a0-87f4-f35668e00db6 tempest-VolumesGetTestJSON-1851406784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c2c957b-fdc7-4368-b1b9-f567680d8652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-af8bd4b5-1ec5-4cb9-9c43-2684932795b9 req-3870c9db-86dd-40a0-87f4-f35668e00db6 tempest-VolumesGetTestJSON-1851406784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c2c957b-fdc7-4368-b1b9-f567680d8652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2010870400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dba4fee9-517b-4565-949a-5c5ffd353662,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b737d5a96edf4fef92d34f7bb364b785',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:36:33Z,use_quota=True,user_id='c594ecb345404e5da01ed62d235284c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-af8bd4b5-1ec5-4cb9-9c43-2684932795b9 req-3870c9db-86dd-40a0-87f4-f35668e00db6 tempest-VolumesGetTestJSON-1851406784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eea5321-954b-4d9a-9d95-3a04a3762f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-af8bd4b5-1ec5-4cb9-9c43-2684932795b9 req-3870c9db-86dd-40a0-87f4-f35668e00db6 tempest-VolumesGetTestJSON-1851406784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eea5321-954b-4d9a-9d95-3a04a3762f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-af8bd4b5-1ec5-4cb9-9c43-2684932795b9 req-3870c9db-86dd-40a0-87f4-f35668e00db6 tempest-VolumesGetTestJSON-1851406784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (261bf91f-416e-4c0d-a00c-8ca9e83ee6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-af8bd4b5-1ec5-4cb9-9c43-2684932795b9 req-3870c9db-86dd-40a0-87f4-f35668e00db6 tempest-VolumesGetTestJSON-1851406784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (261bf91f-416e-4c0d-a00c-8ca9e83ee6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dba4fee9-517b-4565-949a-5c5ffd353662', 'volume_name': 'volume-dba4fee9-517b-4565-949a-5c5ffd353662', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-af8bd4b5-1ec5-4cb9-9c43-2684932795b9 req-3870c9db-86dd-40a0-87f4-f35668e00db6 tempest-VolumesGetTestJSON-1851406784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e28371aa-0151-4559-8af3-a2ef1149a745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-af8bd4b5-1ec5-4cb9-9c43-2684932795b9 req-3870c9db-86dd-40a0-87f4-f35668e00db6 tempest-VolumesGetTestJSON-1851406784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e28371aa-0151-4559-8af3-a2ef1149a745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-af8bd4b5-1ec5-4cb9-9c43-2684932795b9 req-3870c9db-86dd-40a0-87f4-f35668e00db6 tempest-VolumesGetTestJSON-1851406784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0101afeb-9ffa-448a-aa05-1de2ed7e00da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:33 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [req-af8bd4b5-1ec5-4cb9-9c43-2684932795b9 req-3870c9db-86dd-40a0-87f4-f35668e00db6 tempest-VolumesGetTestJSON-1851406784 None] Volume dba4fee9-517b-4565-949a-5c5ffd353662: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dba4fee9-517b-4565-949a-5c5ffd353662', 'volume_size': 1} Jul 11 04:36:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-af8bd4b5-1ec5-4cb9-9c43-2684932795b9 req-3870c9db-86dd-40a0-87f4-f35668e00db6 tempest-VolumesGetTestJSON-1851406784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:36:33 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2ae537e3-6ded-4e92-977f-99267881ba98 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67.info" returned: 0 in 0.679s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:33 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-2ae537e3-6ded-4e92-977f-99267881ba98 tempest-VolumesSnapshotTestJSON-1323670043 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67.info is being set with open permissions: ugo+rw Jul 11 04:36:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2ae537e3-6ded-4e92-977f-99267881ba98 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:33 devstack sudo[99994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67.info Jul 11 04:36:33 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:33 devstack sudo[99991]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b197ed7f-2b35-499d-ba1b-965f0dc9f499" returned: 1 in 0.824s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b197ed7f-2b35-499d-ba1b-965f0dc9f499' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:36:33 devstack cinder-volume[86964]: DEBUG cinder.volume.volume_utils [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Downloaded image a34636df-e58a-4a3a-9b16-7e804af976d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/a34636df-e58a-4a3a-9b16-7e804af976d8', 'metadata': {}}])) to volume b197ed7f-2b35-499d-ba1b-965f0dc9f499 successfully. {{(pid=86964) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 04:36:33 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Temporary image a34636df-e58a-4a3a-9b16-7e804af976d8 for user 82093da713144fc6ad7be1c904ce57f7 is deleted. {{(pid=86964) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 11 04:36:33 devstack cinder-volume[86964]: DEBUG cinder.volume.volume_utils [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Marking volume b197ed7f-2b35-499d-ba1b-965f0dc9f499 as bootable. {{(pid=86964) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 04:36:33 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Copying metadata from image a34636df-e58a-4a3a-9b16-7e804af976d8 to b197ed7f-2b35-499d-ba1b-965f0dc9f499. {{(pid=86964) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 04:36:33 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Creating volume glance metadata for volume b197ed7f-2b35-499d-ba1b-965f0dc9f499 backed by image a34636df-e58a-4a3a-9b16-7e804af976d8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a34636df-e58a-4a3a-9b16-7e804af976d8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86964) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 04:36:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ae2bc61-a353-4169-9b8f-8c315ac9ad1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b197ed7f-2b35-499d-ba1b-965f0dc9f499', 'volume_size': 1, 'image_id': 'a34636df-e58a-4a3a-9b16-7e804af976d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a34636df-e58a-4a3a-9b16-7e804af976d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ffa684dc47340c1a363723e49759fc3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a34636df-e58a-4a3a-9b16-7e804af976d8', 'created_at': datetime.datetime(2026, 7, 11, 2, 18, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 18, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a34636df-e58a-4a3a-9b16-7e804af976d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c70b9d1c-9520-4a98-b417-b15ffe976f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:33 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Volume volume-b197ed7f-2b35-499d-ba1b-965f0dc9f499 (b197ed7f-2b35-499d-ba1b-965f0dc9f499): created successfully Jul 11 04:36:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c70b9d1c-9520-4a98-b417-b15ffe976f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Flow 'volume_create_manager' (ab13d4f7-c2f0-4349-a4c2-eb0dd45f7cd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:36:33 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-d2784a98-1517-4cae-9744-32cf653c4e5f tempest-VolumesImageMetadata-1688709160 None] Created volume successfully. Jul 11 04:36:34 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2ae537e3-6ded-4e92-977f-99267881ba98 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67.info" returned: 0 in 0.620s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2ae537e3-6ded-4e92-977f-99267881ba98 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.716s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:36:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-af8bd4b5-1ec5-4cb9-9c43-2684932795b9 req-3870c9db-86dd-40a0-87f4-f35668e00db6 tempest-VolumesGetTestJSON-1851406784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.871s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:36:34 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [req-af8bd4b5-1ec5-4cb9-9c43-2684932795b9 req-3870c9db-86dd-40a0-87f4-f35668e00db6 tempest-VolumesGetTestJSON-1851406784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2010870400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dba4fee9-517b-4565-949a-5c5ffd353662,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b737d5a96edf4fef92d34f7bb364b785',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:36:33Z,use_quota=True,user_id='c594ecb345404e5da01ed62d235284c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:36:34 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [req-af8bd4b5-1ec5-4cb9-9c43-2684932795b9 req-3870c9db-86dd-40a0-87f4-f35668e00db6 tempest-VolumesGetTestJSON-1851406784 None] Creating volume dba4fee9-517b-4565-949a-5c5ffd353662 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:36:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-af8bd4b5-1ec5-4cb9-9c43-2684932795b9 req-3870c9db-86dd-40a0-87f4-f35668e00db6 tempest-VolumesGetTestJSON-1851406784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:36:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-af8bd4b5-1ec5-4cb9-9c43-2684932795b9 req-3870c9db-86dd-40a0-87f4-f35668e00db6 tempest-VolumesGetTestJSON-1851406784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:36:34 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [req-af8bd4b5-1ec5-4cb9-9c43-2684932795b9 req-3870c9db-86dd-40a0-87f4-f35668e00db6 tempest-VolumesGetTestJSON-1851406784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:36:34 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [req-af8bd4b5-1ec5-4cb9-9c43-2684932795b9 req-3870c9db-86dd-40a0-87f4-f35668e00db6 tempest-VolumesGetTestJSON-1851406784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:36:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-af8bd4b5-1ec5-4cb9-9c43-2684932795b9 req-3870c9db-86dd-40a0-87f4-f35668e00db6 tempest-VolumesGetTestJSON-1851406784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:36:34 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [req-af8bd4b5-1ec5-4cb9-9c43-2684932795b9 req-3870c9db-86dd-40a0-87f4-f35668e00db6 tempest-VolumesGetTestJSON-1851406784 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:36:34 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [req-af8bd4b5-1ec5-4cb9-9c43-2684932795b9 req-3870c9db-86dd-40a0-87f4-f35668e00db6 tempest-VolumesGetTestJSON-1851406784 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:36:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-af8bd4b5-1ec5-4cb9-9c43-2684932795b9 req-3870c9db-86dd-40a0-87f4-f35668e00db6 tempest-VolumesGetTestJSON-1851406784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dba4fee9-517b-4565-949a-5c5ffd353662 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:34 devstack sudo[100001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dba4fee9-517b-4565-949a-5c5ffd353662 1073741824 Jul 11 04:36:34 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:34 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-2ae537e3-6ded-4e92-977f-99267881ba98 tempest-VolumesSnapshotTestJSON-1323670043 None] Create snapshot completed successfully Jul 11 04:36:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6e6dae8d-eb5a-4d32-bbcc-5074de175d24 tempest-VolumesImageMetadata-1688709160 None] Acquiring lock "cinder-b197ed7f-2b35-499d-ba1b-965f0dc9f499-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6e6dae8d-eb5a-4d32-bbcc-5074de175d24 tempest-VolumesImageMetadata-1688709160 None] Lock "cinder-b197ed7f-2b35-499d-ba1b-965f0dc9f499-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6e6dae8d-eb5a-4d32-bbcc-5074de175d24 tempest-VolumesImageMetadata-1688709160 None] Acquiring lock "cinder-quobyte-b197ed7f-2b35-499d-ba1b-965f0dc9f499" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6e6dae8d-eb5a-4d32-bbcc-5074de175d24 tempest-VolumesImageMetadata-1688709160 None] Lock "cinder-quobyte-b197ed7f-2b35-499d-ba1b-965f0dc9f499" acquired by "delete_volume" :: waited 0.022s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:35 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[11087de5-4e65-4342-9ec0-1a69c0826276]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:36:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6e6dae8d-eb5a-4d32-bbcc-5074de175d24 tempest-VolumesImageMetadata-1688709160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b197ed7f-2b35-499d-ba1b-965f0dc9f499 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:35 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-af8bd4b5-1ec5-4cb9-9c43-2684932795b9 req-3870c9db-86dd-40a0-87f4-f35668e00db6 tempest-VolumesGetTestJSON-1851406784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dba4fee9-517b-4565-949a-5c5ffd353662 1073741824" returned: 0 in 0.941s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:35 devstack sudo[100007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b197ed7f-2b35-499d-ba1b-965f0dc9f499 Jul 11 04:36:35 devstack sudo[100007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-af8bd4b5-1ec5-4cb9-9c43-2684932795b9 req-3870c9db-86dd-40a0-87f4-f35668e00db6 tempest-VolumesGetTestJSON-1851406784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dba4fee9-517b-4565-949a-5c5ffd353662 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:35 devstack sudo[100009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dba4fee9-517b-4565-949a-5c5ffd353662 Jul 11 04:36:35 devstack sudo[100009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:35 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:36:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Flow 'volume_create_manager' (2d4ecde8-0463-4041-aa10-e97b02c89f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:36:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e416c58-6e74-47ea-8ecc-013bf23a288a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e416c58-6e74-47ea-8ecc-013bf23a288a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1970475054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91ee0da2-c1b7-4ad4-85bd-4c33c0193eef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d7c406e07ce4db495527579b5d7acbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=180a5435-9b1c-4e71-a371-a32f84e53cab,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:36:35Z,use_quota=True,user_id='3bdc313bd5cd43f8bb404a890cb0f49c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d470b2b8-2544-4db5-aa88-aa2d4f7ff0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d470b2b8-2544-4db5-aa88-aa2d4f7ff0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e14bd17-4584-4870-8392-6456b026cb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e14bd17-4584-4870-8392-6456b026cb47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '91ee0da2-c1b7-4ad4-85bd-4c33c0193eef', 'volume_name': 'volume-91ee0da2-c1b7-4ad4-85bd-4c33c0193eef', 'volume_size': 1, 'snapshot_id': '180a5435-9b1c-4e71-a371-a32f84e53cab'}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b779871e-d17c-4fca-9846-f4017a5aa477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b779871e-d17c-4fca-9846-f4017a5aa477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fb89ea9-6cc1-4348-b187-ece7c6ca34ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:35 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Volume 91ee0da2-c1b7-4ad4-85bd-4c33c0193eef: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-91ee0da2-c1b7-4ad4-85bd-4c33c0193eef', 'volume_size': 1, 'snapshot_id': '180a5435-9b1c-4e71-a371-a32f84e53cab'} Jul 11 04:36:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:36:35 devstack sudo[100007]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6e6dae8d-eb5a-4d32-bbcc-5074de175d24 tempest-VolumesImageMetadata-1688709160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b197ed7f-2b35-499d-ba1b-965f0dc9f499" returned: 0 in 0.763s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6e6dae8d-eb5a-4d32-bbcc-5074de175d24 tempest-VolumesImageMetadata-1688709160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b197ed7f-2b35-499d-ba1b-965f0dc9f499 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:35 devstack sudo[100009]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-af8bd4b5-1ec5-4cb9-9c43-2684932795b9 req-3870c9db-86dd-40a0-87f4-f35668e00db6 tempest-VolumesGetTestJSON-1851406784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dba4fee9-517b-4565-949a-5c5ffd353662" returned: 0 in 0.721s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:35 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [req-af8bd4b5-1ec5-4cb9-9c43-2684932795b9 req-3870c9db-86dd-40a0-87f4-f35668e00db6 tempest-VolumesGetTestJSON-1851406784 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:36:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-af8bd4b5-1ec5-4cb9-9c43-2684932795b9 req-3870c9db-86dd-40a0-87f4-f35668e00db6 tempest-VolumesGetTestJSON-1851406784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.715s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:36:35 devstack sudo[100015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b197ed7f-2b35-499d-ba1b-965f0dc9f499 Jul 11 04:36:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.485s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:36:35 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "cinder-quobyte-180a5435-9b1c-4e71-a371-a32f84e53cab-91ee0da2-c1b7-4ad4-85bd-4c33c0193eef" by "_create_volume_from_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:35 devstack sudo[100015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-af8bd4b5-1ec5-4cb9-9c43-2684932795b9 req-3870c9db-86dd-40a0-87f4-f35668e00db6 tempest-VolumesGetTestJSON-1851406784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0101afeb-9ffa-448a-aa05-1de2ed7e00da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dba4fee9-517b-4565-949a-5c5ffd353662', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-af8bd4b5-1ec5-4cb9-9c43-2684932795b9 req-3870c9db-86dd-40a0-87f4-f35668e00db6 tempest-VolumesGetTestJSON-1851406784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93e2f403-1b7e-46ac-a632-3a4e7225dcfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:35 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-quobyte-180a5435-9b1c-4e71-a371-a32f84e53cab-91ee0da2-c1b7-4ad4-85bd-4c33c0193eef" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:35 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Creating volume 91ee0da2-c1b7-4ad4-85bd-4c33c0193eef from snapshot 180a5435-9b1c-4e71-a371-a32f84e53cab {{(pid=86964) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 04:36:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:36:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:36:35 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:36:35 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:36:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:36:35 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:36:35 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "cinder-quobyte-91ee0da2-c1b7-4ad4-85bd-4c33c0193eef" by "_copy_volume_from_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:35 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [req-af8bd4b5-1ec5-4cb9-9c43-2684932795b9 req-3870c9db-86dd-40a0-87f4-f35668e00db6 tempest-VolumesGetTestJSON-1851406784 None] Volume volume-dba4fee9-517b-4565-949a-5c5ffd353662 (dba4fee9-517b-4565-949a-5c5ffd353662): created successfully Jul 11 04:36:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-af8bd4b5-1ec5-4cb9-9c43-2684932795b9 req-3870c9db-86dd-40a0-87f4-f35668e00db6 tempest-VolumesGetTestJSON-1851406784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93e2f403-1b7e-46ac-a632-3a4e7225dcfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-af8bd4b5-1ec5-4cb9-9c43-2684932795b9 req-3870c9db-86dd-40a0-87f4-f35668e00db6 tempest-VolumesGetTestJSON-1851406784 None] Flow 'volume_create_manager' (e1f0210f-97a9-4beb-94a3-dc2f400fa4fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:36:35 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-quobyte-91ee0da2-c1b7-4ad4-85bd-4c33c0193eef" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:35 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] snapshot: 180a5435-9b1c-4e71-a371-a32f84e53cab, volume: 91ee0da2-c1b7-4ad4-85bd-4c33c0193eef, {{(pid=86964) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 04:36:35 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-af8bd4b5-1ec5-4cb9-9c43-2684932795b9 req-3870c9db-86dd-40a0-87f4-f35668e00db6 tempest-VolumesGetTestJSON-1851406784 None] Created volume successfully. Jul 11 04:36:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:36:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:36:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:36:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:36:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:36:36 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[42482f35-7008-416c-8f30-b36a44b90c16]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:36:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67.180a5435-9b1c-4e71-a371-a32f84e53cab {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:36 devstack sudo[100017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67.180a5435-9b1c-4e71-a371-a32f84e53cab Jul 11 04:36:36 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:36 devstack sudo[100015]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6e6dae8d-eb5a-4d32-bbcc-5074de175d24 tempest-VolumesImageMetadata-1688709160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b197ed7f-2b35-499d-ba1b-965f0dc9f499" returned: 1 in 0.765s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6e6dae8d-eb5a-4d32-bbcc-5074de175d24 tempest-VolumesImageMetadata-1688709160 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b197ed7f-2b35-499d-ba1b-965f0dc9f499' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:36:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6e6dae8d-eb5a-4d32-bbcc-5074de175d24 tempest-VolumesImageMetadata-1688709160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b197ed7f-2b35-499d-ba1b-965f0dc9f499 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:36 devstack sudo[100024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b197ed7f-2b35-499d-ba1b-965f0dc9f499 Jul 11 04:36:36 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:36 devstack cinder-volume[86964]: DEBUG cinder.coordination [req-a994ca92-0b09-466d-939d-b1f4fc6438c0 req-52ccb9cb-fdfe-4fb4-9660-beb98d094510 tempest-VolumesGetTestJSON-1851406784 None] Acquiring lock "cinder-dba4fee9-517b-4565-949a-5c5ffd353662-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:36 devstack cinder-volume[86964]: DEBUG cinder.coordination [req-a994ca92-0b09-466d-939d-b1f4fc6438c0 req-52ccb9cb-fdfe-4fb4-9660-beb98d094510 tempest-VolumesGetTestJSON-1851406784 None] Lock "cinder-dba4fee9-517b-4565-949a-5c5ffd353662-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:36 devstack cinder-volume[86964]: DEBUG cinder.coordination [req-a994ca92-0b09-466d-939d-b1f4fc6438c0 req-52ccb9cb-fdfe-4fb4-9660-beb98d094510 tempest-VolumesGetTestJSON-1851406784 None] Acquiring lock "cinder-quobyte-dba4fee9-517b-4565-949a-5c5ffd353662" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:36 devstack cinder-volume[86964]: DEBUG cinder.coordination [req-a994ca92-0b09-466d-939d-b1f4fc6438c0 req-52ccb9cb-fdfe-4fb4-9660-beb98d094510 tempest-VolumesGetTestJSON-1851406784 None] Lock "cinder-quobyte-dba4fee9-517b-4565-949a-5c5ffd353662" acquired by "delete_volume" :: waited 0.017s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:36 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[9768da27-1108-4db5-971e-10ce9864a672]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:36:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-a994ca92-0b09-466d-939d-b1f4fc6438c0 req-52ccb9cb-fdfe-4fb4-9660-beb98d094510 tempest-VolumesGetTestJSON-1851406784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dba4fee9-517b-4565-949a-5c5ffd353662 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:36 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67.180a5435-9b1c-4e71-a371-a32f84e53cab" returned: 0 in 0.839s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a01fd913-954a-4423-82a5-fc3460ce3b67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:36:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67 {{(pid=86964) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 04:36:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Creating direct copy from snapshot {{(pid=86964) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 04:36:36 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f9e250-93ac-4170-b152-6f959a73b30f]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:36:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:36 devstack sudo[100030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dba4fee9-517b-4565-949a-5c5ffd353662 Jul 11 04:36:36 devstack sudo[100030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:37 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67 Jul 11 04:36:37 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:37 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6e6dae8d-eb5a-4d32-bbcc-5074de175d24 tempest-VolumesImageMetadata-1688709160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b197ed7f-2b35-499d-ba1b-965f0dc9f499" returned: 0 in 0.673s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:37 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6e6dae8d-eb5a-4d32-bbcc-5074de175d24 tempest-VolumesImageMetadata-1688709160 None] Lock "cinder-quobyte-b197ed7f-2b35-499d-ba1b-965f0dc9f499" released by "delete_volume" :: held 2.284s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:36:37 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-6e6dae8d-eb5a-4d32-bbcc-5074de175d24 tempest-VolumesImageMetadata-1688709160 None] Created reservations ['d3b7d4ec-755b-4162-a7d0-b2df45578f91', '3a323fc3-3786-488e-a3d5-8189e54c21ce', 'e730b365-465f-4d05-8aa3-925d233c83e6', '7674db35-e8b3-4d57-9294-f2daf4f29e92'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:36:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6e6dae8d-eb5a-4d32-bbcc-5074de175d24 tempest-VolumesImageMetadata-1688709160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:36:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6e6dae8d-eb5a-4d32-bbcc-5074de175d24 tempest-VolumesImageMetadata-1688709160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:36:37 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6e6dae8d-eb5a-4d32-bbcc-5074de175d24 tempest-VolumesImageMetadata-1688709160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:36:37 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6e6dae8d-eb5a-4d32-bbcc-5074de175d24 tempest-VolumesImageMetadata-1688709160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:36:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6e6dae8d-eb5a-4d32-bbcc-5074de175d24 tempest-VolumesImageMetadata-1688709160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:36:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6e6dae8d-eb5a-4d32-bbcc-5074de175d24 tempest-VolumesImageMetadata-1688709160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:37 devstack sudo[100035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:36:37 devstack sudo[100035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:37 devstack sudo[100030]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-a994ca92-0b09-466d-939d-b1f4fc6438c0 req-52ccb9cb-fdfe-4fb4-9660-beb98d094510 tempest-VolumesGetTestJSON-1851406784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dba4fee9-517b-4565-949a-5c5ffd353662" returned: 0 in 0.782s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-a994ca92-0b09-466d-939d-b1f4fc6438c0 req-52ccb9cb-fdfe-4fb4-9660-beb98d094510 tempest-VolumesGetTestJSON-1851406784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dba4fee9-517b-4565-949a-5c5ffd353662 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:37 devstack sudo[100042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dba4fee9-517b-4565-949a-5c5ffd353662 Jul 11 04:36:37 devstack sudo[100042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:37 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67" returned: 0 in 0.830s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:37 devstack cinder-volume[86964]: DEBUG cinder.utils [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Path /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-91ee0da2-c1b7-4ad4-85bd-4c33c0193eef not found in is_blk_device check {{(pid=86964) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 04:36:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-91ee0da2-c1b7-4ad4-85bd-4c33c0193eef {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:37 devstack sudo[100045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-91ee0da2-c1b7-4ad4-85bd-4c33c0193eef Jul 11 04:36:37 devstack sudo[100045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:37 devstack sudo[100035]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6e6dae8d-eb5a-4d32-bbcc-5074de175d24 tempest-VolumesImageMetadata-1688709160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.627s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:38 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-6e6dae8d-eb5a-4d32-bbcc-5074de175d24 tempest-VolumesImageMetadata-1688709160 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:36:38 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-6e6dae8d-eb5a-4d32-bbcc-5074de175d24 tempest-VolumesImageMetadata-1688709160 None] Deleted volume successfully. Jul 11 04:36:38 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6e6dae8d-eb5a-4d32-bbcc-5074de175d24 tempest-VolumesImageMetadata-1688709160 None] Lock "cinder-b197ed7f-2b35-499d-ba1b-965f0dc9f499-delete_volume" released by "delete_volume" :: held 3.135s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:36:38 devstack sudo[100042]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-a994ca92-0b09-466d-939d-b1f4fc6438c0 req-52ccb9cb-fdfe-4fb4-9660-beb98d094510 tempest-VolumesGetTestJSON-1851406784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dba4fee9-517b-4565-949a-5c5ffd353662" returned: 0 in 0.671s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:38 devstack cinder-volume[86964]: DEBUG cinder.coordination [req-a994ca92-0b09-466d-939d-b1f4fc6438c0 req-52ccb9cb-fdfe-4fb4-9660-beb98d094510 tempest-VolumesGetTestJSON-1851406784 None] Lock "cinder-quobyte-dba4fee9-517b-4565-949a-5c5ffd353662" released by "delete_volume" :: held 1.515s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:36:38 devstack cinder-volume[86964]: DEBUG cinder.quota [req-a994ca92-0b09-466d-939d-b1f4fc6438c0 req-52ccb9cb-fdfe-4fb4-9660-beb98d094510 tempest-VolumesGetTestJSON-1851406784 None] Created reservations ['74bbc1be-7ff3-4e04-8fc4-ba9caa60556f', 'cb44a902-25b7-4b1d-b96d-789e95d7a458', '258a067c-6c2a-47ef-b007-86775132f575', '5676bfcd-88b7-459c-aafc-ef48d3218f0b'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:36:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-a994ca92-0b09-466d-939d-b1f4fc6438c0 req-52ccb9cb-fdfe-4fb4-9660-beb98d094510 tempest-VolumesGetTestJSON-1851406784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:36:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-a994ca92-0b09-466d-939d-b1f4fc6438c0 req-52ccb9cb-fdfe-4fb4-9660-beb98d094510 tempest-VolumesGetTestJSON-1851406784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:36:38 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [req-a994ca92-0b09-466d-939d-b1f4fc6438c0 req-52ccb9cb-fdfe-4fb4-9660-beb98d094510 tempest-VolumesGetTestJSON-1851406784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:36:38 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [req-a994ca92-0b09-466d-939d-b1f4fc6438c0 req-52ccb9cb-fdfe-4fb4-9660-beb98d094510 tempest-VolumesGetTestJSON-1851406784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:36:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-a994ca92-0b09-466d-939d-b1f4fc6438c0 req-52ccb9cb-fdfe-4fb4-9660-beb98d094510 tempest-VolumesGetTestJSON-1851406784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:36:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-a994ca92-0b09-466d-939d-b1f4fc6438c0 req-52ccb9cb-fdfe-4fb4-9660-beb98d094510 tempest-VolumesGetTestJSON-1851406784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:38 devstack sudo[100053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:36:38 devstack sudo[100053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:40 devstack sudo[100053]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-a994ca92-0b09-466d-939d-b1f4fc6438c0 req-52ccb9cb-fdfe-4fb4-9660-beb98d094510 tempest-VolumesGetTestJSON-1851406784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 1.758s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:40 devstack cinder-volume[86964]: DEBUG cinder.manager [req-a994ca92-0b09-466d-939d-b1f4fc6438c0 req-52ccb9cb-fdfe-4fb4-9660-beb98d094510 tempest-VolumesGetTestJSON-1851406784 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:36:40 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-a994ca92-0b09-466d-939d-b1f4fc6438c0 req-52ccb9cb-fdfe-4fb4-9660-beb98d094510 tempest-VolumesGetTestJSON-1851406784 None] Deleted volume successfully. Jul 11 04:36:40 devstack cinder-volume[86964]: DEBUG cinder.coordination [req-a994ca92-0b09-466d-939d-b1f4fc6438c0 req-52ccb9cb-fdfe-4fb4-9660-beb98d094510 tempest-VolumesGetTestJSON-1851406784 None] Lock "cinder-dba4fee9-517b-4565-949a-5c5ffd353662-delete_volume" released by "delete_volume" :: held 3.553s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:36:43 devstack sudo[100045]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-91ee0da2-c1b7-4ad4-85bd-4c33c0193eef" returned: 0 in 5.892s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:43 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[e433f98c-8300-4d63-ad3c-e7d86d6604a2]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:36:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:43 devstack sudo[100063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67 Jul 11 04:36:43 devstack sudo[100063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:44 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-661730f3-bded-48d6-9483-0b6aebafab8a tempest-VolumesMetadataTest-389348272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:36:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-661730f3-bded-48d6-9483-0b6aebafab8a tempest-VolumesMetadataTest-389348272 None] Flow 'volume_create_manager' (48c766c4-b019-4d87-b2c8-653f72b2cbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:36:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-661730f3-bded-48d6-9483-0b6aebafab8a tempest-VolumesMetadataTest-389348272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8487b0f6-ce7d-4fa2-8d3e-2de76ca72200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-661730f3-bded-48d6-9483-0b6aebafab8a tempest-VolumesMetadataTest-389348272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8487b0f6-ce7d-4fa2-8d3e-2de76ca72200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1693779177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba392f8e-7c2a-4b84-adc5-81561563e5c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9878fd9558144948d3b9509a2e5fd8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:36:44Z,use_quota=True,user_id='ccef915b98644b328323a1d50c683321',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-661730f3-bded-48d6-9483-0b6aebafab8a tempest-VolumesMetadataTest-389348272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1465f93-8150-4184-bc1c-161544542f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-661730f3-bded-48d6-9483-0b6aebafab8a tempest-VolumesMetadataTest-389348272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1465f93-8150-4184-bc1c-161544542f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-661730f3-bded-48d6-9483-0b6aebafab8a tempest-VolumesMetadataTest-389348272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55037969-1427-4047-8699-79c6c9e65c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-661730f3-bded-48d6-9483-0b6aebafab8a tempest-VolumesMetadataTest-389348272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55037969-1427-4047-8699-79c6c9e65c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba392f8e-7c2a-4b84-adc5-81561563e5c1', 'volume_name': 'volume-ba392f8e-7c2a-4b84-adc5-81561563e5c1', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-661730f3-bded-48d6-9483-0b6aebafab8a tempest-VolumesMetadataTest-389348272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dcc3f4c-af4a-4c59-902d-ab00d3c7429b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-661730f3-bded-48d6-9483-0b6aebafab8a tempest-VolumesMetadataTest-389348272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dcc3f4c-af4a-4c59-902d-ab00d3c7429b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-661730f3-bded-48d6-9483-0b6aebafab8a tempest-VolumesMetadataTest-389348272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6698c0d4-8a1e-40c0-a7d2-fdb2d2f27a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:44 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-661730f3-bded-48d6-9483-0b6aebafab8a tempest-VolumesMetadataTest-389348272 None] Volume ba392f8e-7c2a-4b84-adc5-81561563e5c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba392f8e-7c2a-4b84-adc5-81561563e5c1', 'volume_size': 1} Jul 11 04:36:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-661730f3-bded-48d6-9483-0b6aebafab8a tempest-VolumesMetadataTest-389348272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:36:44 devstack sudo[100063]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67" returned: 0 in 1.019s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:44 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Image conversion details: src /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67, size 1024.00 MB, duration 5.89 sec, destination /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-91ee0da2-c1b7-4ad4-85bd-4c33c0193eef {{(pid=86964) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 04:36:44 devstack cinder-volume[86964]: INFO cinder.image.image_utils [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Converted 1024.00 MB image at 173.75 MB/s Jul 11 04:36:44 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-91ee0da2-c1b7-4ad4-85bd-4c33c0193eef is being set with open permissions: ugo+rw Jul 11 04:36:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-91ee0da2-c1b7-4ad4-85bd-4c33c0193eef {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:44 devstack sudo[100068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-91ee0da2-c1b7-4ad4-85bd-4c33c0193eef Jul 11 04:36:44 devstack sudo[100068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:45 devstack sudo[100068]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-91ee0da2-c1b7-4ad4-85bd-4c33c0193eef" returned: 0 in 0.639s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:45 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-quobyte-91ee0da2-c1b7-4ad4-85bd-4c33c0193eef" released by "_copy_volume_from_snapshot" :: held 9.349s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:36:45 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-quobyte-180a5435-9b1c-4e71-a371-a32f84e53cab-91ee0da2-c1b7-4ad4-85bd-4c33c0193eef" released by "_create_volume_from_snapshot" :: held 9.396s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:36:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.434s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:36:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-661730f3-bded-48d6-9483-0b6aebafab8a tempest-VolumesMetadataTest-389348272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.979s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:36:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-661730f3-bded-48d6-9483-0b6aebafab8a tempest-VolumesMetadataTest-389348272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1693779177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba392f8e-7c2a-4b84-adc5-81561563e5c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9878fd9558144948d3b9509a2e5fd8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:36:44Z,use_quota=True,user_id='ccef915b98644b328323a1d50c683321',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:36:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-661730f3-bded-48d6-9483-0b6aebafab8a tempest-VolumesMetadataTest-389348272 None] Creating volume ba392f8e-7c2a-4b84-adc5-81561563e5c1 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:36:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-661730f3-bded-48d6-9483-0b6aebafab8a tempest-VolumesMetadataTest-389348272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:36:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-661730f3-bded-48d6-9483-0b6aebafab8a tempest-VolumesMetadataTest-389348272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:36:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-661730f3-bded-48d6-9483-0b6aebafab8a tempest-VolumesMetadataTest-389348272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:36:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-661730f3-bded-48d6-9483-0b6aebafab8a tempest-VolumesMetadataTest-389348272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:36:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-661730f3-bded-48d6-9483-0b6aebafab8a tempest-VolumesMetadataTest-389348272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:36:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-661730f3-bded-48d6-9483-0b6aebafab8a tempest-VolumesMetadataTest-389348272 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:36:45 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-661730f3-bded-48d6-9483-0b6aebafab8a tempest-VolumesMetadataTest-389348272 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:36:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-661730f3-bded-48d6-9483-0b6aebafab8a tempest-VolumesMetadataTest-389348272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ba392f8e-7c2a-4b84-adc5-81561563e5c1 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:45 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ba392f8e-7c2a-4b84-adc5-81561563e5c1 1073741824 Jul 11 04:36:45 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fb89ea9-6cc1-4348-b187-ece7c6ca34ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91ee0da2-c1b7-4ad4-85bd-4c33c0193eef', 'volume_size': 1, 'snapshot_id': '180a5435-9b1c-4e71-a371-a32f84e53cab'}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8a0d63e-d6f4-4fc7-8772-880060e096c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:45 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Volume volume-91ee0da2-c1b7-4ad4-85bd-4c33c0193eef (91ee0da2-c1b7-4ad4-85bd-4c33c0193eef): created successfully Jul 11 04:36:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8a0d63e-d6f4-4fc7-8772-880060e096c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Flow 'volume_create_manager' (2d4ecde8-0463-4041-aa10-e97b02c89f45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:36:45 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-e3681849-2741-4c5f-be45-a2db76f19534 tempest-VolumesSnapshotTestJSON-1323670043 None] Created volume successfully. Jul 11 04:36:46 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-661730f3-bded-48d6-9483-0b6aebafab8a tempest-VolumesMetadataTest-389348272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ba392f8e-7c2a-4b84-adc5-81561563e5c1 1073741824" returned: 0 in 0.804s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-661730f3-bded-48d6-9483-0b6aebafab8a tempest-VolumesMetadataTest-389348272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ba392f8e-7c2a-4b84-adc5-81561563e5c1 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:46 devstack sudo[100078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ba392f8e-7c2a-4b84-adc5-81561563e5c1 Jul 11 04:36:46 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:46 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-464ee56c-da81-4515-b089-01a10b15f981 tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "cinder-91ee0da2-c1b7-4ad4-85bd-4c33c0193eef-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:46 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-464ee56c-da81-4515-b089-01a10b15f981 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-91ee0da2-c1b7-4ad4-85bd-4c33c0193eef-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:46 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-464ee56c-da81-4515-b089-01a10b15f981 tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "cinder-quobyte-91ee0da2-c1b7-4ad4-85bd-4c33c0193eef" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:46 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-464ee56c-da81-4515-b089-01a10b15f981 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-quobyte-91ee0da2-c1b7-4ad4-85bd-4c33c0193eef" acquired by "delete_volume" :: waited 0.017s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:46 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f08390b-0b93-4a56-8e32-2b71738c0814]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:36:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-464ee56c-da81-4515-b089-01a10b15f981 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-91ee0da2-c1b7-4ad4-85bd-4c33c0193eef {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:46 devstack sudo[100080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-91ee0da2-c1b7-4ad4-85bd-4c33c0193eef Jul 11 04:36:46 devstack sudo[100080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ae496e81-5ec8-4ce9-bf24-b0a584e99c65 tempest-BackendsCapabilitiesAdminTestsJSON-1005325665 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.726375579834, 'free_capacity_gb': 1775.726375579834, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86964) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 11 04:36:46 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-661730f3-bded-48d6-9483-0b6aebafab8a tempest-VolumesMetadataTest-389348272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ba392f8e-7c2a-4b84-adc5-81561563e5c1" returned: 0 in 0.706s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:46 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-661730f3-bded-48d6-9483-0b6aebafab8a tempest-VolumesMetadataTest-389348272 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:36:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-661730f3-bded-48d6-9483-0b6aebafab8a tempest-VolumesMetadataTest-389348272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:36:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-661730f3-bded-48d6-9483-0b6aebafab8a tempest-VolumesMetadataTest-389348272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6698c0d4-8a1e-40c0-a7d2-fdb2d2f27a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba392f8e-7c2a-4b84-adc5-81561563e5c1', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-661730f3-bded-48d6-9483-0b6aebafab8a tempest-VolumesMetadataTest-389348272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d59c135-61a1-4ad6-8872-3d0978af5c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:46 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-661730f3-bded-48d6-9483-0b6aebafab8a tempest-VolumesMetadataTest-389348272 None] Volume volume-ba392f8e-7c2a-4b84-adc5-81561563e5c1 (ba392f8e-7c2a-4b84-adc5-81561563e5c1): created successfully Jul 11 04:36:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-661730f3-bded-48d6-9483-0b6aebafab8a tempest-VolumesMetadataTest-389348272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d59c135-61a1-4ad6-8872-3d0978af5c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-661730f3-bded-48d6-9483-0b6aebafab8a tempest-VolumesMetadataTest-389348272 None] Flow 'volume_create_manager' (48c766c4-b019-4d87-b2c8-653f72b2cbac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:36:46 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-661730f3-bded-48d6-9483-0b6aebafab8a tempest-VolumesMetadataTest-389348272 None] Created volume successfully. Jul 11 04:36:47 devstack sudo[100080]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-464ee56c-da81-4515-b089-01a10b15f981 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-91ee0da2-c1b7-4ad4-85bd-4c33c0193eef" returned: 0 in 0.737s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-464ee56c-da81-4515-b089-01a10b15f981 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-91ee0da2-c1b7-4ad4-85bd-4c33c0193eef {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:47 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-83eb6a57-acd2-492f-83c1-201c3262c006 tempest-BackendsCapabilitiesAdminTestsJSON-1005325665 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.726375579834, 'free_capacity_gb': 1775.726375579834, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86964) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 11 04:36:47 devstack sudo[100086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-91ee0da2-c1b7-4ad4-85bd-4c33c0193eef Jul 11 04:36:47 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:47 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-464ee56c-da81-4515-b089-01a10b15f981 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-91ee0da2-c1b7-4ad4-85bd-4c33c0193eef" returned: 0 in 0.707s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:47 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-464ee56c-da81-4515-b089-01a10b15f981 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-quobyte-91ee0da2-c1b7-4ad4-85bd-4c33c0193eef" released by "delete_volume" :: held 1.497s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:36:47 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-464ee56c-da81-4515-b089-01a10b15f981 tempest-VolumesSnapshotTestJSON-1323670043 None] Created reservations ['29738333-d00c-437d-b636-c1b94f0be468', 'cda6ab35-c1d3-439a-914d-15467323e616', 'f651d7f7-2f44-425f-8d95-45d4b2e92fea', '34613df3-a356-4f1a-a5e4-32c4d01bd21d'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:36:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-464ee56c-da81-4515-b089-01a10b15f981 tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:36:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-464ee56c-da81-4515-b089-01a10b15f981 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:36:47 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-464ee56c-da81-4515-b089-01a10b15f981 tempest-VolumesSnapshotTestJSON-1323670043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:36:47 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-464ee56c-da81-4515-b089-01a10b15f981 tempest-VolumesSnapshotTestJSON-1323670043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:36:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-464ee56c-da81-4515-b089-01a10b15f981 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:36:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-464ee56c-da81-4515-b089-01a10b15f981 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:48 devstack sudo[100091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:36:48 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:48 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-5988ceb9-3cf4-446a-9168-9f64a5c111a0 tempest-VolumesMetadataTest-389348272 None] Acquiring lock "cinder-ba392f8e-7c2a-4b84-adc5-81561563e5c1-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:48 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-5988ceb9-3cf4-446a-9168-9f64a5c111a0 tempest-VolumesMetadataTest-389348272 None] Lock "cinder-ba392f8e-7c2a-4b84-adc5-81561563e5c1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:48 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-9844d180-a91e-4eb0-a9f9-e56a2ad20d66 tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "cinder-180a5435-9b1c-4e71-a371-a32f84e53cab-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:48 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-5988ceb9-3cf4-446a-9168-9f64a5c111a0 tempest-VolumesMetadataTest-389348272 None] Acquiring lock "cinder-quobyte-ba392f8e-7c2a-4b84-adc5-81561563e5c1" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:48 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-9844d180-a91e-4eb0-a9f9-e56a2ad20d66 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-180a5435-9b1c-4e71-a371-a32f84e53cab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:48 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-9844d180-a91e-4eb0-a9f9-e56a2ad20d66 tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "cinder-quobyte-a01fd913-954a-4423-82a5-fc3460ce3b67" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:48 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-5988ceb9-3cf4-446a-9168-9f64a5c111a0 tempest-VolumesMetadataTest-389348272 None] Lock "cinder-quobyte-ba392f8e-7c2a-4b84-adc5-81561563e5c1" acquired by "delete_volume" :: waited 0.037s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:48 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-9844d180-a91e-4eb0-a9f9-e56a2ad20d66 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-quobyte-a01fd913-954a-4423-82a5-fc3460ce3b67" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:48 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-9844d180-a91e-4eb0-a9f9-e56a2ad20d66 tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "cinder-quobyte-180a5435-9b1c-4e71-a371-a32f84e53cab" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:48 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c433730-345e-4a57-aeff-ec3b4ad017e2]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:36:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5988ceb9-3cf4-446a-9168-9f64a5c111a0 tempest-VolumesMetadataTest-389348272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ba392f8e-7c2a-4b84-adc5-81561563e5c1 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:48 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-9844d180-a91e-4eb0-a9f9-e56a2ad20d66 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-quobyte-180a5435-9b1c-4e71-a371-a32f84e53cab" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:48 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:48 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-9844d180-a91e-4eb0-a9f9-e56a2ad20d66 tempest-VolumesSnapshotTestJSON-1323670043 None] Deleting offline snapshot 180a5435-9b1c-4e71-a371-a32f84e53cab of volume a01fd913-954a-4423-82a5-fc3460ce3b67 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:36:48 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-9844d180-a91e-4eb0-a9f9-e56a2ad20d66 tempest-VolumesSnapshotTestJSON-1323670043 None] snapshot_file for this snap is: volume-a01fd913-954a-4423-82a5-fc3460ce3b67.180a5435-9b1c-4e71-a371-a32f84e53cab {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:36:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-464ee56c-da81-4515-b089-01a10b15f981 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.809s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:48 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-464ee56c-da81-4515-b089-01a10b15f981 tempest-VolumesSnapshotTestJSON-1323670043 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:36:48 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-464ee56c-da81-4515-b089-01a10b15f981 tempest-VolumesSnapshotTestJSON-1323670043 None] Deleted volume successfully. Jul 11 04:36:48 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[9460244c-6643-41a0-9605-2357b70e9b76]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:36:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9844d180-a91e-4eb0-a9f9-e56a2ad20d66 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67.180a5435-9b1c-4e71-a371-a32f84e53cab {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:48 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-464ee56c-da81-4515-b089-01a10b15f981 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-91ee0da2-c1b7-4ad4-85bd-4c33c0193eef-delete_volume" released by "delete_volume" :: held 2.558s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:36:48 devstack sudo[100094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ba392f8e-7c2a-4b84-adc5-81561563e5c1 Jul 11 04:36:48 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:48 devstack sudo[100095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67.180a5435-9b1c-4e71-a371-a32f84e53cab Jul 11 04:36:48 devstack sudo[100095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:49 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5988ceb9-3cf4-446a-9168-9f64a5c111a0 tempest-VolumesMetadataTest-389348272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ba392f8e-7c2a-4b84-adc5-81561563e5c1" returned: 0 in 0.847s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5988ceb9-3cf4-446a-9168-9f64a5c111a0 tempest-VolumesMetadataTest-389348272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ba392f8e-7c2a-4b84-adc5-81561563e5c1 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:49 devstack sudo[100104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ba392f8e-7c2a-4b84-adc5-81561563e5c1 Jul 11 04:36:49 devstack sudo[100104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:49 devstack sudo[100095]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9844d180-a91e-4eb0-a9f9-e56a2ad20d66 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67.180a5435-9b1c-4e71-a371-a32f84e53cab" returned: 0 in 0.880s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-9844d180-a91e-4eb0-a9f9-e56a2ad20d66 tempest-VolumesSnapshotTestJSON-1323670043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a01fd913-954a-4423-82a5-fc3460ce3b67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:36:49 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3b958d-55bd-4c1e-8d88-e16418d45f52]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:36:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9844d180-a91e-4eb0-a9f9-e56a2ad20d66 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:49 devstack sudo[100106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67 Jul 11 04:36:49 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:50 devstack sudo[100104]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5988ceb9-3cf4-446a-9168-9f64a5c111a0 tempest-VolumesMetadataTest-389348272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ba392f8e-7c2a-4b84-adc5-81561563e5c1" returned: 0 in 0.736s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-5988ceb9-3cf4-446a-9168-9f64a5c111a0 tempest-VolumesMetadataTest-389348272 None] Lock "cinder-quobyte-ba392f8e-7c2a-4b84-adc5-81561563e5c1" released by "delete_volume" :: held 1.628s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:36:50 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-5988ceb9-3cf4-446a-9168-9f64a5c111a0 tempest-VolumesMetadataTest-389348272 None] Created reservations ['99bc939e-43da-45f0-8288-896f92a6384b', '5dd30d03-c62b-43a3-90c0-adf46066b7db', '4cded0d3-7583-4f06-b22f-6bd2e2184936', '989261f7-1035-4764-870b-d686fd926661'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:36:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5988ceb9-3cf4-446a-9168-9f64a5c111a0 tempest-VolumesMetadataTest-389348272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:36:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5988ceb9-3cf4-446a-9168-9f64a5c111a0 tempest-VolumesMetadataTest-389348272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:36:50 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-5988ceb9-3cf4-446a-9168-9f64a5c111a0 tempest-VolumesMetadataTest-389348272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:36:50 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-5988ceb9-3cf4-446a-9168-9f64a5c111a0 tempest-VolumesMetadataTest-389348272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:36:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5988ceb9-3cf4-446a-9168-9f64a5c111a0 tempest-VolumesMetadataTest-389348272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:36:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5988ceb9-3cf4-446a-9168-9f64a5c111a0 tempest-VolumesMetadataTest-389348272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:50 devstack sudo[100112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:36:50 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:50 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9844d180-a91e-4eb0-a9f9-e56a2ad20d66 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67" returned: 0 in 0.877s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9844d180-a91e-4eb0-a9f9-e56a2ad20d66 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67.180a5435-9b1c-4e71-a371-a32f84e53cab {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:50 devstack sudo[100114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67.180a5435-9b1c-4e71-a371-a32f84e53cab Jul 11 04:36:50 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:51 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5988ceb9-3cf4-446a-9168-9f64a5c111a0 tempest-VolumesMetadataTest-389348272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.668s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:51 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-5988ceb9-3cf4-446a-9168-9f64a5c111a0 tempest-VolumesMetadataTest-389348272 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:36:51 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-5988ceb9-3cf4-446a-9168-9f64a5c111a0 tempest-VolumesMetadataTest-389348272 None] Deleted volume successfully. Jul 11 04:36:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-5988ceb9-3cf4-446a-9168-9f64a5c111a0 tempest-VolumesMetadataTest-389348272 None] Lock "cinder-ba392f8e-7c2a-4b84-adc5-81561563e5c1-delete_volume" released by "delete_volume" :: held 2.627s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:36:51 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9844d180-a91e-4eb0-a9f9-e56a2ad20d66 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67.180a5435-9b1c-4e71-a371-a32f84e53cab" returned: 0 in 0.905s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9844d180-a91e-4eb0-a9f9-e56a2ad20d66 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67.180a5435-9b1c-4e71-a371-a32f84e53cab {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:51 devstack sudo[100120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67.180a5435-9b1c-4e71-a371-a32f84e53cab Jul 11 04:36:51 devstack sudo[100120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:52 devstack sudo[100120]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9844d180-a91e-4eb0-a9f9-e56a2ad20d66 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67.180a5435-9b1c-4e71-a371-a32f84e53cab" returned: 0 in 0.797s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:52 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-9844d180-a91e-4eb0-a9f9-e56a2ad20d66 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-quobyte-180a5435-9b1c-4e71-a371-a32f84e53cab" released by "_delete_snapshot" :: held 3.616s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:36:52 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-9844d180-a91e-4eb0-a9f9-e56a2ad20d66 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-quobyte-a01fd913-954a-4423-82a5-fc3460ce3b67" released by "delete_snapshot" :: held 3.663s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:36:52 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-9844d180-a91e-4eb0-a9f9-e56a2ad20d66 tempest-VolumesSnapshotTestJSON-1323670043 None] Created reservations ['39b9964b-0bba-4958-83a0-5df5bc32bd41', '2a3d50d4-0040-4c32-9185-6abbaddab324', '31bba6d1-8e89-48e6-b0db-86c1bd2b464c', 'f8482489-f9e1-4b66-9bd6-dd171302292e'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:36:52 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-9844d180-a91e-4eb0-a9f9-e56a2ad20d66 tempest-VolumesSnapshotTestJSON-1323670043 None] Delete snapshot completed successfully. Jul 11 04:36:52 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-9844d180-a91e-4eb0-a9f9-e56a2ad20d66 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-180a5435-9b1c-4e71-a371-a32f84e53cab-delete_snapshot" released by "delete_snapshot" :: held 3.833s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:36:53 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-aa6e2501-8c5e-46f6-bba6-f2ecb8833cb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "cinder-a01fd913-954a-4423-82a5-fc3460ce3b67-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:53 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-aa6e2501-8c5e-46f6-bba6-f2ecb8833cb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-a01fd913-954a-4423-82a5-fc3460ce3b67-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:53 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-aa6e2501-8c5e-46f6-bba6-f2ecb8833cb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "cinder-quobyte-a01fd913-954a-4423-82a5-fc3460ce3b67" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:53 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-aa6e2501-8c5e-46f6-bba6-f2ecb8833cb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-quobyte-a01fd913-954a-4423-82a5-fc3460ce3b67" acquired by "delete_volume" :: waited 0.015s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:53 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ca8c97-e04e-4b62-82e9-52a6af6fc242]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:36:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-aa6e2501-8c5e-46f6-bba6-f2ecb8833cb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:53 devstack sudo[100123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67 Jul 11 04:36:53 devstack sudo[100123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:53 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-4ec96f56-969f-4453-8fc1-89d5cbfea84a tempest-GroupsTest-2041898812 None] Group tempest-Group1-245047776: creating Jul 11 04:36:53 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=131,cinder:INSERT=50,cinder:UPDATE=160,cinder:DELETE=16 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:36:53 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-4ec96f56-969f-4453-8fc1-89d5cbfea84a tempest-GroupsTest-2041898812 None] Group tempest-Group1-245047776: created successfully Jul 11 04:36:53 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-4ec96f56-969f-4453-8fc1-89d5cbfea84a tempest-GroupsTest-2041898812 None] Create group completed successfully. Jul 11 04:36:54 devstack sudo[100123]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-aa6e2501-8c5e-46f6-bba6-f2ecb8833cb0 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67" returned: 0 in 0.848s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-aa6e2501-8c5e-46f6-bba6-f2ecb8833cb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:54 devstack sudo[100128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67 Jul 11 04:36:54 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:54 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-6703ad15-801f-4a29-b127-898b22572333 tempest-GroupsTest-2041898812 None] Group tempest-Group2-1213900689: creating Jul 11 04:36:54 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-6703ad15-801f-4a29-b127-898b22572333 tempest-GroupsTest-2041898812 None] Group tempest-Group2-1213900689: created successfully Jul 11 04:36:54 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-6703ad15-801f-4a29-b127-898b22572333 tempest-GroupsTest-2041898812 None] Create group completed successfully. Jul 11 04:36:54 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-aa6e2501-8c5e-46f6-bba6-f2ecb8833cb0 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a01fd913-954a-4423-82a5-fc3460ce3b67" returned: 0 in 0.704s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:54 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-aa6e2501-8c5e-46f6-bba6-f2ecb8833cb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-quobyte-a01fd913-954a-4423-82a5-fc3460ce3b67" released by "delete_volume" :: held 1.627s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:36:54 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-aa6e2501-8c5e-46f6-bba6-f2ecb8833cb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Created reservations ['fc094359-192c-487d-ae73-43023269d760', '95f204e6-9c96-45e0-bd72-0d58e764c0b9', '4197db21-a338-4097-be4d-a129957b1927', '75dea93c-1e43-4be6-be32-6c96b64e47a2'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:36:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-aa6e2501-8c5e-46f6-bba6-f2ecb8833cb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:36:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-aa6e2501-8c5e-46f6-bba6-f2ecb8833cb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:36:54 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-aa6e2501-8c5e-46f6-bba6-f2ecb8833cb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:36:54 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-aa6e2501-8c5e-46f6-bba6-f2ecb8833cb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:36:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-aa6e2501-8c5e-46f6-bba6-f2ecb8833cb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:36:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-aa6e2501-8c5e-46f6-bba6-f2ecb8833cb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:54 devstack sudo[100131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:36:54 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:55 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-5883801d-0d8c-4fdd-919c-6dbffcc3cb89 tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "cinder-45dd46a7-a8fe-4b98-a49c-690c8f0d4765-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:55 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-5883801d-0d8c-4fdd-919c-6dbffcc3cb89 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-45dd46a7-a8fe-4b98-a49c-690c8f0d4765-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:55 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-5883801d-0d8c-4fdd-919c-6dbffcc3cb89 tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "cinder-quobyte-45dd46a7-a8fe-4b98-a49c-690c8f0d4765" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:55 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-5883801d-0d8c-4fdd-919c-6dbffcc3cb89 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-quobyte-45dd46a7-a8fe-4b98-a49c-690c8f0d4765" acquired by "delete_volume" :: waited 0.020s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:55 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-aa6e2501-8c5e-46f6-bba6-f2ecb8833cb0 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.669s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:55 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-aa6e2501-8c5e-46f6-bba6-f2ecb8833cb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:36:55 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-aa6e2501-8c5e-46f6-bba6-f2ecb8833cb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Deleted volume successfully. Jul 11 04:36:55 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac255cd-5f3b-41d6-9e27-5c2433a29ed7]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:36:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5883801d-0d8c-4fdd-919c-6dbffcc3cb89 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:55 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-aa6e2501-8c5e-46f6-bba6-f2ecb8833cb0 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-a01fd913-954a-4423-82a5-fc3460ce3b67-delete_volume" released by "delete_volume" :: held 2.519s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:36:55 devstack sudo[100135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765 Jul 11 04:36:55 devstack sudo[100135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:55 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-32e963c8-27d9-4ae4-84e6-ef32df875877 tempest-VolumesTransfersV357Test-1583639504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:36:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-32e963c8-27d9-4ae4-84e6-ef32df875877 tempest-VolumesTransfersV357Test-1583639504 None] Flow 'volume_create_manager' (7f42eacd-2fdb-4282-92f4-98b862b58d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:36:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-32e963c8-27d9-4ae4-84e6-ef32df875877 tempest-VolumesTransfersV357Test-1583639504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84175f59-0e22-49c5-97a4-a2b92123a506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-32e963c8-27d9-4ae4-84e6-ef32df875877 tempest-VolumesTransfersV357Test-1583639504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84175f59-0e22-49c5-97a4-a2b92123a506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2128068058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a27b6c3f-5a7d-4188-ae28-4cbb5715c316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5835208207a485498a84f70a636ef01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:36:56Z,use_quota=True,user_id='9e1e0ffc150b46cabe669e6d278fd06f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-32e963c8-27d9-4ae4-84e6-ef32df875877 tempest-VolumesTransfersV357Test-1583639504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (929ac6d9-c8e5-4e84-9ae2-5cd158bc3f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-32e963c8-27d9-4ae4-84e6-ef32df875877 tempest-VolumesTransfersV357Test-1583639504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (929ac6d9-c8e5-4e84-9ae2-5cd158bc3f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-32e963c8-27d9-4ae4-84e6-ef32df875877 tempest-VolumesTransfersV357Test-1583639504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7511c2a-39c1-47b5-b413-bfcb0d0972b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-32e963c8-27d9-4ae4-84e6-ef32df875877 tempest-VolumesTransfersV357Test-1583639504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7511c2a-39c1-47b5-b413-bfcb0d0972b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a27b6c3f-5a7d-4188-ae28-4cbb5715c316', 'volume_name': 'volume-a27b6c3f-5a7d-4188-ae28-4cbb5715c316', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-32e963c8-27d9-4ae4-84e6-ef32df875877 tempest-VolumesTransfersV357Test-1583639504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53ddf218-c4aa-493c-bd18-7efc02c5428e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-32e963c8-27d9-4ae4-84e6-ef32df875877 tempest-VolumesTransfersV357Test-1583639504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53ddf218-c4aa-493c-bd18-7efc02c5428e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-32e963c8-27d9-4ae4-84e6-ef32df875877 tempest-VolumesTransfersV357Test-1583639504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b9d61fd-0159-44f8-a0b1-78362f77b572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:55 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-32e963c8-27d9-4ae4-84e6-ef32df875877 tempest-VolumesTransfersV357Test-1583639504 None] Volume a27b6c3f-5a7d-4188-ae28-4cbb5715c316: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a27b6c3f-5a7d-4188-ae28-4cbb5715c316', 'volume_size': 1} Jul 11 04:36:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-32e963c8-27d9-4ae4-84e6-ef32df875877 tempest-VolumesTransfersV357Test-1583639504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:36:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-32e963c8-27d9-4ae4-84e6-ef32df875877 tempest-VolumesTransfersV357Test-1583639504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:36:55 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-32e963c8-27d9-4ae4-84e6-ef32df875877 tempest-VolumesTransfersV357Test-1583639504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2128068058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a27b6c3f-5a7d-4188-ae28-4cbb5715c316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5835208207a485498a84f70a636ef01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:36:56Z,use_quota=True,user_id='9e1e0ffc150b46cabe669e6d278fd06f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:36:55 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-32e963c8-27d9-4ae4-84e6-ef32df875877 tempest-VolumesTransfersV357Test-1583639504 None] Creating volume a27b6c3f-5a7d-4188-ae28-4cbb5715c316 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:36:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-32e963c8-27d9-4ae4-84e6-ef32df875877 tempest-VolumesTransfersV357Test-1583639504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:36:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-32e963c8-27d9-4ae4-84e6-ef32df875877 tempest-VolumesTransfersV357Test-1583639504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:36:55 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-32e963c8-27d9-4ae4-84e6-ef32df875877 tempest-VolumesTransfersV357Test-1583639504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:36:55 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-32e963c8-27d9-4ae4-84e6-ef32df875877 tempest-VolumesTransfersV357Test-1583639504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:36:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-32e963c8-27d9-4ae4-84e6-ef32df875877 tempest-VolumesTransfersV357Test-1583639504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:36:55 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-32e963c8-27d9-4ae4-84e6-ef32df875877 tempest-VolumesTransfersV357Test-1583639504 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:36:55 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-32e963c8-27d9-4ae4-84e6-ef32df875877 tempest-VolumesTransfersV357Test-1583639504 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:36:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-32e963c8-27d9-4ae4-84e6-ef32df875877 tempest-VolumesTransfersV357Test-1583639504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a27b6c3f-5a7d-4188-ae28-4cbb5715c316 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:55 devstack sudo[100137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a27b6c3f-5a7d-4188-ae28-4cbb5715c316 1073741824 Jul 11 04:36:55 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:56 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-91e10d66-2680-4c9b-a0b2-192e7c285a4d tempest-GroupsTest-2041898812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:36:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-91e10d66-2680-4c9b-a0b2-192e7c285a4d tempest-GroupsTest-2041898812 None] Flow 'volume_create_manager' (e16a4761-10f1-479b-8c02-36cf5454273f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:36:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-91e10d66-2680-4c9b-a0b2-192e7c285a4d tempest-GroupsTest-2041898812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (291a0d2e-d63e-4bea-aa0d-bfc9bb5d31de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-91e10d66-2680-4c9b-a0b2-192e7c285a4d tempest-GroupsTest-2041898812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (291a0d2e-d63e-4bea-aa0d-bfc9bb5d31de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1350646594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eb677667-6927-49f6-b2b1-6fb5ccfc8c5b,host='devstack@QuobyteHD#QuobyteHD',id=b8ee8519-90b7-46ad-81c5-4bc8fe8b6bfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe75b68d9554eac9324c641fc092788',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:36:56Z,use_quota=True,user_id='a25921b83a2348feac28d01adfac763d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d46608a-1ee5-4f1f-9e9a-48ea5ef3e7c2),volume_type_id=1d46608a-1ee5-4f1f-9e9a-48ea5ef3e7c2)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-91e10d66-2680-4c9b-a0b2-192e7c285a4d tempest-GroupsTest-2041898812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3889b974-d57c-46e1-a184-4d31131926fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-91e10d66-2680-4c9b-a0b2-192e7c285a4d tempest-GroupsTest-2041898812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3889b974-d57c-46e1-a184-4d31131926fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-91e10d66-2680-4c9b-a0b2-192e7c285a4d tempest-GroupsTest-2041898812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8d44c75-15cc-4e17-90d6-9c21f6d9c614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-91e10d66-2680-4c9b-a0b2-192e7c285a4d tempest-GroupsTest-2041898812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8d44c75-15cc-4e17-90d6-9c21f6d9c614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8ee8519-90b7-46ad-81c5-4bc8fe8b6bfd', 'volume_name': 'volume-b8ee8519-90b7-46ad-81c5-4bc8fe8b6bfd', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-91e10d66-2680-4c9b-a0b2-192e7c285a4d tempest-GroupsTest-2041898812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88afdb97-73e0-4c26-bd5c-3f16a26c6ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-91e10d66-2680-4c9b-a0b2-192e7c285a4d tempest-GroupsTest-2041898812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88afdb97-73e0-4c26-bd5c-3f16a26c6ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:56 devstack sudo[100135]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-91e10d66-2680-4c9b-a0b2-192e7c285a4d tempest-GroupsTest-2041898812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83b7fc13-fd21-4dc1-8b6e-b6169559ac40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:56 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-91e10d66-2680-4c9b-a0b2-192e7c285a4d tempest-GroupsTest-2041898812 None] Volume b8ee8519-90b7-46ad-81c5-4bc8fe8b6bfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8ee8519-90b7-46ad-81c5-4bc8fe8b6bfd', 'volume_size': 1} Jul 11 04:36:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-91e10d66-2680-4c9b-a0b2-192e7c285a4d tempest-GroupsTest-2041898812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:36:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5883801d-0d8c-4fdd-919c-6dbffcc3cb89 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765" returned: 0 in 0.840s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5883801d-0d8c-4fdd-919c-6dbffcc3cb89 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:56 devstack sudo[100142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765 Jul 11 04:36:56 devstack sudo[100142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:56 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-32e963c8-27d9-4ae4-84e6-ef32df875877 tempest-VolumesTransfersV357Test-1583639504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a27b6c3f-5a7d-4188-ae28-4cbb5715c316 1073741824" returned: 0 in 0.938s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-32e963c8-27d9-4ae4-84e6-ef32df875877 tempest-VolumesTransfersV357Test-1583639504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a27b6c3f-5a7d-4188-ae28-4cbb5715c316 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:56 devstack sudo[100148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a27b6c3f-5a7d-4188-ae28-4cbb5715c316 Jul 11 04:36:56 devstack sudo[100148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:57 devstack sudo[100142]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5883801d-0d8c-4fdd-919c-6dbffcc3cb89 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45dd46a7-a8fe-4b98-a49c-690c8f0d4765" returned: 0 in 0.657s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:57 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-5883801d-0d8c-4fdd-919c-6dbffcc3cb89 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-quobyte-45dd46a7-a8fe-4b98-a49c-690c8f0d4765" released by "delete_volume" :: held 1.604s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:36:57 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-5883801d-0d8c-4fdd-919c-6dbffcc3cb89 tempest-VolumesSnapshotTestJSON-1323670043 None] Created reservations ['5eefe4eb-1441-4c8f-bf31-48daa1c81fa3', '3cc02f56-740b-4b81-aede-89994fb7e8da', '18a69001-7b40-4ee4-8708-b81fec622647', '983aa3d6-226a-4fe9-a4fb-0eaa2da980cd'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:36:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5883801d-0d8c-4fdd-919c-6dbffcc3cb89 tempest-VolumesSnapshotTestJSON-1323670043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:36:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5883801d-0d8c-4fdd-919c-6dbffcc3cb89 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:36:57 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-5883801d-0d8c-4fdd-919c-6dbffcc3cb89 tempest-VolumesSnapshotTestJSON-1323670043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:36:57 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-5883801d-0d8c-4fdd-919c-6dbffcc3cb89 tempest-VolumesSnapshotTestJSON-1323670043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:36:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5883801d-0d8c-4fdd-919c-6dbffcc3cb89 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:36:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5883801d-0d8c-4fdd-919c-6dbffcc3cb89 tempest-VolumesSnapshotTestJSON-1323670043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:57 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:36:57 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:57 devstack sudo[100148]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-32e963c8-27d9-4ae4-84e6-ef32df875877 tempest-VolumesTransfersV357Test-1583639504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a27b6c3f-5a7d-4188-ae28-4cbb5715c316" returned: 0 in 0.687s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:57 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-32e963c8-27d9-4ae4-84e6-ef32df875877 tempest-VolumesTransfersV357Test-1583639504 None] <== create_volume: return (1669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:36:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-32e963c8-27d9-4ae4-84e6-ef32df875877 tempest-VolumesTransfersV357Test-1583639504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.673s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:36:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-91e10d66-2680-4c9b-a0b2-192e7c285a4d tempest-GroupsTest-2041898812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.067s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:36:57 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-91e10d66-2680-4c9b-a0b2-192e7c285a4d tempest-GroupsTest-2041898812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=eb677667-6927-49f6-b2b1-6fb5ccfc8c5b,created_at=2026-07-11T02:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1350646594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eb677667-6927-49f6-b2b1-6fb5ccfc8c5b,host='devstack@QuobyteHD#QuobyteHD',id=b8ee8519-90b7-46ad-81c5-4bc8fe8b6bfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe75b68d9554eac9324c641fc092788',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:36:56Z,use_quota=True,user_id='a25921b83a2348feac28d01adfac763d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d46608a-1ee5-4f1f-9e9a-48ea5ef3e7c2),volume_type_id=1d46608a-1ee5-4f1f-9e9a-48ea5ef3e7c2)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:36:57 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-91e10d66-2680-4c9b-a0b2-192e7c285a4d tempest-GroupsTest-2041898812 None] Creating volume b8ee8519-90b7-46ad-81c5-4bc8fe8b6bfd {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:36:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-91e10d66-2680-4c9b-a0b2-192e7c285a4d tempest-GroupsTest-2041898812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:36:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-91e10d66-2680-4c9b-a0b2-192e7c285a4d tempest-GroupsTest-2041898812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:36:57 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-91e10d66-2680-4c9b-a0b2-192e7c285a4d tempest-GroupsTest-2041898812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:36:57 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-91e10d66-2680-4c9b-a0b2-192e7c285a4d tempest-GroupsTest-2041898812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:36:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-91e10d66-2680-4c9b-a0b2-192e7c285a4d tempest-GroupsTest-2041898812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:36:57 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-91e10d66-2680-4c9b-a0b2-192e7c285a4d tempest-GroupsTest-2041898812 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:36:57 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-91e10d66-2680-4c9b-a0b2-192e7c285a4d tempest-GroupsTest-2041898812 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:36:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-91e10d66-2680-4c9b-a0b2-192e7c285a4d tempest-GroupsTest-2041898812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b8ee8519-90b7-46ad-81c5-4bc8fe8b6bfd 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:57 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-32e963c8-27d9-4ae4-84e6-ef32df875877 tempest-VolumesTransfersV357Test-1583639504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b9d61fd-0159-44f8-a0b1-78362f77b572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a27b6c3f-5a7d-4188-ae28-4cbb5715c316', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:57 devstack sudo[100154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b8ee8519-90b7-46ad-81c5-4bc8fe8b6bfd 1073741824 Jul 11 04:36:57 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:57 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-32e963c8-27d9-4ae4-84e6-ef32df875877 tempest-VolumesTransfersV357Test-1583639504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38b1788e-f61e-4764-981e-a58bda359bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:57 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-32e963c8-27d9-4ae4-84e6-ef32df875877 tempest-VolumesTransfersV357Test-1583639504 None] Volume volume-a27b6c3f-5a7d-4188-ae28-4cbb5715c316 (a27b6c3f-5a7d-4188-ae28-4cbb5715c316): created successfully Jul 11 04:36:57 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-32e963c8-27d9-4ae4-84e6-ef32df875877 tempest-VolumesTransfersV357Test-1583639504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38b1788e-f61e-4764-981e-a58bda359bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:57 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-32e963c8-27d9-4ae4-84e6-ef32df875877 tempest-VolumesTransfersV357Test-1583639504 None] Flow 'volume_create_manager' (7f42eacd-2fdb-4282-92f4-98b862b58d2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:36:57 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-32e963c8-27d9-4ae4-84e6-ef32df875877 tempest-VolumesTransfersV357Test-1583639504 None] Created volume successfully. Jul 11 04:36:57 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5883801d-0d8c-4fdd-919c-6dbffcc3cb89 tempest-VolumesSnapshotTestJSON-1323670043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.713s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:57 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-5883801d-0d8c-4fdd-919c-6dbffcc3cb89 tempest-VolumesSnapshotTestJSON-1323670043 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:36:57 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-5883801d-0d8c-4fdd-919c-6dbffcc3cb89 tempest-VolumesSnapshotTestJSON-1323670043 None] Deleted volume successfully. Jul 11 04:36:57 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-5883801d-0d8c-4fdd-919c-6dbffcc3cb89 tempest-VolumesSnapshotTestJSON-1323670043 None] Lock "cinder-45dd46a7-a8fe-4b98-a49c-690c8f0d4765-delete_volume" released by "delete_volume" :: held 2.558s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:36:58 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-587aeb5b-7872-4a0d-a9fd-d0085e737145 tempest-VolumesTransfersV357Test-1943081883 None] Transfer volume completed successfully. Jul 11 04:36:58 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-91e10d66-2680-4c9b-a0b2-192e7c285a4d tempest-GroupsTest-2041898812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b8ee8519-90b7-46ad-81c5-4bc8fe8b6bfd 1073741824" returned: 0 in 1.023s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-91e10d66-2680-4c9b-a0b2-192e7c285a4d tempest-GroupsTest-2041898812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b8ee8519-90b7-46ad-81c5-4bc8fe8b6bfd {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:58 devstack sudo[100161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b8ee8519-90b7-46ad-81c5-4bc8fe8b6bfd Jul 11 04:36:58 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:59 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:36:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:36:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:36:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:36:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:36:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:36:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:59 devstack sudo[100165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:36:59 devstack sudo[100165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:59 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-91e10d66-2680-4c9b-a0b2-192e7c285a4d tempest-GroupsTest-2041898812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b8ee8519-90b7-46ad-81c5-4bc8fe8b6bfd" returned: 0 in 0.758s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-91e10d66-2680-4c9b-a0b2-192e7c285a4d tempest-GroupsTest-2041898812 None] <== create_volume: return (1838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:36:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-91e10d66-2680-4c9b-a0b2-192e7c285a4d tempest-GroupsTest-2041898812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.844s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:36:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-91e10d66-2680-4c9b-a0b2-192e7c285a4d tempest-GroupsTest-2041898812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83b7fc13-fd21-4dc1-8b6e-b6169559ac40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8ee8519-90b7-46ad-81c5-4bc8fe8b6bfd', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-91e10d66-2680-4c9b-a0b2-192e7c285a4d tempest-GroupsTest-2041898812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26339892-95e6-4f2f-94ee-7515814d7f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:36:59 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:UPDATE=157,cinder:INSERT=38,cinder:SELECT=120,cinder:DELETE=10 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:36:59 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-91e10d66-2680-4c9b-a0b2-192e7c285a4d tempest-GroupsTest-2041898812 None] Volume volume-b8ee8519-90b7-46ad-81c5-4bc8fe8b6bfd (b8ee8519-90b7-46ad-81c5-4bc8fe8b6bfd): created successfully Jul 11 04:36:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-91e10d66-2680-4c9b-a0b2-192e7c285a4d tempest-GroupsTest-2041898812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26339892-95e6-4f2f-94ee-7515814d7f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:36:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-91e10d66-2680-4c9b-a0b2-192e7c285a4d tempest-GroupsTest-2041898812 None] Flow 'volume_create_manager' (e16a4761-10f1-479b-8c02-36cf5454273f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:36:59 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-91e10d66-2680-4c9b-a0b2-192e7c285a4d tempest-GroupsTest-2041898812 None] Created volume successfully. Jul 11 04:36:59 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-66c9213b-a885-4fb5-b3dd-61bf2a5fc9be tempest-VolumesTransfersV357Test-1032037694 None] Acquiring lock "cinder-a27b6c3f-5a7d-4188-ae28-4cbb5715c316-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:59 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-66c9213b-a885-4fb5-b3dd-61bf2a5fc9be tempest-VolumesTransfersV357Test-1032037694 None] Lock "cinder-a27b6c3f-5a7d-4188-ae28-4cbb5715c316-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:59 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-66c9213b-a885-4fb5-b3dd-61bf2a5fc9be tempest-VolumesTransfersV357Test-1032037694 None] Acquiring lock "cinder-quobyte-a27b6c3f-5a7d-4188-ae28-4cbb5715c316" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:36:59 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-66c9213b-a885-4fb5-b3dd-61bf2a5fc9be tempest-VolumesTransfersV357Test-1032037694 None] Lock "cinder-quobyte-a27b6c3f-5a7d-4188-ae28-4cbb5715c316" acquired by "delete_volume" :: waited 0.015s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:36:59 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc2c796-53a2-4608-a9f9-650ea5a8825c]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:36:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-66c9213b-a885-4fb5-b3dd-61bf2a5fc9be tempest-VolumesTransfersV357Test-1032037694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a27b6c3f-5a7d-4188-ae28-4cbb5715c316 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:36:59 devstack sudo[100167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a27b6c3f-5a7d-4188-ae28-4cbb5715c316 Jul 11 04:36:59 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:36:59 devstack sudo[100165]: pam_unix(sudo:session): session closed for user root Jul 11 04:36:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.784s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:36:59 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:36:59 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager._thread_info {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:36:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread count: 28 {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:36:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread info: [<_MainThread(MainThread, started 124675027595392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:37:00 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-cf39212e-9d4e-44ab-9997-6b8c9ce0431b tempest-GroupsTest-2041898812 None] Acquiring lock "cinder-quobyte-b8ee8519-90b7-46ad-81c5-4bc8fe8b6bfd" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:37:00 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-cf39212e-9d4e-44ab-9997-6b8c9ce0431b tempest-GroupsTest-2041898812 None] Lock "cinder-quobyte-b8ee8519-90b7-46ad-81c5-4bc8fe8b6bfd" acquired by "delete_volume" :: waited 0.019s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:37:00 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[218c2134-b992-4308-ae67-074af5eb924c]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:37:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cf39212e-9d4e-44ab-9997-6b8c9ce0431b tempest-GroupsTest-2041898812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b8ee8519-90b7-46ad-81c5-4bc8fe8b6bfd {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:00 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-66c9213b-a885-4fb5-b3dd-61bf2a5fc9be tempest-VolumesTransfersV357Test-1032037694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a27b6c3f-5a7d-4188-ae28-4cbb5715c316" returned: 0 in 0.914s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-66c9213b-a885-4fb5-b3dd-61bf2a5fc9be tempest-VolumesTransfersV357Test-1032037694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a27b6c3f-5a7d-4188-ae28-4cbb5715c316 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:00 devstack sudo[100174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a27b6c3f-5a7d-4188-ae28-4cbb5715c316 Jul 11 04:37:00 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:00 devstack sudo[100173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b8ee8519-90b7-46ad-81c5-4bc8fe8b6bfd Jul 11 04:37:00 devstack sudo[100173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:01 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-66c9213b-a885-4fb5-b3dd-61bf2a5fc9be tempest-VolumesTransfersV357Test-1032037694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a27b6c3f-5a7d-4188-ae28-4cbb5715c316" returned: 0 in 0.837s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:01 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-66c9213b-a885-4fb5-b3dd-61bf2a5fc9be tempest-VolumesTransfersV357Test-1032037694 None] Lock "cinder-quobyte-a27b6c3f-5a7d-4188-ae28-4cbb5715c316" released by "delete_volume" :: held 1.802s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:37:01 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-66c9213b-a885-4fb5-b3dd-61bf2a5fc9be tempest-VolumesTransfersV357Test-1032037694 None] Created reservations ['9a5466b3-f6e8-42da-b6ef-f47d82c43d10', '8a70a1f6-8d39-4daf-81ff-b014d746887f', '96bea658-4d36-4c5d-9b16-107d309c34a3', '1d2af096-79c2-4414-b2df-839118794e8e'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:37:01 devstack sudo[100173]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cf39212e-9d4e-44ab-9997-6b8c9ce0431b tempest-GroupsTest-2041898812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b8ee8519-90b7-46ad-81c5-4bc8fe8b6bfd" returned: 0 in 0.955s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cf39212e-9d4e-44ab-9997-6b8c9ce0431b tempest-GroupsTest-2041898812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b8ee8519-90b7-46ad-81c5-4bc8fe8b6bfd {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:01 devstack sudo[100182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b8ee8519-90b7-46ad-81c5-4bc8fe8b6bfd Jul 11 04:37:01 devstack sudo[100182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-66c9213b-a885-4fb5-b3dd-61bf2a5fc9be tempest-VolumesTransfersV357Test-1032037694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:37:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-66c9213b-a885-4fb5-b3dd-61bf2a5fc9be tempest-VolumesTransfersV357Test-1032037694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:37:01 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-66c9213b-a885-4fb5-b3dd-61bf2a5fc9be tempest-VolumesTransfersV357Test-1032037694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:37:01 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-66c9213b-a885-4fb5-b3dd-61bf2a5fc9be tempest-VolumesTransfersV357Test-1032037694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:37:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-66c9213b-a885-4fb5-b3dd-61bf2a5fc9be tempest-VolumesTransfersV357Test-1032037694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:37:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-66c9213b-a885-4fb5-b3dd-61bf2a5fc9be tempest-VolumesTransfersV357Test-1032037694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:01 devstack sudo[100184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:37:01 devstack sudo[100184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:02 devstack sudo[100182]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cf39212e-9d4e-44ab-9997-6b8c9ce0431b tempest-GroupsTest-2041898812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b8ee8519-90b7-46ad-81c5-4bc8fe8b6bfd" returned: 0 in 0.882s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:02 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-cf39212e-9d4e-44ab-9997-6b8c9ce0431b tempest-GroupsTest-2041898812 None] Lock "cinder-quobyte-b8ee8519-90b7-46ad-81c5-4bc8fe8b6bfd" released by "delete_volume" :: held 1.893s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:37:02 devstack sudo[100184]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-66c9213b-a885-4fb5-b3dd-61bf2a5fc9be tempest-VolumesTransfersV357Test-1032037694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.822s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:02 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-66c9213b-a885-4fb5-b3dd-61bf2a5fc9be tempest-VolumesTransfersV357Test-1032037694 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:37:02 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-66c9213b-a885-4fb5-b3dd-61bf2a5fc9be tempest-VolumesTransfersV357Test-1032037694 None] Deleted volume successfully. Jul 11 04:37:02 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-66c9213b-a885-4fb5-b3dd-61bf2a5fc9be tempest-VolumesTransfersV357Test-1032037694 None] Lock "cinder-a27b6c3f-5a7d-4188-ae28-4cbb5715c316-delete_volume" released by "delete_volume" :: held 2.936s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:37:02 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-cf39212e-9d4e-44ab-9997-6b8c9ce0431b tempest-GroupsTest-2041898812 None] Created reservations ['22bba0b4-eb28-4723-b145-4f65f0ff4757'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:37:02 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeb5317b-f519-435b-a7d4-a9c67b93f85f tempest-VolumesTransfersV357Test-1583639504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:37:02 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-aeb5317b-f519-435b-a7d4-a9c67b93f85f tempest-VolumesTransfersV357Test-1583639504 None] Flow 'volume_create_manager' (16e33fae-dcd2-46ce-a5a3-e5712177718a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:37:02 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-aeb5317b-f519-435b-a7d4-a9c67b93f85f tempest-VolumesTransfersV357Test-1583639504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49bb1c18-456d-4b6a-96c9-76cd7b0bf8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:02 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-aeb5317b-f519-435b-a7d4-a9c67b93f85f tempest-VolumesTransfersV357Test-1583639504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49bb1c18-456d-4b6a-96c9-76cd7b0bf8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-306589134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37d86306-8a9c-4731-90c5-2cd6c96d52ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5835208207a485498a84f70a636ef01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:37:02Z,use_quota=True,user_id='9e1e0ffc150b46cabe669e6d278fd06f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:02 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-aeb5317b-f519-435b-a7d4-a9c67b93f85f tempest-VolumesTransfersV357Test-1583639504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (530ac78f-8180-4827-849c-ed0b8d703ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:02 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-aeb5317b-f519-435b-a7d4-a9c67b93f85f tempest-VolumesTransfersV357Test-1583639504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (530ac78f-8180-4827-849c-ed0b8d703ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:02 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-aeb5317b-f519-435b-a7d4-a9c67b93f85f tempest-VolumesTransfersV357Test-1583639504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (693d2d74-86fd-4728-af12-33e818815ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:02 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-aeb5317b-f519-435b-a7d4-a9c67b93f85f tempest-VolumesTransfersV357Test-1583639504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (693d2d74-86fd-4728-af12-33e818815ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37d86306-8a9c-4731-90c5-2cd6c96d52ec', 'volume_name': 'volume-37d86306-8a9c-4731-90c5-2cd6c96d52ec', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:02 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-aeb5317b-f519-435b-a7d4-a9c67b93f85f tempest-VolumesTransfersV357Test-1583639504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b0d1a6a-1b05-457a-bc0d-36be348150a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:02 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-aeb5317b-f519-435b-a7d4-a9c67b93f85f tempest-VolumesTransfersV357Test-1583639504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b0d1a6a-1b05-457a-bc0d-36be348150a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:02 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-aeb5317b-f519-435b-a7d4-a9c67b93f85f tempest-VolumesTransfersV357Test-1583639504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (286400d5-d67c-4672-bc1c-7cdbe1a16fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:02 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-aeb5317b-f519-435b-a7d4-a9c67b93f85f tempest-VolumesTransfersV357Test-1583639504 None] Volume 37d86306-8a9c-4731-90c5-2cd6c96d52ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37d86306-8a9c-4731-90c5-2cd6c96d52ec', 'volume_size': 1} Jul 11 04:37:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-aeb5317b-f519-435b-a7d4-a9c67b93f85f tempest-VolumesTransfersV357Test-1583639504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:37:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-aeb5317b-f519-435b-a7d4-a9c67b93f85f tempest-VolumesTransfersV357Test-1583639504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:37:02 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-aeb5317b-f519-435b-a7d4-a9c67b93f85f tempest-VolumesTransfersV357Test-1583639504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-306589134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37d86306-8a9c-4731-90c5-2cd6c96d52ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5835208207a485498a84f70a636ef01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:37:02Z,use_quota=True,user_id='9e1e0ffc150b46cabe669e6d278fd06f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:37:02 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-aeb5317b-f519-435b-a7d4-a9c67b93f85f tempest-VolumesTransfersV357Test-1583639504 None] Creating volume 37d86306-8a9c-4731-90c5-2cd6c96d52ec {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:37:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-aeb5317b-f519-435b-a7d4-a9c67b93f85f tempest-VolumesTransfersV357Test-1583639504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:37:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-aeb5317b-f519-435b-a7d4-a9c67b93f85f tempest-VolumesTransfersV357Test-1583639504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:37:02 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-aeb5317b-f519-435b-a7d4-a9c67b93f85f tempest-VolumesTransfersV357Test-1583639504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:37:02 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-aeb5317b-f519-435b-a7d4-a9c67b93f85f tempest-VolumesTransfersV357Test-1583639504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:37:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-aeb5317b-f519-435b-a7d4-a9c67b93f85f tempest-VolumesTransfersV357Test-1583639504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:37:02 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-aeb5317b-f519-435b-a7d4-a9c67b93f85f tempest-VolumesTransfersV357Test-1583639504 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:37:02 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-aeb5317b-f519-435b-a7d4-a9c67b93f85f tempest-VolumesTransfersV357Test-1583639504 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:37:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-aeb5317b-f519-435b-a7d4-a9c67b93f85f tempest-VolumesTransfersV357Test-1583639504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-37d86306-8a9c-4731-90c5-2cd6c96d52ec 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:02 devstack cinder-volume[86964]: WARNING cinder.quota [None req-cf39212e-9d4e-44ab-9997-6b8c9ce0431b tempest-GroupsTest-2041898812 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-684134657 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-684134657, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:37:02 devstack sudo[100188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-37d86306-8a9c-4731-90c5-2cd6c96d52ec 1073741824 Jul 11 04:37:02 devstack cinder-volume[86964]: WARNING cinder.quota [None req-cf39212e-9d4e-44ab-9997-6b8c9ce0431b tempest-GroupsTest-2041898812 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-684134657 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-684134657, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:37:02 devstack sudo[100188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:02 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-cf39212e-9d4e-44ab-9997-6b8c9ce0431b tempest-GroupsTest-2041898812 None] Created reservations ['5361f640-30b2-4aa5-9df6-b5deb0313d86', '9dfa3f7f-ce5a-4706-a22d-848b623109db', '9c2a925d-757f-49ab-9cd2-5f6f97c6a279', 'b8ef75b9-1857-434a-af49-28a9b1249704'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:37:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-cf39212e-9d4e-44ab-9997-6b8c9ce0431b tempest-GroupsTest-2041898812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:37:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-cf39212e-9d4e-44ab-9997-6b8c9ce0431b tempest-GroupsTest-2041898812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:37:02 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-cf39212e-9d4e-44ab-9997-6b8c9ce0431b tempest-GroupsTest-2041898812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:37:02 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-cf39212e-9d4e-44ab-9997-6b8c9ce0431b tempest-GroupsTest-2041898812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:37:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-cf39212e-9d4e-44ab-9997-6b8c9ce0431b tempest-GroupsTest-2041898812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:37:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cf39212e-9d4e-44ab-9997-6b8c9ce0431b tempest-GroupsTest-2041898812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:02 devstack sudo[100190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:37:02 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:03 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-10947109-e59e-43b6-99ed-493f1496587f tempest-GroupsTest-2041898812 None] Created reservations ['6d49423b-9da7-4e49-8b60-5793de39111c'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:37:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-10947109-e59e-43b6-99ed-493f1496587f tempest-GroupsTest-2041898812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:37:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-10947109-e59e-43b6-99ed-493f1496587f tempest-GroupsTest-2041898812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:37:03 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-10947109-e59e-43b6-99ed-493f1496587f tempest-GroupsTest-2041898812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:37:03 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-10947109-e59e-43b6-99ed-493f1496587f tempest-GroupsTest-2041898812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:37:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-10947109-e59e-43b6-99ed-493f1496587f tempest-GroupsTest-2041898812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:37:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-10947109-e59e-43b6-99ed-493f1496587f tempest-GroupsTest-2041898812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:03 devstack sudo[100194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:37:03 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:03 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cf39212e-9d4e-44ab-9997-6b8c9ce0431b tempest-GroupsTest-2041898812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.720s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:03 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-cf39212e-9d4e-44ab-9997-6b8c9ce0431b tempest-GroupsTest-2041898812 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:37:03 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-cf39212e-9d4e-44ab-9997-6b8c9ce0431b tempest-GroupsTest-2041898812 None] Delete group completed successfully. Jul 11 04:37:03 devstack sudo[100188]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-aeb5317b-f519-435b-a7d4-a9c67b93f85f tempest-VolumesTransfersV357Test-1583639504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-37d86306-8a9c-4731-90c5-2cd6c96d52ec 1073741824" returned: 0 in 1.052s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-aeb5317b-f519-435b-a7d4-a9c67b93f85f tempest-VolumesTransfersV357Test-1583639504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-37d86306-8a9c-4731-90c5-2cd6c96d52ec {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:03 devstack sudo[100199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-37d86306-8a9c-4731-90c5-2cd6c96d52ec Jul 11 04:37:03 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:04 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-10947109-e59e-43b6-99ed-493f1496587f tempest-GroupsTest-2041898812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.822s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:04 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-10947109-e59e-43b6-99ed-493f1496587f tempest-GroupsTest-2041898812 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:37:04 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-10947109-e59e-43b6-99ed-493f1496587f tempest-GroupsTest-2041898812 None] Delete group completed successfully. Jul 11 04:37:04 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-aeb5317b-f519-435b-a7d4-a9c67b93f85f tempest-VolumesTransfersV357Test-1583639504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-37d86306-8a9c-4731-90c5-2cd6c96d52ec" returned: 0 in 0.697s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:04 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-aeb5317b-f519-435b-a7d4-a9c67b93f85f tempest-VolumesTransfersV357Test-1583639504 None] <== create_volume: return (1792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:37:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-aeb5317b-f519-435b-a7d4-a9c67b93f85f tempest-VolumesTransfersV357Test-1583639504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.795s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:37:04 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-aeb5317b-f519-435b-a7d4-a9c67b93f85f tempest-VolumesTransfersV357Test-1583639504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (286400d5-d67c-4672-bc1c-7cdbe1a16fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37d86306-8a9c-4731-90c5-2cd6c96d52ec', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:04 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-aeb5317b-f519-435b-a7d4-a9c67b93f85f tempest-VolumesTransfersV357Test-1583639504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (672e40d0-087d-4085-95b2-6f01c92767fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:04 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-aeb5317b-f519-435b-a7d4-a9c67b93f85f tempest-VolumesTransfersV357Test-1583639504 None] Volume volume-37d86306-8a9c-4731-90c5-2cd6c96d52ec (37d86306-8a9c-4731-90c5-2cd6c96d52ec): created successfully Jul 11 04:37:04 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-aeb5317b-f519-435b-a7d4-a9c67b93f85f tempest-VolumesTransfersV357Test-1583639504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (672e40d0-087d-4085-95b2-6f01c92767fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:04 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-aeb5317b-f519-435b-a7d4-a9c67b93f85f tempest-VolumesTransfersV357Test-1583639504 None] Flow 'volume_create_manager' (16e33fae-dcd2-46ce-a5a3-e5712177718a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:37:04 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-aeb5317b-f519-435b-a7d4-a9c67b93f85f tempest-VolumesTransfersV357Test-1583639504 None] Created volume successfully. Jul 11 04:37:04 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f27aaaf1-7484-4e0f-a88a-7898ccf2ed41 tempest-VolumesTransfersV357Test-1032037694 None] Acquiring lock "cinder-37d86306-8a9c-4731-90c5-2cd6c96d52ec-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:37:04 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f27aaaf1-7484-4e0f-a88a-7898ccf2ed41 tempest-VolumesTransfersV357Test-1032037694 None] Lock "cinder-37d86306-8a9c-4731-90c5-2cd6c96d52ec-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:37:04 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-9f1b069b-0cdb-4e8b-bbf0-b132eb7eec61 tempest-GroupsTest-2041898812 None] Group tempest-GroupsTest-Group-1800032543: creating Jul 11 04:37:04 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f27aaaf1-7484-4e0f-a88a-7898ccf2ed41 tempest-VolumesTransfersV357Test-1032037694 None] Acquiring lock "cinder-quobyte-37d86306-8a9c-4731-90c5-2cd6c96d52ec" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:37:05 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-9f1b069b-0cdb-4e8b-bbf0-b132eb7eec61 tempest-GroupsTest-2041898812 None] Group tempest-GroupsTest-Group-1800032543: created successfully Jul 11 04:37:05 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f27aaaf1-7484-4e0f-a88a-7898ccf2ed41 tempest-VolumesTransfersV357Test-1032037694 None] Lock "cinder-quobyte-37d86306-8a9c-4731-90c5-2cd6c96d52ec" acquired by "delete_volume" :: waited 0.023s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:37:05 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-9f1b069b-0cdb-4e8b-bbf0-b132eb7eec61 tempest-GroupsTest-2041898812 None] Create group completed successfully. Jul 11 04:37:05 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef1424a-c353-48da-8ebc-da610b1dfb7a]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:37:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f27aaaf1-7484-4e0f-a88a-7898ccf2ed41 tempest-VolumesTransfersV357Test-1032037694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-37d86306-8a9c-4731-90c5-2cd6c96d52ec {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:05 devstack sudo[100239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-37d86306-8a9c-4731-90c5-2cd6c96d52ec Jul 11 04:37:05 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:05 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f27aaaf1-7484-4e0f-a88a-7898ccf2ed41 tempest-VolumesTransfersV357Test-1032037694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-37d86306-8a9c-4731-90c5-2cd6c96d52ec" returned: 0 in 0.802s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f27aaaf1-7484-4e0f-a88a-7898ccf2ed41 tempest-VolumesTransfersV357Test-1032037694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-37d86306-8a9c-4731-90c5-2cd6c96d52ec {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:05 devstack sudo[100245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-37d86306-8a9c-4731-90c5-2cd6c96d52ec Jul 11 04:37:05 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:06 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f27aaaf1-7484-4e0f-a88a-7898ccf2ed41 tempest-VolumesTransfersV357Test-1032037694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-37d86306-8a9c-4731-90c5-2cd6c96d52ec" returned: 0 in 0.797s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:06 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f27aaaf1-7484-4e0f-a88a-7898ccf2ed41 tempest-VolumesTransfersV357Test-1032037694 None] Lock "cinder-quobyte-37d86306-8a9c-4731-90c5-2cd6c96d52ec" released by "delete_volume" :: held 1.664s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:37:06 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-13ba9fbc-e7aa-4835-9d86-8a1eadf8f0ae tempest-GroupsTest-2041898812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:37:06 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-13ba9fbc-e7aa-4835-9d86-8a1eadf8f0ae tempest-GroupsTest-2041898812 None] Flow 'volume_create_manager' (105cda83-f813-4ef3-84e7-0e404adc228e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:37:06 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-13ba9fbc-e7aa-4835-9d86-8a1eadf8f0ae tempest-GroupsTest-2041898812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8bdc49e-4f41-48ca-8674-e82fd09c5338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:06 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-13ba9fbc-e7aa-4835-9d86-8a1eadf8f0ae tempest-GroupsTest-2041898812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8bdc49e-4f41-48ca-8674-e82fd09c5338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1860043978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c34d9de0-6e0e-4481-acbf-21109aa36e03,host='devstack@QuobyteHD#QuobyteHD',id=b3e30b6d-2c7c-4f01-afdf-07a63a202f97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe75b68d9554eac9324c641fc092788',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:37:07Z,use_quota=True,user_id='a25921b83a2348feac28d01adfac763d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1cdc344-6fb4-4691-af71-b2a7708964af),volume_type_id=b1cdc344-6fb4-4691-af71-b2a7708964af)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:06 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-13ba9fbc-e7aa-4835-9d86-8a1eadf8f0ae tempest-GroupsTest-2041898812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1256f2c8-ce28-41d9-9e87-b060e644b7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:06 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-13ba9fbc-e7aa-4835-9d86-8a1eadf8f0ae tempest-GroupsTest-2041898812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1256f2c8-ce28-41d9-9e87-b060e644b7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:06 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-13ba9fbc-e7aa-4835-9d86-8a1eadf8f0ae tempest-GroupsTest-2041898812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a2e21aa-e41d-4c73-a136-67671992eef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:06 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-13ba9fbc-e7aa-4835-9d86-8a1eadf8f0ae tempest-GroupsTest-2041898812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a2e21aa-e41d-4c73-a136-67671992eef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3e30b6d-2c7c-4f01-afdf-07a63a202f97', 'volume_name': 'volume-b3e30b6d-2c7c-4f01-afdf-07a63a202f97', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:06 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-13ba9fbc-e7aa-4835-9d86-8a1eadf8f0ae tempest-GroupsTest-2041898812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57ef19a1-f5ce-4137-8f78-128287b9f9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:06 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-13ba9fbc-e7aa-4835-9d86-8a1eadf8f0ae tempest-GroupsTest-2041898812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57ef19a1-f5ce-4137-8f78-128287b9f9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:06 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-13ba9fbc-e7aa-4835-9d86-8a1eadf8f0ae tempest-GroupsTest-2041898812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7214f5d8-1789-4b20-a316-c02f2887b384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:06 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-13ba9fbc-e7aa-4835-9d86-8a1eadf8f0ae tempest-GroupsTest-2041898812 None] Volume b3e30b6d-2c7c-4f01-afdf-07a63a202f97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3e30b6d-2c7c-4f01-afdf-07a63a202f97', 'volume_size': 1} Jul 11 04:37:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-13ba9fbc-e7aa-4835-9d86-8a1eadf8f0ae tempest-GroupsTest-2041898812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:37:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-13ba9fbc-e7aa-4835-9d86-8a1eadf8f0ae tempest-GroupsTest-2041898812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:37:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-13ba9fbc-e7aa-4835-9d86-8a1eadf8f0ae tempest-GroupsTest-2041898812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c34d9de0-6e0e-4481-acbf-21109aa36e03,created_at=2026-07-11T02:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1860043978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c34d9de0-6e0e-4481-acbf-21109aa36e03,host='devstack@QuobyteHD#QuobyteHD',id=b3e30b6d-2c7c-4f01-afdf-07a63a202f97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe75b68d9554eac9324c641fc092788',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:37:07Z,use_quota=True,user_id='a25921b83a2348feac28d01adfac763d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1cdc344-6fb4-4691-af71-b2a7708964af),volume_type_id=b1cdc344-6fb4-4691-af71-b2a7708964af)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:37:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-13ba9fbc-e7aa-4835-9d86-8a1eadf8f0ae tempest-GroupsTest-2041898812 None] Creating volume b3e30b6d-2c7c-4f01-afdf-07a63a202f97 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:37:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-13ba9fbc-e7aa-4835-9d86-8a1eadf8f0ae tempest-GroupsTest-2041898812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:37:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-13ba9fbc-e7aa-4835-9d86-8a1eadf8f0ae tempest-GroupsTest-2041898812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:37:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-13ba9fbc-e7aa-4835-9d86-8a1eadf8f0ae tempest-GroupsTest-2041898812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:37:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-13ba9fbc-e7aa-4835-9d86-8a1eadf8f0ae tempest-GroupsTest-2041898812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:37:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-13ba9fbc-e7aa-4835-9d86-8a1eadf8f0ae tempest-GroupsTest-2041898812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:37:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-13ba9fbc-e7aa-4835-9d86-8a1eadf8f0ae tempest-GroupsTest-2041898812 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:37:06 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-13ba9fbc-e7aa-4835-9d86-8a1eadf8f0ae tempest-GroupsTest-2041898812 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:37:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-13ba9fbc-e7aa-4835-9d86-8a1eadf8f0ae tempest-GroupsTest-2041898812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3e30b6d-2c7c-4f01-afdf-07a63a202f97 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:06 devstack sudo[100249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3e30b6d-2c7c-4f01-afdf-07a63a202f97 1073741824 Jul 11 04:37:06 devstack sudo[100249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:06 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-f27aaaf1-7484-4e0f-a88a-7898ccf2ed41 tempest-VolumesTransfersV357Test-1032037694 None] Created reservations ['6a4c8013-0113-4761-b2c8-9b651ea516aa', '6c6de7d7-e96a-4d57-a90e-b1636e357182', '36f2f567-53e9-44c0-8fc2-3a6cec5ec7ec', 'a44963d6-2cdf-4c89-b152-0c50d00c279e'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:37:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f27aaaf1-7484-4e0f-a88a-7898ccf2ed41 tempest-VolumesTransfersV357Test-1032037694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:37:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f27aaaf1-7484-4e0f-a88a-7898ccf2ed41 tempest-VolumesTransfersV357Test-1032037694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:37:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-f27aaaf1-7484-4e0f-a88a-7898ccf2ed41 tempest-VolumesTransfersV357Test-1032037694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:37:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-f27aaaf1-7484-4e0f-a88a-7898ccf2ed41 tempest-VolumesTransfersV357Test-1032037694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:37:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f27aaaf1-7484-4e0f-a88a-7898ccf2ed41 tempest-VolumesTransfersV357Test-1032037694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:37:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f27aaaf1-7484-4e0f-a88a-7898ccf2ed41 tempest-VolumesTransfersV357Test-1032037694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:06 devstack sudo[100251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:37:06 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:07 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f27aaaf1-7484-4e0f-a88a-7898ccf2ed41 tempest-VolumesTransfersV357Test-1032037694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.765s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:07 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-f27aaaf1-7484-4e0f-a88a-7898ccf2ed41 tempest-VolumesTransfersV357Test-1032037694 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:37:07 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-f27aaaf1-7484-4e0f-a88a-7898ccf2ed41 tempest-VolumesTransfersV357Test-1032037694 None] Deleted volume successfully. Jul 11 04:37:07 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f27aaaf1-7484-4e0f-a88a-7898ccf2ed41 tempest-VolumesTransfersV357Test-1032037694 None] Lock "cinder-37d86306-8a9c-4731-90c5-2cd6c96d52ec-delete_volume" released by "delete_volume" :: held 2.758s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:37:07 devstack sudo[100249]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-13ba9fbc-e7aa-4835-9d86-8a1eadf8f0ae tempest-GroupsTest-2041898812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3e30b6d-2c7c-4f01-afdf-07a63a202f97 1073741824" returned: 0 in 1.037s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-13ba9fbc-e7aa-4835-9d86-8a1eadf8f0ae tempest-GroupsTest-2041898812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3e30b6d-2c7c-4f01-afdf-07a63a202f97 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:07 devstack sudo[100257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3e30b6d-2c7c-4f01-afdf-07a63a202f97 Jul 11 04:37:07 devstack sudo[100257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:08 devstack sudo[100257]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-13ba9fbc-e7aa-4835-9d86-8a1eadf8f0ae tempest-GroupsTest-2041898812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3e30b6d-2c7c-4f01-afdf-07a63a202f97" returned: 0 in 0.788s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:08 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-13ba9fbc-e7aa-4835-9d86-8a1eadf8f0ae tempest-GroupsTest-2041898812 None] <== create_volume: return (1875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:37:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-13ba9fbc-e7aa-4835-9d86-8a1eadf8f0ae tempest-GroupsTest-2041898812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.877s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:37:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-13ba9fbc-e7aa-4835-9d86-8a1eadf8f0ae tempest-GroupsTest-2041898812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7214f5d8-1789-4b20-a316-c02f2887b384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3e30b6d-2c7c-4f01-afdf-07a63a202f97', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-13ba9fbc-e7aa-4835-9d86-8a1eadf8f0ae tempest-GroupsTest-2041898812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa7f5b11-335c-4b49-a056-58bfa731233a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:08 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-13ba9fbc-e7aa-4835-9d86-8a1eadf8f0ae tempest-GroupsTest-2041898812 None] Volume volume-b3e30b6d-2c7c-4f01-afdf-07a63a202f97 (b3e30b6d-2c7c-4f01-afdf-07a63a202f97): created successfully Jul 11 04:37:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-13ba9fbc-e7aa-4835-9d86-8a1eadf8f0ae tempest-GroupsTest-2041898812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa7f5b11-335c-4b49-a056-58bfa731233a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-13ba9fbc-e7aa-4835-9d86-8a1eadf8f0ae tempest-GroupsTest-2041898812 None] Flow 'volume_create_manager' (105cda83-f813-4ef3-84e7-0e404adc228e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:37:08 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-13ba9fbc-e7aa-4835-9d86-8a1eadf8f0ae tempest-GroupsTest-2041898812 None] Created volume successfully. Jul 11 04:37:09 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a428586-7fe0-4969-bd2f-c966744289ce tempest-GroupsTest-2041898812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:37:09 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2a428586-7fe0-4969-bd2f-c966744289ce tempest-GroupsTest-2041898812 None] Flow 'volume_create_manager' (3ca6eb90-334e-44e5-80d2-387f1057573c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:37:09 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2a428586-7fe0-4969-bd2f-c966744289ce tempest-GroupsTest-2041898812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd2041ef-17a8-4065-bae6-95f0fc034ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:09 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2a428586-7fe0-4969-bd2f-c966744289ce tempest-GroupsTest-2041898812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd2041ef-17a8-4065-bae6-95f0fc034ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-128782392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c34d9de0-6e0e-4481-acbf-21109aa36e03,host='devstack@QuobyteHD#QuobyteHD',id=7bb23e9c-b3b8-47fb-92aa-cb6816df1287,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe75b68d9554eac9324c641fc092788',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:37:10Z,use_quota=True,user_id='a25921b83a2348feac28d01adfac763d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1cdc344-6fb4-4691-af71-b2a7708964af),volume_type_id=b1cdc344-6fb4-4691-af71-b2a7708964af)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:09 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2a428586-7fe0-4969-bd2f-c966744289ce tempest-GroupsTest-2041898812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f757c8ac-d7ca-4407-9205-4d2f0c13ffc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:09 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2a428586-7fe0-4969-bd2f-c966744289ce tempest-GroupsTest-2041898812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f757c8ac-d7ca-4407-9205-4d2f0c13ffc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:09 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2a428586-7fe0-4969-bd2f-c966744289ce tempest-GroupsTest-2041898812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30cc1973-8a2a-4644-a6ff-1c33b4b2468e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:09 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2a428586-7fe0-4969-bd2f-c966744289ce tempest-GroupsTest-2041898812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30cc1973-8a2a-4644-a6ff-1c33b4b2468e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bb23e9c-b3b8-47fb-92aa-cb6816df1287', 'volume_name': 'volume-7bb23e9c-b3b8-47fb-92aa-cb6816df1287', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:09 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2a428586-7fe0-4969-bd2f-c966744289ce tempest-GroupsTest-2041898812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84ef3a76-7738-4e27-a679-8c4193124238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:09 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2a428586-7fe0-4969-bd2f-c966744289ce tempest-GroupsTest-2041898812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84ef3a76-7738-4e27-a679-8c4193124238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:09 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2a428586-7fe0-4969-bd2f-c966744289ce tempest-GroupsTest-2041898812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68c96418-066e-4dbc-a68e-0bd29958a732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:09 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-2a428586-7fe0-4969-bd2f-c966744289ce tempest-GroupsTest-2041898812 None] Volume 7bb23e9c-b3b8-47fb-92aa-cb6816df1287: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bb23e9c-b3b8-47fb-92aa-cb6816df1287', 'volume_size': 1} Jul 11 04:37:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2a428586-7fe0-4969-bd2f-c966744289ce tempest-GroupsTest-2041898812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:37:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2a428586-7fe0-4969-bd2f-c966744289ce tempest-GroupsTest-2041898812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:37:09 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2a428586-7fe0-4969-bd2f-c966744289ce tempest-GroupsTest-2041898812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c34d9de0-6e0e-4481-acbf-21109aa36e03,created_at=2026-07-11T02:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-128782392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c34d9de0-6e0e-4481-acbf-21109aa36e03,host='devstack@QuobyteHD#QuobyteHD',id=7bb23e9c-b3b8-47fb-92aa-cb6816df1287,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe75b68d9554eac9324c641fc092788',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:37:10Z,use_quota=True,user_id='a25921b83a2348feac28d01adfac763d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1cdc344-6fb4-4691-af71-b2a7708964af),volume_type_id=b1cdc344-6fb4-4691-af71-b2a7708964af)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:37:09 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-2a428586-7fe0-4969-bd2f-c966744289ce tempest-GroupsTest-2041898812 None] Creating volume 7bb23e9c-b3b8-47fb-92aa-cb6816df1287 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:37:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2a428586-7fe0-4969-bd2f-c966744289ce tempest-GroupsTest-2041898812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:37:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2a428586-7fe0-4969-bd2f-c966744289ce tempest-GroupsTest-2041898812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:37:09 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2a428586-7fe0-4969-bd2f-c966744289ce tempest-GroupsTest-2041898812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:37:09 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2a428586-7fe0-4969-bd2f-c966744289ce tempest-GroupsTest-2041898812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:37:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2a428586-7fe0-4969-bd2f-c966744289ce tempest-GroupsTest-2041898812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:37:09 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2a428586-7fe0-4969-bd2f-c966744289ce tempest-GroupsTest-2041898812 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:37:09 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-2a428586-7fe0-4969-bd2f-c966744289ce tempest-GroupsTest-2041898812 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:37:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2a428586-7fe0-4969-bd2f-c966744289ce tempest-GroupsTest-2041898812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7bb23e9c-b3b8-47fb-92aa-cb6816df1287 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:09 devstack sudo[100260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7bb23e9c-b3b8-47fb-92aa-cb6816df1287 1073741824 Jul 11 04:37:09 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:10 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2a428586-7fe0-4969-bd2f-c966744289ce tempest-GroupsTest-2041898812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7bb23e9c-b3b8-47fb-92aa-cb6816df1287 1073741824" returned: 0 in 1.048s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2a428586-7fe0-4969-bd2f-c966744289ce tempest-GroupsTest-2041898812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7bb23e9c-b3b8-47fb-92aa-cb6816df1287 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:10 devstack sudo[100266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7bb23e9c-b3b8-47fb-92aa-cb6816df1287 Jul 11 04:37:10 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:11 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2a428586-7fe0-4969-bd2f-c966744289ce tempest-GroupsTest-2041898812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7bb23e9c-b3b8-47fb-92aa-cb6816df1287" returned: 0 in 0.760s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:11 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2a428586-7fe0-4969-bd2f-c966744289ce tempest-GroupsTest-2041898812 None] <== create_volume: return (1892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:37:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2a428586-7fe0-4969-bd2f-c966744289ce tempest-GroupsTest-2041898812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.905s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:37:11 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2a428586-7fe0-4969-bd2f-c966744289ce tempest-GroupsTest-2041898812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68c96418-066e-4dbc-a68e-0bd29958a732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bb23e9c-b3b8-47fb-92aa-cb6816df1287', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:11 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2a428586-7fe0-4969-bd2f-c966744289ce tempest-GroupsTest-2041898812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d21b886-b42d-4f2c-8133-7fcd5c7cb5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:11 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-2a428586-7fe0-4969-bd2f-c966744289ce tempest-GroupsTest-2041898812 None] Volume volume-7bb23e9c-b3b8-47fb-92aa-cb6816df1287 (7bb23e9c-b3b8-47fb-92aa-cb6816df1287): created successfully Jul 11 04:37:11 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2a428586-7fe0-4969-bd2f-c966744289ce tempest-GroupsTest-2041898812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d21b886-b42d-4f2c-8133-7fcd5c7cb5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:11 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2a428586-7fe0-4969-bd2f-c966744289ce tempest-GroupsTest-2041898812 None] Flow 'volume_create_manager' (3ca6eb90-334e-44e5-80d2-387f1057573c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:37:11 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-2a428586-7fe0-4969-bd2f-c966744289ce tempest-GroupsTest-2041898812 None] Created volume successfully. Jul 11 04:37:12 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-d4382d00-cb4b-47f3-a936-e825c932dbaf tempest-GroupsTest-2041898812 None] Update group completed successfully. Jul 11 04:37:13 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-4393d594-4726-4fff-8fba-e22a120a201e tempest-GroupsTest-2041898812 None] Update group completed successfully. Jul 11 04:37:14 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:37:14 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Flow 'volume_create_manager' (b8d36350-b66e-42cd-8864-a53f90d93c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:37:14 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b26fc35b-1883-4c59-b872-3a941403fdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:14 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b26fc35b-1883-4c59-b872-3a941403fdc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1007280826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95504154b9cf4935998ff1d516f3d75e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:37:14Z,use_quota=True,user_id='a133d16011944da1b346a315f48da9d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:14 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (526bc747-f966-4bb2-b0a5-4b916dbb9a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:14 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (526bc747-f966-4bb2-b0a5-4b916dbb9a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:14 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b62e612a-3856-43ea-b943-c9acc03aa1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:14 devstack cinder-volume[86964]: DEBUG cinder.image.glance [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Creating Keystone auth plugin from conf {{(pid=86964) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 04:37:14 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b62e612a-3856-43ea-b943-c9acc03aa1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d', 'volume_name': 'volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d', 'volume_size': 1, 'image_id': 'a34636df-e58a-4a3a-9b16-7e804af976d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a34636df-e58a-4a3a-9b16-7e804af976d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ffa684dc47340c1a363723e49759fc3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a34636df-e58a-4a3a-9b16-7e804af976d8', 'created_at': datetime.datetime(2026, 7, 11, 2, 18, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 18, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a34636df-e58a-4a3a-9b16-7e804af976d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:14 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (124a5712-65fa-4d4b-be9c-623e8bde58fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:14 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (124a5712-65fa-4d4b-be9c-623e8bde58fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:14 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e32939ed-d97d-4ea2-8eb3-89f987a0109b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:14 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Volume 7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d', 'volume_size': 1, 'image_id': 'a34636df-e58a-4a3a-9b16-7e804af976d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a34636df-e58a-4a3a-9b16-7e804af976d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ffa684dc47340c1a363723e49759fc3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a34636df-e58a-4a3a-9b16-7e804af976d8', 'created_at': datetime.datetime(2026, 7, 11, 2, 18, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 18, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a34636df-e58a-4a3a-9b16-7e804af976d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 11 04:37:14 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Trying to clone 7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d from image a34636df-e58a-4a3a-9b16-7e804af976d8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a34636df-e58a-4a3a-9b16-7e804af976d8', 'metadata': {}}]). {{(pid=86964) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 04:37:14 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_b0jivbmydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86964) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 11 04:37:14 devstack cinder-volume[86964]: INFO cinder.image.image_utils [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Image download 20.69 MB at 20.69 MB/s Jul 11 04:37:14 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1c5159-3462-4f43-ae07-7968a3e06a4e]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:37:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_b0jivbmydevstack@QuobyteHD {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:14 devstack sudo[100270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_b0jivbmydevstack@QuobyteHD Jul 11 04:37:14 devstack sudo[100270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:15 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a77f2c40-7711-4e9d-b82f-a798856c42cc tempest-GroupsTest-2041898812 None] Acquiring lock "cinder-quobyte-7bb23e9c-b3b8-47fb-92aa-cb6816df1287" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:37:15 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a77f2c40-7711-4e9d-b82f-a798856c42cc tempest-GroupsTest-2041898812 None] Lock "cinder-quobyte-7bb23e9c-b3b8-47fb-92aa-cb6816df1287" acquired by "delete_volume" :: waited 0.028s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:37:15 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[3532d0a9-758a-4892-b290-dc10f43e7586]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:37:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a77f2c40-7711-4e9d-b82f-a798856c42cc tempest-GroupsTest-2041898812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7bb23e9c-b3b8-47fb-92aa-cb6816df1287 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:15 devstack sudo[100270]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_b0jivbmydevstack@QuobyteHD" returned: 0 in 0.810s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:15 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Temporary image a34636df-e58a-4a3a-9b16-7e804af976d8 is fetched for user a133d16011944da1b346a315f48da9d0. {{(pid=86964) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 11 04:37:15 devstack sudo[100273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7bb23e9c-b3b8-47fb-92aa-cb6816df1287 Jul 11 04:37:15 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:15 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[719fe077-f69d-42b2-abe7-2cbf4304fb25]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:37:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_b0jivbmydevstack@QuobyteHD {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:15 devstack sudo[100278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_b0jivbmydevstack@QuobyteHD Jul 11 04:37:15 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:16 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a77f2c40-7711-4e9d-b82f-a798856c42cc tempest-GroupsTest-2041898812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7bb23e9c-b3b8-47fb-92aa-cb6816df1287" returned: 0 in 0.952s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a77f2c40-7711-4e9d-b82f-a798856c42cc tempest-GroupsTest-2041898812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7bb23e9c-b3b8-47fb-92aa-cb6816df1287 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:16 devstack sudo[100285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7bb23e9c-b3b8-47fb-92aa-cb6816df1287 Jul 11 04:37:16 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:16 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_b0jivbmydevstack@QuobyteHD" returned: 0 in 0.877s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:37:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:37:16 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1007280826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95504154b9cf4935998ff1d516f3d75e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:37:14Z,use_quota=True,user_id='a133d16011944da1b346a315f48da9d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:37:16 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Creating volume 7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:37:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:37:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:37:16 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:37:16 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:37:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:37:16 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:37:16 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:37:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:16 devstack sudo[100289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d 1073741824 Jul 11 04:37:16 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:17 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a77f2c40-7711-4e9d-b82f-a798856c42cc tempest-GroupsTest-2041898812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7bb23e9c-b3b8-47fb-92aa-cb6816df1287" returned: 0 in 0.724s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a77f2c40-7711-4e9d-b82f-a798856c42cc tempest-GroupsTest-2041898812 None] Lock "cinder-quobyte-7bb23e9c-b3b8-47fb-92aa-cb6816df1287" released by "delete_volume" :: held 1.736s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:37:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a77f2c40-7711-4e9d-b82f-a798856c42cc tempest-GroupsTest-2041898812 None] Acquiring lock "cinder-quobyte-b3e30b6d-2c7c-4f01-afdf-07a63a202f97" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:37:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a77f2c40-7711-4e9d-b82f-a798856c42cc tempest-GroupsTest-2041898812 None] Lock "cinder-quobyte-b3e30b6d-2c7c-4f01-afdf-07a63a202f97" acquired by "delete_volume" :: waited 0.018s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:37:17 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[c229f593-1178-483a-8392-045c0d2fbf8e]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:37:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a77f2c40-7711-4e9d-b82f-a798856c42cc tempest-GroupsTest-2041898812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3e30b6d-2c7c-4f01-afdf-07a63a202f97 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:17 devstack sudo[100295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3e30b6d-2c7c-4f01-afdf-07a63a202f97 Jul 11 04:37:17 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:17 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d 1073741824" returned: 0 in 0.953s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:17 devstack sudo[100299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d Jul 11 04:37:17 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:18 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a77f2c40-7711-4e9d-b82f-a798856c42cc tempest-GroupsTest-2041898812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3e30b6d-2c7c-4f01-afdf-07a63a202f97" returned: 0 in 0.810s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a77f2c40-7711-4e9d-b82f-a798856c42cc tempest-GroupsTest-2041898812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3e30b6d-2c7c-4f01-afdf-07a63a202f97 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:18 devstack sudo[100305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3e30b6d-2c7c-4f01-afdf-07a63a202f97 Jul 11 04:37:18 devstack sudo[100305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:18 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d" returned: 0 in 0.776s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:18 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] <== create_volume: return (1786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:37:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.792s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:37:18 devstack cinder-volume[86964]: DEBUG cinder.volume.volume_utils [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Attempting download of a34636df-e58a-4a3a-9b16-7e804af976d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/a34636df-e58a-4a3a-9b16-7e804af976d8', 'metadata': {}}])) to volume 7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d. {{(pid=86964) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 04:37:18 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[de415eea-fa51-4a2b-998e-5675524ecca9]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:37:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a34636df-e58a-4a3a-9b16-7e804af976d8_rx411al2 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:18 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a34636df-e58a-4a3a-9b16-7e804af976d8_rx411al2 Jul 11 04:37:18 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:18 devstack sudo[100305]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a77f2c40-7711-4e9d-b82f-a798856c42cc tempest-GroupsTest-2041898812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3e30b6d-2c7c-4f01-afdf-07a63a202f97" returned: 0 in 0.728s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:18 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a77f2c40-7711-4e9d-b82f-a798856c42cc tempest-GroupsTest-2041898812 None] Lock "cinder-quobyte-b3e30b6d-2c7c-4f01-afdf-07a63a202f97" released by "delete_volume" :: held 1.594s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:37:18 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-a77f2c40-7711-4e9d-b82f-a798856c42cc tempest-GroupsTest-2041898812 None] Created reservations ['4c074bfa-2f52-4e1f-a1f4-e5b055432af8'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:37:18 devstack cinder-volume[86964]: WARNING cinder.quota [None req-a77f2c40-7711-4e9d-b82f-a798856c42cc tempest-GroupsTest-2041898812 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1126938054 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1126938054, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:37:18 devstack cinder-volume[86964]: WARNING cinder.quota [None req-a77f2c40-7711-4e9d-b82f-a798856c42cc tempest-GroupsTest-2041898812 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1126938054 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1126938054, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:37:18 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-a77f2c40-7711-4e9d-b82f-a798856c42cc tempest-GroupsTest-2041898812 None] Created reservations ['ff27cb16-eea9-4861-8d5b-bdcd22ae8e90', 'a4aabbc5-7852-4c6e-a99d-da36427b7f99', '6b8bc2ce-a7a2-47e5-9e01-cebc830e41bf', 'c5860889-70d6-485c-b688-0fb1eafcf41a'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:37:19 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-a77f2c40-7711-4e9d-b82f-a798856c42cc tempest-GroupsTest-2041898812 None] Created reservations ['6c3b84ac-af3f-48b0-895b-06d915d817c0', '06a0016f-6570-4d5e-90a4-0b742104512b', 'a2363870-9b0a-49d1-a3cb-3c95ed6bb4ad', 'df554b8e-dc42-4fef-85ff-2b00ca94a2c1'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:37:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a77f2c40-7711-4e9d-b82f-a798856c42cc tempest-GroupsTest-2041898812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:37:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a77f2c40-7711-4e9d-b82f-a798856c42cc tempest-GroupsTest-2041898812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:37:19 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-a77f2c40-7711-4e9d-b82f-a798856c42cc tempest-GroupsTest-2041898812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:37:19 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-a77f2c40-7711-4e9d-b82f-a798856c42cc tempest-GroupsTest-2041898812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:37:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a77f2c40-7711-4e9d-b82f-a798856c42cc tempest-GroupsTest-2041898812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:37:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a77f2c40-7711-4e9d-b82f-a798856c42cc tempest-GroupsTest-2041898812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:19 devstack sudo[100319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:37:19 devstack sudo[100319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:19 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a34636df-e58a-4a3a-9b16-7e804af976d8_rx411al2" returned: 0 in 0.742s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a34636df-e58a-4a3a-9b16-7e804af976d8_rx411al2 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:19 devstack sudo[100321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a34636df-e58a-4a3a-9b16-7e804af976d8_rx411al2 Jul 11 04:37:19 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:19 devstack sudo[100319]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a77f2c40-7711-4e9d-b82f-a798856c42cc tempest-GroupsTest-2041898812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.724s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:19 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-a77f2c40-7711-4e9d-b82f-a798856c42cc tempest-GroupsTest-2041898812 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:37:19 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-a77f2c40-7711-4e9d-b82f-a798856c42cc tempest-GroupsTest-2041898812 None] Delete group completed successfully. Jul 11 04:37:19 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a34636df-e58a-4a3a-9b16-7e804af976d8_rx411al2" returned: 1 in 0.783s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a34636df-e58a-4a3a-9b16-7e804af976d8_rx411al2' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:37:20 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ed111c-0a0d-475e-8270-70eb911ceb71]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:37:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_b0jivbmydevstack@QuobyteHD {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:20 devstack sudo[100326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_b0jivbmydevstack@QuobyteHD Jul 11 04:37:20 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:20 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_b0jivbmydevstack@QuobyteHD" returned: 0 in 0.811s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:20 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] a34636df-e58a-4a3a-9b16-7e804af976d8 was qcow2, converting to raw {{(pid=86964) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 11 04:37:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_b0jivbmydevstack@QuobyteHD /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:20 devstack sudo[100331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_b0jivbmydevstack@QuobyteHD /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d Jul 11 04:37:20 devstack sudo[100331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:23 devstack sudo[100331]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_b0jivbmydevstack@QuobyteHD /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d" returned: 0 in 2.261s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:23 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_b0jivbmydevstack@QuobyteHD, size 112.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d {{(pid=86964) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 04:37:23 devstack cinder-volume[86964]: INFO cinder.image.image_utils [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Converted 112.00 MB image at 49.52 MB/s Jul 11 04:37:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:23 devstack sudo[100339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d 1G Jul 11 04:37:23 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:23 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d 1G" returned: 0 in 0.749s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:23 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[db169607-2c56-4f4c-9788-4bb541993570]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:37:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:24 devstack sudo[100344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d Jul 11 04:37:24 devstack sudo[100344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:24 devstack sudo[100344]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d" returned: 0 in 0.872s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:24 devstack sudo[100348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d Jul 11 04:37:24 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:25 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d" returned: 1 in 0.937s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:37:25 devstack cinder-volume[86964]: DEBUG cinder.volume.volume_utils [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Downloaded image a34636df-e58a-4a3a-9b16-7e804af976d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/a34636df-e58a-4a3a-9b16-7e804af976d8', 'metadata': {}}])) to volume 7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d successfully. {{(pid=86964) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 04:37:25 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Temporary image a34636df-e58a-4a3a-9b16-7e804af976d8 for user a133d16011944da1b346a315f48da9d0 is deleted. {{(pid=86964) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 11 04:37:25 devstack cinder-volume[86964]: DEBUG cinder.volume.volume_utils [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Marking volume 7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d as bootable. {{(pid=86964) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 04:37:25 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Copying metadata from image a34636df-e58a-4a3a-9b16-7e804af976d8 to 7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d. {{(pid=86964) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 04:37:25 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Creating volume glance metadata for volume 7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d backed by image a34636df-e58a-4a3a-9b16-7e804af976d8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a34636df-e58a-4a3a-9b16-7e804af976d8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86964) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 04:37:25 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e32939ed-d97d-4ea2-8eb3-89f987a0109b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d', 'volume_size': 1, 'image_id': 'a34636df-e58a-4a3a-9b16-7e804af976d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a34636df-e58a-4a3a-9b16-7e804af976d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ffa684dc47340c1a363723e49759fc3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a34636df-e58a-4a3a-9b16-7e804af976d8', 'created_at': datetime.datetime(2026, 7, 11, 2, 18, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 18, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a34636df-e58a-4a3a-9b16-7e804af976d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:25 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a0c3b5a-a49f-4d38-ba89-a9e90b0816cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:25 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Volume volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d (7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d): created successfully Jul 11 04:37:25 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a0c3b5a-a49f-4d38-ba89-a9e90b0816cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:25 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Flow 'volume_create_manager' (b8d36350-b66e-42cd-8864-a53f90d93c71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:37:25 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-6b576e6b-6b98-4c85-88b4-42ced2b15bbd tempest-VolumesExtendTest-929829731 None] Created volume successfully. Jul 11 04:37:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-0e9cb7fa-3b5c-442e-a1c7-46ca7f5f765f tempest-VolumesExtendTest-929829731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:37:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-0e9cb7fa-3b5c-442e-a1c7-46ca7f5f765f tempest-VolumesExtendTest-929829731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:37:27 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[931fcb87-30a6-4131-afb4-9e13304fde2a]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:37:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-0e9cb7fa-3b5c-442e-a1c7-46ca7f5f765f tempest-VolumesExtendTest-929829731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:27 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-31c0c884-645e-4013-9679-b7a08dd54280 tempest-VolumeQuotasAdminTestJSON-1953034656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:37:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31c0c884-645e-4013-9679-b7a08dd54280 tempest-VolumeQuotasAdminTestJSON-1953034656 None] Flow 'volume_create_manager' (d18875bc-1a9e-461c-98ed-0706ad8d354d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:37:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31c0c884-645e-4013-9679-b7a08dd54280 tempest-VolumeQuotasAdminTestJSON-1953034656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3d38f24-5f0a-4c40-9cf6-f625b2a424f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:27 devstack sudo[100355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d Jul 11 04:37:27 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31c0c884-645e-4013-9679-b7a08dd54280 tempest-VolumeQuotasAdminTestJSON-1953034656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3d38f24-5f0a-4c40-9cf6-f625b2a424f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1359519994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f70d379a-c028-472b-a4fe-aa81f3f5e505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c79411d5a1a84b58a5aa390858a9e5ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:37:27Z,use_quota=True,user_id='9c5368625865465d95889e44c9dac3ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31c0c884-645e-4013-9679-b7a08dd54280 tempest-VolumeQuotasAdminTestJSON-1953034656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f596556-8d3f-46d7-9952-59af4e8912d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31c0c884-645e-4013-9679-b7a08dd54280 tempest-VolumeQuotasAdminTestJSON-1953034656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f596556-8d3f-46d7-9952-59af4e8912d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31c0c884-645e-4013-9679-b7a08dd54280 tempest-VolumeQuotasAdminTestJSON-1953034656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3ebaead-33f2-4a39-9ae2-a8dfb3443a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31c0c884-645e-4013-9679-b7a08dd54280 tempest-VolumeQuotasAdminTestJSON-1953034656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3ebaead-33f2-4a39-9ae2-a8dfb3443a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f70d379a-c028-472b-a4fe-aa81f3f5e505', 'volume_name': 'volume-f70d379a-c028-472b-a4fe-aa81f3f5e505', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31c0c884-645e-4013-9679-b7a08dd54280 tempest-VolumeQuotasAdminTestJSON-1953034656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fd13d26-1ac3-4535-832a-d0c2cabefb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31c0c884-645e-4013-9679-b7a08dd54280 tempest-VolumeQuotasAdminTestJSON-1953034656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fd13d26-1ac3-4535-832a-d0c2cabefb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31c0c884-645e-4013-9679-b7a08dd54280 tempest-VolumeQuotasAdminTestJSON-1953034656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc2869ce-85d3-4085-a37e-b9269c3eea0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:27 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-31c0c884-645e-4013-9679-b7a08dd54280 tempest-VolumeQuotasAdminTestJSON-1953034656 None] Volume f70d379a-c028-472b-a4fe-aa81f3f5e505: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f70d379a-c028-472b-a4fe-aa81f3f5e505', 'volume_size': 1} Jul 11 04:37:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-31c0c884-645e-4013-9679-b7a08dd54280 tempest-VolumeQuotasAdminTestJSON-1953034656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:37:28 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-0e9cb7fa-3b5c-442e-a1c7-46ca7f5f765f tempest-VolumesExtendTest-929829731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d" returned: 0 in 0.956s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-0e9cb7fa-3b5c-442e-a1c7-46ca7f5f765f tempest-VolumesExtendTest-929829731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:28 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d Jul 11 04:37:28 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:29 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-0e9cb7fa-3b5c-442e-a1c7-46ca7f5f765f tempest-VolumesExtendTest-929829731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d" returned: 1 in 0.795s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-0e9cb7fa-3b5c-442e-a1c7-46ca7f5f765f tempest-VolumesExtendTest-929829731 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:37:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-0e9cb7fa-3b5c-442e-a1c7-46ca7f5f765f tempest-VolumesExtendTest-929829731 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d 2G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-0e9cb7fa-3b5c-442e-a1c7-46ca7f5f765f tempest-VolumesExtendTest-929829731 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d 2G" returned: 0 in 0.081s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-0e9cb7fa-3b5c-442e-a1c7-46ca7f5f765f tempest-VolumesExtendTest-929829731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.893s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:37:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-31c0c884-645e-4013-9679-b7a08dd54280 tempest-VolumeQuotasAdminTestJSON-1953034656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.636s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:37:29 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-31c0c884-645e-4013-9679-b7a08dd54280 tempest-VolumeQuotasAdminTestJSON-1953034656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1359519994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f70d379a-c028-472b-a4fe-aa81f3f5e505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c79411d5a1a84b58a5aa390858a9e5ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:37:27Z,use_quota=True,user_id='9c5368625865465d95889e44c9dac3ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:37:29 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-31c0c884-645e-4013-9679-b7a08dd54280 tempest-VolumeQuotasAdminTestJSON-1953034656 None] Creating volume f70d379a-c028-472b-a4fe-aa81f3f5e505 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:37:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-31c0c884-645e-4013-9679-b7a08dd54280 tempest-VolumeQuotasAdminTestJSON-1953034656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:37:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-31c0c884-645e-4013-9679-b7a08dd54280 tempest-VolumeQuotasAdminTestJSON-1953034656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:37:29 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-31c0c884-645e-4013-9679-b7a08dd54280 tempest-VolumeQuotasAdminTestJSON-1953034656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:37:29 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-31c0c884-645e-4013-9679-b7a08dd54280 tempest-VolumeQuotasAdminTestJSON-1953034656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:37:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-31c0c884-645e-4013-9679-b7a08dd54280 tempest-VolumeQuotasAdminTestJSON-1953034656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:37:29 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-31c0c884-645e-4013-9679-b7a08dd54280 tempest-VolumeQuotasAdminTestJSON-1953034656 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:37:29 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-31c0c884-645e-4013-9679-b7a08dd54280 tempest-VolumeQuotasAdminTestJSON-1953034656 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:37:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-31c0c884-645e-4013-9679-b7a08dd54280 tempest-VolumeQuotasAdminTestJSON-1953034656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f70d379a-c028-472b-a4fe-aa81f3f5e505 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:29 devstack sudo[100368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f70d379a-c028-472b-a4fe-aa81f3f5e505 1073741824 Jul 11 04:37:29 devstack sudo[100368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:29 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-0e9cb7fa-3b5c-442e-a1c7-46ca7f5f765f tempest-VolumesExtendTest-929829731 None] Extend volume completed successfully. Jul 11 04:37:30 devstack sudo[100368]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-31c0c884-645e-4013-9679-b7a08dd54280 tempest-VolumeQuotasAdminTestJSON-1953034656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f70d379a-c028-472b-a4fe-aa81f3f5e505 1073741824" returned: 0 in 0.892s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-31c0c884-645e-4013-9679-b7a08dd54280 tempest-VolumeQuotasAdminTestJSON-1953034656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f70d379a-c028-472b-a4fe-aa81f3f5e505 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:30 devstack sudo[100374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f70d379a-c028-472b-a4fe-aa81f3f5e505 Jul 11 04:37:30 devstack sudo[100374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:30 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c3ef2690-ca02-4e2f-a4ff-d9a47f046ed4 tempest-VolumesExtendTest-929829731 None] Acquiring lock "cinder-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:37:30 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c3ef2690-ca02-4e2f-a4ff-d9a47f046ed4 tempest-VolumesExtendTest-929829731 None] Lock "cinder-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:37:30 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb6fc344-4bc7-4b30-a213-569c689c0906 tempest-TestStampPattern-25865344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:37:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-eb6fc344-4bc7-4b30-a213-569c689c0906 tempest-TestStampPattern-25865344 None] Flow 'volume_create_manager' (dcd49f78-9555-4d40-a4da-84aebfeccd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:37:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-eb6fc344-4bc7-4b30-a213-569c689c0906 tempest-TestStampPattern-25865344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4cab11f-5597-41c4-92a9-91c24b3a6a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-eb6fc344-4bc7-4b30-a213-569c689c0906 tempest-TestStampPattern-25865344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4cab11f-5597-41c4-92a9-91c24b3a6a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1295234233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45f7be47-35fe-47b5-9b29-102708f56eb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='597256c8a28b4fcc91ee2a96a26876f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:37:31Z,use_quota=True,user_id='35b3f658ccf442bfadb717ab1d84094f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-eb6fc344-4bc7-4b30-a213-569c689c0906 tempest-TestStampPattern-25865344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (903e4660-6abd-45cd-af03-6eb1768e6aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-eb6fc344-4bc7-4b30-a213-569c689c0906 tempest-TestStampPattern-25865344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (903e4660-6abd-45cd-af03-6eb1768e6aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-eb6fc344-4bc7-4b30-a213-569c689c0906 tempest-TestStampPattern-25865344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d3fdce-89f1-4163-adf4-76593b4e6ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-eb6fc344-4bc7-4b30-a213-569c689c0906 tempest-TestStampPattern-25865344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d3fdce-89f1-4163-adf4-76593b4e6ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45f7be47-35fe-47b5-9b29-102708f56eb0', 'volume_name': 'volume-45f7be47-35fe-47b5-9b29-102708f56eb0', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-eb6fc344-4bc7-4b30-a213-569c689c0906 tempest-TestStampPattern-25865344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ce270a6-81b8-41ae-98f4-05142e55af05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-eb6fc344-4bc7-4b30-a213-569c689c0906 tempest-TestStampPattern-25865344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ce270a6-81b8-41ae-98f4-05142e55af05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-eb6fc344-4bc7-4b30-a213-569c689c0906 tempest-TestStampPattern-25865344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00e78383-e413-497b-b9a9-7786f7edbd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:30 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-eb6fc344-4bc7-4b30-a213-569c689c0906 tempest-TestStampPattern-25865344 None] Volume 45f7be47-35fe-47b5-9b29-102708f56eb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45f7be47-35fe-47b5-9b29-102708f56eb0', 'volume_size': 1} Jul 11 04:37:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-eb6fc344-4bc7-4b30-a213-569c689c0906 tempest-TestStampPattern-25865344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:37:30 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c3ef2690-ca02-4e2f-a4ff-d9a47f046ed4 tempest-VolumesExtendTest-929829731 None] Acquiring lock "cinder-quobyte-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:37:31 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c3ef2690-ca02-4e2f-a4ff-d9a47f046ed4 tempest-VolumesExtendTest-929829731 None] Lock "cinder-quobyte-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d" acquired by "delete_volume" :: waited 0.021s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:37:31 devstack sudo[100374]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-31c0c884-645e-4013-9679-b7a08dd54280 tempest-VolumeQuotasAdminTestJSON-1953034656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f70d379a-c028-472b-a4fe-aa81f3f5e505" returned: 0 in 0.744s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:31 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-31c0c884-645e-4013-9679-b7a08dd54280 tempest-VolumeQuotasAdminTestJSON-1953034656 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:37:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-31c0c884-645e-4013-9679-b7a08dd54280 tempest-VolumeQuotasAdminTestJSON-1953034656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:37:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-eb6fc344-4bc7-4b30-a213-569c689c0906 tempest-TestStampPattern-25865344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.062s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:37:31 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-eb6fc344-4bc7-4b30-a213-569c689c0906 tempest-TestStampPattern-25865344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1295234233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45f7be47-35fe-47b5-9b29-102708f56eb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='597256c8a28b4fcc91ee2a96a26876f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:37:31Z,use_quota=True,user_id='35b3f658ccf442bfadb717ab1d84094f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:37:31 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-eb6fc344-4bc7-4b30-a213-569c689c0906 tempest-TestStampPattern-25865344 None] Creating volume 45f7be47-35fe-47b5-9b29-102708f56eb0 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:37:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-eb6fc344-4bc7-4b30-a213-569c689c0906 tempest-TestStampPattern-25865344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:37:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-eb6fc344-4bc7-4b30-a213-569c689c0906 tempest-TestStampPattern-25865344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:37:31 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-eb6fc344-4bc7-4b30-a213-569c689c0906 tempest-TestStampPattern-25865344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:37:31 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-eb6fc344-4bc7-4b30-a213-569c689c0906 tempest-TestStampPattern-25865344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:37:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-eb6fc344-4bc7-4b30-a213-569c689c0906 tempest-TestStampPattern-25865344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:37:31 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-eb6fc344-4bc7-4b30-a213-569c689c0906 tempest-TestStampPattern-25865344 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:37:31 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-eb6fc344-4bc7-4b30-a213-569c689c0906 tempest-TestStampPattern-25865344 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:37:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-eb6fc344-4bc7-4b30-a213-569c689c0906 tempest-TestStampPattern-25865344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:31 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b2adae-2309-4813-b4b2-88d09a173745]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:37:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c3ef2690-ca02-4e2f-a4ff-d9a47f046ed4 tempest-VolumesExtendTest-929829731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:31 devstack sudo[100377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0 1073741824 Jul 11 04:37:31 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:31 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31c0c884-645e-4013-9679-b7a08dd54280 tempest-VolumeQuotasAdminTestJSON-1953034656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc2869ce-85d3-4085-a37e-b9269c3eea0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f70d379a-c028-472b-a4fe-aa81f3f5e505', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:31 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31c0c884-645e-4013-9679-b7a08dd54280 tempest-VolumeQuotasAdminTestJSON-1953034656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15d34d0c-0790-4fb0-b534-6d5b37e66242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:31 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-31c0c884-645e-4013-9679-b7a08dd54280 tempest-VolumeQuotasAdminTestJSON-1953034656 None] Volume volume-f70d379a-c028-472b-a4fe-aa81f3f5e505 (f70d379a-c028-472b-a4fe-aa81f3f5e505): created successfully Jul 11 04:37:31 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31c0c884-645e-4013-9679-b7a08dd54280 tempest-VolumeQuotasAdminTestJSON-1953034656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15d34d0c-0790-4fb0-b534-6d5b37e66242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:31 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31c0c884-645e-4013-9679-b7a08dd54280 tempest-VolumeQuotasAdminTestJSON-1953034656 None] Flow 'volume_create_manager' (d18875bc-1a9e-461c-98ed-0706ad8d354d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:37:31 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-31c0c884-645e-4013-9679-b7a08dd54280 tempest-VolumeQuotasAdminTestJSON-1953034656 None] Created volume successfully. Jul 11 04:37:31 devstack sudo[100378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d Jul 11 04:37:31 devstack sudo[100378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:31 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-65bece9c-841b-4f7e-b5c1-1614af0f1fef tempest-VolumeQuotasAdminTestJSON-1953034656 None] Acquiring lock "cinder-f70d379a-c028-472b-a4fe-aa81f3f5e505-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:37:31 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-65bece9c-841b-4f7e-b5c1-1614af0f1fef tempest-VolumeQuotasAdminTestJSON-1953034656 None] Lock "cinder-f70d379a-c028-472b-a4fe-aa81f3f5e505-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:37:31 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-65bece9c-841b-4f7e-b5c1-1614af0f1fef tempest-VolumeQuotasAdminTestJSON-1953034656 None] Acquiring lock "cinder-quobyte-f70d379a-c028-472b-a4fe-aa81f3f5e505" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:37:31 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-65bece9c-841b-4f7e-b5c1-1614af0f1fef tempest-VolumeQuotasAdminTestJSON-1953034656 None] Lock "cinder-quobyte-f70d379a-c028-472b-a4fe-aa81f3f5e505" acquired by "delete_volume" :: waited 0.018s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:37:31 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1cde5c-dcb2-4e9e-88d8-cd0b174e4994]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:37:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-65bece9c-841b-4f7e-b5c1-1614af0f1fef tempest-VolumeQuotasAdminTestJSON-1953034656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f70d379a-c028-472b-a4fe-aa81f3f5e505 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:31 devstack sudo[100378]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c3ef2690-ca02-4e2f-a4ff-d9a47f046ed4 tempest-VolumesExtendTest-929829731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d" returned: 0 in 0.919s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c3ef2690-ca02-4e2f-a4ff-d9a47f046ed4 tempest-VolumesExtendTest-929829731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:32 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-eb6fc344-4bc7-4b30-a213-569c689c0906 tempest-TestStampPattern-25865344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0 1073741824" returned: 0 in 1.029s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:32 devstack sudo[100390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f70d379a-c028-472b-a4fe-aa81f3f5e505 Jul 11 04:37:32 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:32 devstack sudo[100391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d Jul 11 04:37:32 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-eb6fc344-4bc7-4b30-a213-569c689c0906 tempest-TestStampPattern-25865344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:32 devstack sudo[100394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0 Jul 11 04:37:32 devstack sudo[100394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:32 devstack sudo[100394]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-eb6fc344-4bc7-4b30-a213-569c689c0906 tempest-TestStampPattern-25865344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0" returned: 0 in 0.690s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:32 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-eb6fc344-4bc7-4b30-a213-569c689c0906 tempest-TestStampPattern-25865344 None] <== create_volume: return (1780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:37:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-eb6fc344-4bc7-4b30-a213-569c689c0906 tempest-TestStampPattern-25865344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.782s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:37:32 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:32 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c3ef2690-ca02-4e2f-a4ff-d9a47f046ed4 tempest-VolumesExtendTest-929829731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d" returned: 1 in 0.842s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c3ef2690-ca02-4e2f-a4ff-d9a47f046ed4 tempest-VolumesExtendTest-929829731 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:37:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c3ef2690-ca02-4e2f-a4ff-d9a47f046ed4 tempest-VolumesExtendTest-929829731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-65bece9c-841b-4f7e-b5c1-1614af0f1fef tempest-VolumeQuotasAdminTestJSON-1953034656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f70d379a-c028-472b-a4fe-aa81f3f5e505" returned: 0 in 0.903s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-65bece9c-841b-4f7e-b5c1-1614af0f1fef tempest-VolumeQuotasAdminTestJSON-1953034656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f70d379a-c028-472b-a4fe-aa81f3f5e505 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:32 devstack sudo[100403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d Jul 11 04:37:32 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:32 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-eb6fc344-4bc7-4b30-a213-569c689c0906 tempest-TestStampPattern-25865344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00e78383-e413-497b-b9a9-7786f7edbd6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45f7be47-35fe-47b5-9b29-102708f56eb0', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:32 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-eb6fc344-4bc7-4b30-a213-569c689c0906 tempest-TestStampPattern-25865344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7f26515-dffa-4b69-95b7-91fc93bba9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:32 devstack sudo[100404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f70d379a-c028-472b-a4fe-aa81f3f5e505 Jul 11 04:37:32 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:32 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-eb6fc344-4bc7-4b30-a213-569c689c0906 tempest-TestStampPattern-25865344 None] Volume volume-45f7be47-35fe-47b5-9b29-102708f56eb0 (45f7be47-35fe-47b5-9b29-102708f56eb0): created successfully Jul 11 04:37:32 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-eb6fc344-4bc7-4b30-a213-569c689c0906 tempest-TestStampPattern-25865344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7f26515-dffa-4b69-95b7-91fc93bba9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:32 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-eb6fc344-4bc7-4b30-a213-569c689c0906 tempest-TestStampPattern-25865344 None] Flow 'volume_create_manager' (dcd49f78-9555-4d40-a4da-84aebfeccd02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:37:32 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-eb6fc344-4bc7-4b30-a213-569c689c0906 tempest-TestStampPattern-25865344 None] Created volume successfully. Jul 11 04:37:33 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c3ef2690-ca02-4e2f-a4ff-d9a47f046ed4 tempest-VolumesExtendTest-929829731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d" returned: 0 in 0.716s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:33 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c3ef2690-ca02-4e2f-a4ff-d9a47f046ed4 tempest-VolumesExtendTest-929829731 None] Lock "cinder-quobyte-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d" released by "delete_volume" :: held 2.559s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:37:33 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-65bece9c-841b-4f7e-b5c1-1614af0f1fef tempest-VolumeQuotasAdminTestJSON-1953034656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f70d379a-c028-472b-a4fe-aa81f3f5e505" returned: 0 in 0.748s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:33 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-65bece9c-841b-4f7e-b5c1-1614af0f1fef tempest-VolumeQuotasAdminTestJSON-1953034656 None] Lock "cinder-quobyte-f70d379a-c028-472b-a4fe-aa81f3f5e505" released by "delete_volume" :: held 1.707s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:37:33 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-c3ef2690-ca02-4e2f-a4ff-d9a47f046ed4 tempest-VolumesExtendTest-929829731 None] Created reservations ['d64e8185-8c0f-4f5a-8931-ae964c8259df', '74a436e0-c0ca-47ec-9bf2-9b1741680e95', '9c02ca9b-a438-4b02-a8ef-885d140fc661', '9c855a39-44a6-4987-9920-778d3c8d2c59'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:37:33 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-65bece9c-841b-4f7e-b5c1-1614af0f1fef tempest-VolumeQuotasAdminTestJSON-1953034656 None] Created reservations ['45d564a4-325b-497c-8801-4f85b5110de1', '24de6a88-9de5-417b-8e86-a2753ed229c8', '7ea72d53-15c6-4ae1-bcb7-bbb1c9d25fba', '285b1e50-c541-4363-ac0a-3e134e0e10e9'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:37:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c3ef2690-ca02-4e2f-a4ff-d9a47f046ed4 tempest-VolumesExtendTest-929829731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:37:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c3ef2690-ca02-4e2f-a4ff-d9a47f046ed4 tempest-VolumesExtendTest-929829731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:37:33 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c3ef2690-ca02-4e2f-a4ff-d9a47f046ed4 tempest-VolumesExtendTest-929829731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:37:33 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c3ef2690-ca02-4e2f-a4ff-d9a47f046ed4 tempest-VolumesExtendTest-929829731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:37:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c3ef2690-ca02-4e2f-a4ff-d9a47f046ed4 tempest-VolumesExtendTest-929829731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:37:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c3ef2690-ca02-4e2f-a4ff-d9a47f046ed4 tempest-VolumesExtendTest-929829731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:33 devstack sudo[100410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:37:33 devstack sudo[100410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-65bece9c-841b-4f7e-b5c1-1614af0f1fef tempest-VolumeQuotasAdminTestJSON-1953034656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:37:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-65bece9c-841b-4f7e-b5c1-1614af0f1fef tempest-VolumeQuotasAdminTestJSON-1953034656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:37:33 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-65bece9c-841b-4f7e-b5c1-1614af0f1fef tempest-VolumeQuotasAdminTestJSON-1953034656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:37:33 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-65bece9c-841b-4f7e-b5c1-1614af0f1fef tempest-VolumeQuotasAdminTestJSON-1953034656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:37:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-65bece9c-841b-4f7e-b5c1-1614af0f1fef tempest-VolumeQuotasAdminTestJSON-1953034656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:37:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-65bece9c-841b-4f7e-b5c1-1614af0f1fef tempest-VolumeQuotasAdminTestJSON-1953034656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:33 devstack sudo[100412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:37:33 devstack sudo[100412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:34 devstack sudo[100412]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-65bece9c-841b-4f7e-b5c1-1614af0f1fef tempest-VolumeQuotasAdminTestJSON-1953034656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.754s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:34 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-65bece9c-841b-4f7e-b5c1-1614af0f1fef tempest-VolumeQuotasAdminTestJSON-1953034656 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:37:34 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-65bece9c-841b-4f7e-b5c1-1614af0f1fef tempest-VolumeQuotasAdminTestJSON-1953034656 None] Deleted volume successfully. Jul 11 04:37:34 devstack sudo[100410]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c3ef2690-ca02-4e2f-a4ff-d9a47f046ed4 tempest-VolumesExtendTest-929829731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.846s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:34 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-c3ef2690-ca02-4e2f-a4ff-d9a47f046ed4 tempest-VolumesExtendTest-929829731 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:37:34 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-c3ef2690-ca02-4e2f-a4ff-d9a47f046ed4 tempest-VolumesExtendTest-929829731 None] Deleted volume successfully. Jul 11 04:37:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-65bece9c-841b-4f7e-b5c1-1614af0f1fef tempest-VolumeQuotasAdminTestJSON-1953034656 None] Lock "cinder-f70d379a-c028-472b-a4fe-aa81f3f5e505-delete_volume" released by "delete_volume" :: held 2.786s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:37:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c3ef2690-ca02-4e2f-a4ff-d9a47f046ed4 tempest-VolumesExtendTest-929829731 None] Lock "cinder-7f2ad3e7-1d0c-46c6-8220-1651a43a5e5d-delete_volume" released by "delete_volume" :: held 3.759s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:37:34 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-6660a8ac-5b56-435e-9273-6ca45d6d8def tempest-VolumeQuotasAdminTestJSON-1953034656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:37:34 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6660a8ac-5b56-435e-9273-6ca45d6d8def tempest-VolumeQuotasAdminTestJSON-1953034656 None] Flow 'volume_create_manager' (66c0fe49-60b7-4cc1-a302-1aeab159ce2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:37:34 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6660a8ac-5b56-435e-9273-6ca45d6d8def tempest-VolumeQuotasAdminTestJSON-1953034656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8984f2d-e102-4cae-b5ea-8346bb1e74bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:34 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6660a8ac-5b56-435e-9273-6ca45d6d8def tempest-VolumeQuotasAdminTestJSON-1953034656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8984f2d-e102-4cae-b5ea-8346bb1e74bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2144457045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f39e55d-b890-4b6d-9929-29554bf26577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c79411d5a1a84b58a5aa390858a9e5ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:37:35Z,use_quota=True,user_id='9c5368625865465d95889e44c9dac3ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:34 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6660a8ac-5b56-435e-9273-6ca45d6d8def tempest-VolumeQuotasAdminTestJSON-1953034656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec789f1a-df78-4fb7-a020-1de700c25e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:34 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6660a8ac-5b56-435e-9273-6ca45d6d8def tempest-VolumeQuotasAdminTestJSON-1953034656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec789f1a-df78-4fb7-a020-1de700c25e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:34 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6660a8ac-5b56-435e-9273-6ca45d6d8def tempest-VolumeQuotasAdminTestJSON-1953034656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e331a00-195e-499a-b477-212e9a004a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:34 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6660a8ac-5b56-435e-9273-6ca45d6d8def tempest-VolumeQuotasAdminTestJSON-1953034656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e331a00-195e-499a-b477-212e9a004a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f39e55d-b890-4b6d-9929-29554bf26577', 'volume_name': 'volume-2f39e55d-b890-4b6d-9929-29554bf26577', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:34 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6660a8ac-5b56-435e-9273-6ca45d6d8def tempest-VolumeQuotasAdminTestJSON-1953034656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5bf1820-1607-4a32-b3ad-db95597d3182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:34 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6660a8ac-5b56-435e-9273-6ca45d6d8def tempest-VolumeQuotasAdminTestJSON-1953034656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5bf1820-1607-4a32-b3ad-db95597d3182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:34 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6660a8ac-5b56-435e-9273-6ca45d6d8def tempest-VolumeQuotasAdminTestJSON-1953034656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ad7e9a-074b-453f-b131-381bb355d5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:34 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-6660a8ac-5b56-435e-9273-6ca45d6d8def tempest-VolumeQuotasAdminTestJSON-1953034656 None] Volume 2f39e55d-b890-4b6d-9929-29554bf26577: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f39e55d-b890-4b6d-9929-29554bf26577', 'volume_size': 1} Jul 11 04:37:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6660a8ac-5b56-435e-9273-6ca45d6d8def tempest-VolumeQuotasAdminTestJSON-1953034656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:37:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6660a8ac-5b56-435e-9273-6ca45d6d8def tempest-VolumeQuotasAdminTestJSON-1953034656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:37:35 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6660a8ac-5b56-435e-9273-6ca45d6d8def tempest-VolumeQuotasAdminTestJSON-1953034656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2144457045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f39e55d-b890-4b6d-9929-29554bf26577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c79411d5a1a84b58a5aa390858a9e5ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:37:35Z,use_quota=True,user_id='9c5368625865465d95889e44c9dac3ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:37:35 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-6660a8ac-5b56-435e-9273-6ca45d6d8def tempest-VolumeQuotasAdminTestJSON-1953034656 None] Creating volume 2f39e55d-b890-4b6d-9929-29554bf26577 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:37:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6660a8ac-5b56-435e-9273-6ca45d6d8def tempest-VolumeQuotasAdminTestJSON-1953034656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:37:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6660a8ac-5b56-435e-9273-6ca45d6d8def tempest-VolumeQuotasAdminTestJSON-1953034656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:37:35 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6660a8ac-5b56-435e-9273-6ca45d6d8def tempest-VolumeQuotasAdminTestJSON-1953034656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:37:35 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6660a8ac-5b56-435e-9273-6ca45d6d8def tempest-VolumeQuotasAdminTestJSON-1953034656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:37:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6660a8ac-5b56-435e-9273-6ca45d6d8def tempest-VolumeQuotasAdminTestJSON-1953034656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:37:35 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6660a8ac-5b56-435e-9273-6ca45d6d8def tempest-VolumeQuotasAdminTestJSON-1953034656 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:37:35 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-6660a8ac-5b56-435e-9273-6ca45d6d8def tempest-VolumeQuotasAdminTestJSON-1953034656 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:37:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6660a8ac-5b56-435e-9273-6ca45d6d8def tempest-VolumeQuotasAdminTestJSON-1953034656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2f39e55d-b890-4b6d-9929-29554bf26577 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:35 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-975f368c-ce63-44e0-ba52-8a6a6dfb9176 tempest-VolumesExtendTest-929829731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:37:35 devstack sudo[100416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2f39e55d-b890-4b6d-9929-29554bf26577 1073741824 Jul 11 04:37:35 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-975f368c-ce63-44e0-ba52-8a6a6dfb9176 tempest-VolumesExtendTest-929829731 None] Flow 'volume_create_manager' (6b5d5ccd-6e5a-44f9-9e20-89e1134260d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:37:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-975f368c-ce63-44e0-ba52-8a6a6dfb9176 tempest-VolumesExtendTest-929829731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fb4245b-b547-4dc0-9225-674ae1530350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-975f368c-ce63-44e0-ba52-8a6a6dfb9176 tempest-VolumesExtendTest-929829731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fb4245b-b547-4dc0-9225-674ae1530350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-359469231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a5d91bb-05ce-4aeb-8410-11b3fb1df38f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95504154b9cf4935998ff1d516f3d75e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:37:35Z,use_quota=True,user_id='a133d16011944da1b346a315f48da9d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-975f368c-ce63-44e0-ba52-8a6a6dfb9176 tempest-VolumesExtendTest-929829731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2974560b-9cbd-493c-9e37-c0725690b6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-975f368c-ce63-44e0-ba52-8a6a6dfb9176 tempest-VolumesExtendTest-929829731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2974560b-9cbd-493c-9e37-c0725690b6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-975f368c-ce63-44e0-ba52-8a6a6dfb9176 tempest-VolumesExtendTest-929829731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a3185c-49bd-4d27-af40-0e4b797dade2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-975f368c-ce63-44e0-ba52-8a6a6dfb9176 tempest-VolumesExtendTest-929829731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a3185c-49bd-4d27-af40-0e4b797dade2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a5d91bb-05ce-4aeb-8410-11b3fb1df38f', 'volume_name': 'volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-975f368c-ce63-44e0-ba52-8a6a6dfb9176 tempest-VolumesExtendTest-929829731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7ae417a-8e18-4c4c-99a9-840b91e61729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-975f368c-ce63-44e0-ba52-8a6a6dfb9176 tempest-VolumesExtendTest-929829731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7ae417a-8e18-4c4c-99a9-840b91e61729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-975f368c-ce63-44e0-ba52-8a6a6dfb9176 tempest-VolumesExtendTest-929829731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a7a3ec9-4c71-4010-88dc-0ad23388cc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:35 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-975f368c-ce63-44e0-ba52-8a6a6dfb9176 tempest-VolumesExtendTest-929829731 None] Volume 0a5d91bb-05ce-4aeb-8410-11b3fb1df38f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f', 'volume_size': 1} Jul 11 04:37:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-975f368c-ce63-44e0-ba52-8a6a6dfb9176 tempest-VolumesExtendTest-929829731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:37:35 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6660a8ac-5b56-435e-9273-6ca45d6d8def tempest-VolumeQuotasAdminTestJSON-1953034656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2f39e55d-b890-4b6d-9929-29554bf26577 1073741824" returned: 0 in 0.881s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6660a8ac-5b56-435e-9273-6ca45d6d8def tempest-VolumeQuotasAdminTestJSON-1953034656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2f39e55d-b890-4b6d-9929-29554bf26577 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:35 devstack sudo[100422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2f39e55d-b890-4b6d-9929-29554bf26577 Jul 11 04:37:35 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:36 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6660a8ac-5b56-435e-9273-6ca45d6d8def tempest-VolumeQuotasAdminTestJSON-1953034656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2f39e55d-b890-4b6d-9929-29554bf26577" returned: 0 in 0.645s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6660a8ac-5b56-435e-9273-6ca45d6d8def tempest-VolumeQuotasAdminTestJSON-1953034656 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:37:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6660a8ac-5b56-435e-9273-6ca45d6d8def tempest-VolumeQuotasAdminTestJSON-1953034656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:37:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-975f368c-ce63-44e0-ba52-8a6a6dfb9176 tempest-VolumesExtendTest-929829731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.456s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:37:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-975f368c-ce63-44e0-ba52-8a6a6dfb9176 tempest-VolumesExtendTest-929829731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-359469231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a5d91bb-05ce-4aeb-8410-11b3fb1df38f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95504154b9cf4935998ff1d516f3d75e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:37:35Z,use_quota=True,user_id='a133d16011944da1b346a315f48da9d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:37:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-975f368c-ce63-44e0-ba52-8a6a6dfb9176 tempest-VolumesExtendTest-929829731 None] Creating volume 0a5d91bb-05ce-4aeb-8410-11b3fb1df38f {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:37:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-975f368c-ce63-44e0-ba52-8a6a6dfb9176 tempest-VolumesExtendTest-929829731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:37:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-975f368c-ce63-44e0-ba52-8a6a6dfb9176 tempest-VolumesExtendTest-929829731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:37:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-975f368c-ce63-44e0-ba52-8a6a6dfb9176 tempest-VolumesExtendTest-929829731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:37:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-975f368c-ce63-44e0-ba52-8a6a6dfb9176 tempest-VolumesExtendTest-929829731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:37:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-975f368c-ce63-44e0-ba52-8a6a6dfb9176 tempest-VolumesExtendTest-929829731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:37:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-975f368c-ce63-44e0-ba52-8a6a6dfb9176 tempest-VolumesExtendTest-929829731 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:37:36 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-975f368c-ce63-44e0-ba52-8a6a6dfb9176 tempest-VolumesExtendTest-929829731 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:37:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-975f368c-ce63-44e0-ba52-8a6a6dfb9176 tempest-VolumesExtendTest-929829731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:36 devstack sudo[100427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f 1073741824 Jul 11 04:37:36 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6660a8ac-5b56-435e-9273-6ca45d6d8def tempest-VolumeQuotasAdminTestJSON-1953034656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ad7e9a-074b-453f-b131-381bb355d5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f39e55d-b890-4b6d-9929-29554bf26577', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6660a8ac-5b56-435e-9273-6ca45d6d8def tempest-VolumeQuotasAdminTestJSON-1953034656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b44654e-f91a-4487-b8c1-c6812deb18ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:36 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-6660a8ac-5b56-435e-9273-6ca45d6d8def tempest-VolumeQuotasAdminTestJSON-1953034656 None] Volume volume-2f39e55d-b890-4b6d-9929-29554bf26577 (2f39e55d-b890-4b6d-9929-29554bf26577): created successfully Jul 11 04:37:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6660a8ac-5b56-435e-9273-6ca45d6d8def tempest-VolumeQuotasAdminTestJSON-1953034656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b44654e-f91a-4487-b8c1-c6812deb18ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6660a8ac-5b56-435e-9273-6ca45d6d8def tempest-VolumeQuotasAdminTestJSON-1953034656 None] Flow 'volume_create_manager' (66c0fe49-60b7-4cc1-a302-1aeab159ce2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:37:36 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-6660a8ac-5b56-435e-9273-6ca45d6d8def tempest-VolumeQuotasAdminTestJSON-1953034656 None] Created volume successfully. Jul 11 04:37:37 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-975f368c-ce63-44e0-ba52-8a6a6dfb9176 tempest-VolumesExtendTest-929829731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f 1073741824" returned: 0 in 0.937s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:37 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-d161b48b-0105-4215-a731-12207fa7fea1 tempest-VolumeQuotasAdminTestJSON-1190843757 None] Transfer volume completed successfully. Jul 11 04:37:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-975f368c-ce63-44e0-ba52-8a6a6dfb9176 tempest-VolumesExtendTest-929829731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:37 devstack sudo[100433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f Jul 11 04:37:37 devstack sudo[100433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:38 devstack sudo[100433]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-975f368c-ce63-44e0-ba52-8a6a6dfb9176 tempest-VolumesExtendTest-929829731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f" returned: 0 in 0.753s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:38 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-975f368c-ce63-44e0-ba52-8a6a6dfb9176 tempest-VolumesExtendTest-929829731 None] <== create_volume: return (1743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:37:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-975f368c-ce63-44e0-ba52-8a6a6dfb9176 tempest-VolumesExtendTest-929829731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.746s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:37:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-975f368c-ce63-44e0-ba52-8a6a6dfb9176 tempest-VolumesExtendTest-929829731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a7a3ec9-4c71-4010-88dc-0ad23388cc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-975f368c-ce63-44e0-ba52-8a6a6dfb9176 tempest-VolumesExtendTest-929829731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c84807-6524-471d-9fe4-bfa2f531ec89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:38 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-975f368c-ce63-44e0-ba52-8a6a6dfb9176 tempest-VolumesExtendTest-929829731 None] Volume volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f (0a5d91bb-05ce-4aeb-8410-11b3fb1df38f): created successfully Jul 11 04:37:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-975f368c-ce63-44e0-ba52-8a6a6dfb9176 tempest-VolumesExtendTest-929829731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c84807-6524-471d-9fe4-bfa2f531ec89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-975f368c-ce63-44e0-ba52-8a6a6dfb9176 tempest-VolumesExtendTest-929829731 None] Flow 'volume_create_manager' (6b5d5ccd-6e5a-44f9-9e20-89e1134260d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:37:38 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-975f368c-ce63-44e0-ba52-8a6a6dfb9176 tempest-VolumesExtendTest-929829731 None] Created volume successfully. Jul 11 04:37:38 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4c3b7293-2f53-4769-a992-b543d6c0651c tempest-VolumeQuotasAdminTestJSON-107398490 None] Acquiring lock "cinder-2f39e55d-b890-4b6d-9929-29554bf26577-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:37:38 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4c3b7293-2f53-4769-a992-b543d6c0651c tempest-VolumeQuotasAdminTestJSON-107398490 None] Lock "cinder-2f39e55d-b890-4b6d-9929-29554bf26577-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:37:38 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4c3b7293-2f53-4769-a992-b543d6c0651c tempest-VolumeQuotasAdminTestJSON-107398490 None] Acquiring lock "cinder-quobyte-2f39e55d-b890-4b6d-9929-29554bf26577" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:37:38 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4c3b7293-2f53-4769-a992-b543d6c0651c tempest-VolumeQuotasAdminTestJSON-107398490 None] Lock "cinder-quobyte-2f39e55d-b890-4b6d-9929-29554bf26577" acquired by "delete_volume" :: waited 0.014s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:37:38 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d869800-110d-449f-a456-622562629f8d]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:37:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4c3b7293-2f53-4769-a992-b543d6c0651c tempest-VolumeQuotasAdminTestJSON-107398490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2f39e55d-b890-4b6d-9929-29554bf26577 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:38 devstack sudo[100436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2f39e55d-b890-4b6d-9929-29554bf26577 Jul 11 04:37:38 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2dc6c83d-7fdc-4788-8d1e-877da31caf25 tempest-VolumesExtendTest-929829731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:37:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2dc6c83d-7fdc-4788-8d1e-877da31caf25 tempest-VolumesExtendTest-929829731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:37:39 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-2dc6c83d-7fdc-4788-8d1e-877da31caf25 tempest-VolumesExtendTest-929829731 None] Creating offline snapshot f1b7bcce-d28f-4b06-a948-9011e09b90c1 of volume 0a5d91bb-05ce-4aeb-8410-11b3fb1df38f {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:37:39 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b016981-d7c6-403d-a9e9-5c2f268e89a3]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:37:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2dc6c83d-7fdc-4788-8d1e-877da31caf25 tempest-VolumesExtendTest-929829731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:39 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4c3b7293-2f53-4769-a992-b543d6c0651c tempest-VolumeQuotasAdminTestJSON-107398490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2f39e55d-b890-4b6d-9929-29554bf26577" returned: 0 in 0.885s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4c3b7293-2f53-4769-a992-b543d6c0651c tempest-VolumeQuotasAdminTestJSON-107398490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2f39e55d-b890-4b6d-9929-29554bf26577 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:39 devstack sudo[100452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f Jul 11 04:37:39 devstack sudo[100452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:39 devstack sudo[100457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2f39e55d-b890-4b6d-9929-29554bf26577 Jul 11 04:37:39 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:40 devstack sudo[100452]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:40 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4c3b7293-2f53-4769-a992-b543d6c0651c tempest-VolumeQuotasAdminTestJSON-107398490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2f39e55d-b890-4b6d-9929-29554bf26577" returned: 0 in 0.755s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2dc6c83d-7fdc-4788-8d1e-877da31caf25 tempest-VolumesExtendTest-929829731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f" returned: 0 in 0.862s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2dc6c83d-7fdc-4788-8d1e-877da31caf25 tempest-VolumesExtendTest-929829731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f.f1b7bcce-d28f-4b06-a948-9011e09b90c1 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:40 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4c3b7293-2f53-4769-a992-b543d6c0651c tempest-VolumeQuotasAdminTestJSON-107398490 None] Lock "cinder-quobyte-2f39e55d-b890-4b6d-9929-29554bf26577" released by "delete_volume" :: held 1.696s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:37:40 devstack sudo[100467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f.f1b7bcce-d28f-4b06-a948-9011e09b90c1 1G Jul 11 04:37:40 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:40 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-4c3b7293-2f53-4769-a992-b543d6c0651c tempest-VolumeQuotasAdminTestJSON-107398490 None] Created reservations ['fb8c1c84-e91b-4de5-965c-04d031870e08', 'c17cdca9-8b71-4b76-be73-943cae0ec166', '88471a39-cb05-47f2-bc91-67418cd4f59d', '601ee8d9-dfb3-47f5-ad44-76acc765c09a'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:37:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4c3b7293-2f53-4769-a992-b543d6c0651c tempest-VolumeQuotasAdminTestJSON-107398490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:37:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4c3b7293-2f53-4769-a992-b543d6c0651c tempest-VolumeQuotasAdminTestJSON-107398490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:37:40 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4c3b7293-2f53-4769-a992-b543d6c0651c tempest-VolumeQuotasAdminTestJSON-107398490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:37:40 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4c3b7293-2f53-4769-a992-b543d6c0651c tempest-VolumeQuotasAdminTestJSON-107398490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:37:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4c3b7293-2f53-4769-a992-b543d6c0651c tempest-VolumeQuotasAdminTestJSON-107398490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:37:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4c3b7293-2f53-4769-a992-b543d6c0651c tempest-VolumeQuotasAdminTestJSON-107398490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:40 devstack sudo[100469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:37:40 devstack sudo[100469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:41 devstack sudo[100469]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4c3b7293-2f53-4769-a992-b543d6c0651c tempest-VolumeQuotasAdminTestJSON-107398490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.753s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:41 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-4c3b7293-2f53-4769-a992-b543d6c0651c tempest-VolumeQuotasAdminTestJSON-107398490 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:37:41 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-4c3b7293-2f53-4769-a992-b543d6c0651c tempest-VolumeQuotasAdminTestJSON-107398490 None] Deleted volume successfully. Jul 11 04:37:41 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2dc6c83d-7fdc-4788-8d1e-877da31caf25 tempest-VolumesExtendTest-929829731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f.f1b7bcce-d28f-4b06-a948-9011e09b90c1 1G" returned: 0 in 0.960s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2dc6c83d-7fdc-4788-8d1e-877da31caf25 tempest-VolumesExtendTest-929829731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f.f1b7bcce-d28f-4b06-a948-9011e09b90c1 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:41 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4c3b7293-2f53-4769-a992-b543d6c0651c tempest-VolumeQuotasAdminTestJSON-107398490 None] Lock "cinder-2f39e55d-b890-4b6d-9929-29554bf26577-delete_volume" released by "delete_volume" :: held 2.706s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:37:41 devstack sudo[100476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f.f1b7bcce-d28f-4b06-a948-9011e09b90c1 Jul 11 04:37:41 devstack sudo[100476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:41 devstack sudo[100476]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2dc6c83d-7fdc-4788-8d1e-877da31caf25 tempest-VolumesExtendTest-929829731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f.f1b7bcce-d28f-4b06-a948-9011e09b90c1" returned: 0 in 0.752s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:41 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-2dc6c83d-7fdc-4788-8d1e-877da31caf25 tempest-VolumesExtendTest-929829731 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f.f1b7bcce-d28f-4b06-a948-9011e09b90c1 is being set with open permissions: ugo+rw Jul 11 04:37:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2dc6c83d-7fdc-4788-8d1e-877da31caf25 tempest-VolumesExtendTest-929829731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f.f1b7bcce-d28f-4b06-a948-9011e09b90c1 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:42 devstack sudo[100481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f.f1b7bcce-d28f-4b06-a948-9011e09b90c1 Jul 11 04:37:42 devstack sudo[100481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:42 devstack sudo[100481]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2dc6c83d-7fdc-4788-8d1e-877da31caf25 tempest-VolumesExtendTest-929829731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f.f1b7bcce-d28f-4b06-a948-9011e09b90c1" returned: 0 in 0.874s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2dc6c83d-7fdc-4788-8d1e-877da31caf25 tempest-VolumesExtendTest-929829731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:42 devstack sudo[100519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f.info Jul 11 04:37:42 devstack sudo[100519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:43 devstack sudo[100519]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2dc6c83d-7fdc-4788-8d1e-877da31caf25 tempest-VolumesExtendTest-929829731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f.info" returned: 0 in 0.792s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:43 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-2dc6c83d-7fdc-4788-8d1e-877da31caf25 tempest-VolumesExtendTest-929829731 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f.info is being set with open permissions: ugo+rw Jul 11 04:37:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2dc6c83d-7fdc-4788-8d1e-877da31caf25 tempest-VolumesExtendTest-929829731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:43 devstack sudo[100534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f.info Jul 11 04:37:43 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:44 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2dc6c83d-7fdc-4788-8d1e-877da31caf25 tempest-VolumesExtendTest-929829731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f.info" returned: 0 in 0.681s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2dc6c83d-7fdc-4788-8d1e-877da31caf25 tempest-VolumesExtendTest-929829731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.077s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:37:44 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-2dc6c83d-7fdc-4788-8d1e-877da31caf25 tempest-VolumesExtendTest-929829731 None] Create snapshot completed successfully Jul 11 04:37:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3bf5568c-833c-42e5-a362-8a56fad2413e tempest-VolumesExtendTest-929829731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:37:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3bf5568c-833c-42e5-a362-8a56fad2413e tempest-VolumesExtendTest-929829731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:37:44 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d89a7cc-6e47-4193-af14-b6f3725e9fd7]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:37:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3bf5568c-833c-42e5-a362-8a56fad2413e tempest-VolumesExtendTest-929829731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:44 devstack sudo[100556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f Jul 11 04:37:44 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:45 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3bf5568c-833c-42e5-a362-8a56fad2413e tempest-VolumesExtendTest-929829731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f" returned: 0 in 0.879s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3bf5568c-833c-42e5-a362-8a56fad2413e tempest-VolumesExtendTest-929829731 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f.f1b7bcce-d28f-4b06-a948-9011e09b90c1 2G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3bf5568c-833c-42e5-a362-8a56fad2413e tempest-VolumesExtendTest-929829731 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f.f1b7bcce-d28f-4b06-a948-9011e09b90c1 2G" returned: 0 in 0.203s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3bf5568c-833c-42e5-a362-8a56fad2413e tempest-VolumesExtendTest-929829731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.162s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:37:46 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-3bf5568c-833c-42e5-a362-8a56fad2413e tempest-VolumesExtendTest-929829731 None] Extend volume completed successfully. Jul 11 04:37:47 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-627e9b8c-2e18-4e0b-acf8-7875e1d245f9 tempest-VolumesExtendTest-929829731 None] Acquiring lock "cinder-f1b7bcce-d28f-4b06-a948-9011e09b90c1-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:37:47 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-627e9b8c-2e18-4e0b-acf8-7875e1d245f9 tempest-VolumesExtendTest-929829731 None] Lock "cinder-f1b7bcce-d28f-4b06-a948-9011e09b90c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:37:47 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-627e9b8c-2e18-4e0b-acf8-7875e1d245f9 tempest-VolumesExtendTest-929829731 None] Acquiring lock "cinder-quobyte-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:37:47 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-627e9b8c-2e18-4e0b-acf8-7875e1d245f9 tempest-VolumesExtendTest-929829731 None] Lock "cinder-quobyte-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:37:47 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-627e9b8c-2e18-4e0b-acf8-7875e1d245f9 tempest-VolumesExtendTest-929829731 None] Acquiring lock "cinder-quobyte-f1b7bcce-d28f-4b06-a948-9011e09b90c1" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:37:47 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-627e9b8c-2e18-4e0b-acf8-7875e1d245f9 tempest-VolumesExtendTest-929829731 None] Lock "cinder-quobyte-f1b7bcce-d28f-4b06-a948-9011e09b90c1" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:37:47 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-627e9b8c-2e18-4e0b-acf8-7875e1d245f9 tempest-VolumesExtendTest-929829731 None] Deleting offline snapshot f1b7bcce-d28f-4b06-a948-9011e09b90c1 of volume 0a5d91bb-05ce-4aeb-8410-11b3fb1df38f {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:37:47 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-627e9b8c-2e18-4e0b-acf8-7875e1d245f9 tempest-VolumesExtendTest-929829731 None] snapshot_file for this snap is: volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f.f1b7bcce-d28f-4b06-a948-9011e09b90c1 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:37:47 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c5b084-291f-4029-b3d0-a527ffff2f8b]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:37:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-627e9b8c-2e18-4e0b-acf8-7875e1d245f9 tempest-VolumesExtendTest-929829731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f.f1b7bcce-d28f-4b06-a948-9011e09b90c1 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:47 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f.f1b7bcce-d28f-4b06-a948-9011e09b90c1 Jul 11 04:37:47 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:48 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-627e9b8c-2e18-4e0b-acf8-7875e1d245f9 tempest-VolumesExtendTest-929829731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f.f1b7bcce-d28f-4b06-a948-9011e09b90c1" returned: 0 in 1.000s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:48 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-627e9b8c-2e18-4e0b-acf8-7875e1d245f9 tempest-VolumesExtendTest-929829731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:37:48 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd55373d-6667-40b8-8bac-68c91e2d5f2e]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:37:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-627e9b8c-2e18-4e0b-acf8-7875e1d245f9 tempest-VolumesExtendTest-929829731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:48 devstack sudo[100572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f Jul 11 04:37:48 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:49 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-627e9b8c-2e18-4e0b-acf8-7875e1d245f9 tempest-VolumesExtendTest-929829731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f" returned: 0 in 0.923s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-627e9b8c-2e18-4e0b-acf8-7875e1d245f9 tempest-VolumesExtendTest-929829731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f.f1b7bcce-d28f-4b06-a948-9011e09b90c1 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:49 devstack sudo[100578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f.f1b7bcce-d28f-4b06-a948-9011e09b90c1 Jul 11 04:37:49 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:50 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-627e9b8c-2e18-4e0b-acf8-7875e1d245f9 tempest-VolumesExtendTest-929829731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f.f1b7bcce-d28f-4b06-a948-9011e09b90c1" returned: 0 in 1.220s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-627e9b8c-2e18-4e0b-acf8-7875e1d245f9 tempest-VolumesExtendTest-929829731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f.f1b7bcce-d28f-4b06-a948-9011e09b90c1 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:50 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f.f1b7bcce-d28f-4b06-a948-9011e09b90c1 Jul 11 04:37:50 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:51 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-627e9b8c-2e18-4e0b-acf8-7875e1d245f9 tempest-VolumesExtendTest-929829731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f.f1b7bcce-d28f-4b06-a948-9011e09b90c1" returned: 0 in 0.842s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-627e9b8c-2e18-4e0b-acf8-7875e1d245f9 tempest-VolumesExtendTest-929829731 None] Lock "cinder-quobyte-f1b7bcce-d28f-4b06-a948-9011e09b90c1" released by "_delete_snapshot" :: held 4.162s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:37:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-627e9b8c-2e18-4e0b-acf8-7875e1d245f9 tempest-VolumesExtendTest-929829731 None] Lock "cinder-quobyte-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f" released by "delete_snapshot" :: held 4.208s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:37:51 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-627e9b8c-2e18-4e0b-acf8-7875e1d245f9 tempest-VolumesExtendTest-929829731 None] Created reservations ['6c36c345-f561-455c-96cc-f1e45b54a0ef', 'fecb8c5e-9792-41a9-ab33-87c518901f29', '94f60eae-d3a2-45e3-81ef-d0fb066f19a0', 'e6ae32d8-83f1-4c4d-a875-d104bc2ea792'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:37:51 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-627e9b8c-2e18-4e0b-acf8-7875e1d245f9 tempest-VolumesExtendTest-929829731 None] Delete snapshot completed successfully. Jul 11 04:37:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-627e9b8c-2e18-4e0b-acf8-7875e1d245f9 tempest-VolumesExtendTest-929829731 None] Lock "cinder-f1b7bcce-d28f-4b06-a948-9011e09b90c1-delete_snapshot" released by "delete_snapshot" :: held 4.404s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:37:52 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c56308cb-6d35-4a31-a029-cd180cea7d2a tempest-VolumesExtendTest-929829731 None] Acquiring lock "cinder-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:37:52 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c56308cb-6d35-4a31-a029-cd180cea7d2a tempest-VolumesExtendTest-929829731 None] Lock "cinder-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:37:52 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c56308cb-6d35-4a31-a029-cd180cea7d2a tempest-VolumesExtendTest-929829731 None] Acquiring lock "cinder-quobyte-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:37:52 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c56308cb-6d35-4a31-a029-cd180cea7d2a tempest-VolumesExtendTest-929829731 None] Lock "cinder-quobyte-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f" acquired by "delete_volume" :: waited 0.021s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:37:52 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e0fe29-433b-4612-a4fc-d0c92f920251]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:37:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c56308cb-6d35-4a31-a029-cd180cea7d2a tempest-VolumesExtendTest-929829731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:52 devstack sudo[100589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f Jul 11 04:37:52 devstack sudo[100589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:53 devstack sudo[100589]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c56308cb-6d35-4a31-a029-cd180cea7d2a tempest-VolumesExtendTest-929829731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f" returned: 0 in 0.807s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c56308cb-6d35-4a31-a029-cd180cea7d2a tempest-VolumesExtendTest-929829731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:53 devstack sudo[100594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f Jul 11 04:37:53 devstack sudo[100594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:54 devstack sudo[100594]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c56308cb-6d35-4a31-a029-cd180cea7d2a tempest-VolumesExtendTest-929829731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f" returned: 0 in 0.672s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:54 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c56308cb-6d35-4a31-a029-cd180cea7d2a tempest-VolumesExtendTest-929829731 None] Lock "cinder-quobyte-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f" released by "delete_volume" :: held 1.552s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:37:54 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=112,cinder:INSERT=34,cinder:UPDATE=133,cinder:DELETE=8 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:37:54 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-c56308cb-6d35-4a31-a029-cd180cea7d2a tempest-VolumesExtendTest-929829731 None] Created reservations ['56ed699d-3ff2-4732-9b11-ad40734b9aeb', '6c87ed31-ee76-4513-ace1-155c4c253d3f', '03a89f5c-1e23-4f5c-8248-39f95227e99e', '1daa47b4-880e-4d63-b0c9-ab41e291d1e6'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:37:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c56308cb-6d35-4a31-a029-cd180cea7d2a tempest-VolumesExtendTest-929829731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:37:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c56308cb-6d35-4a31-a029-cd180cea7d2a tempest-VolumesExtendTest-929829731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:37:54 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c56308cb-6d35-4a31-a029-cd180cea7d2a tempest-VolumesExtendTest-929829731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:37:54 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c56308cb-6d35-4a31-a029-cd180cea7d2a tempest-VolumesExtendTest-929829731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:37:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c56308cb-6d35-4a31-a029-cd180cea7d2a tempest-VolumesExtendTest-929829731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:37:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c56308cb-6d35-4a31-a029-cd180cea7d2a tempest-VolumesExtendTest-929829731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:54 devstack sudo[100597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:37:54 devstack sudo[100597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:55 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e15dd9e-e12e-4318-9eed-2cdc121d5d1a tempest-VolumesTransfersV355Test-342143843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:37:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7e15dd9e-e12e-4318-9eed-2cdc121d5d1a tempest-VolumesTransfersV355Test-342143843 None] Flow 'volume_create_manager' (1379b391-9bab-4616-802c-4c6f3ea0ea30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:37:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7e15dd9e-e12e-4318-9eed-2cdc121d5d1a tempest-VolumesTransfersV355Test-342143843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99104957-c9eb-4122-8d37-638543dbb692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7e15dd9e-e12e-4318-9eed-2cdc121d5d1a tempest-VolumesTransfersV355Test-342143843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99104957-c9eb-4122-8d37-638543dbb692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-650376762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5411d5b8-a207-4eb7-a0f5-5283d7dc8036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bfe153d0f94fc7bc0d6fcfd67f0108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:37:55Z,use_quota=True,user_id='d8136f4bd2f44f26bb31b5d461c4f6f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7e15dd9e-e12e-4318-9eed-2cdc121d5d1a tempest-VolumesTransfersV355Test-342143843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f17b0cd5-9f1e-417a-8da1-da57e581a305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7e15dd9e-e12e-4318-9eed-2cdc121d5d1a tempest-VolumesTransfersV355Test-342143843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f17b0cd5-9f1e-417a-8da1-da57e581a305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7e15dd9e-e12e-4318-9eed-2cdc121d5d1a tempest-VolumesTransfersV355Test-342143843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23cffe2c-e69f-4086-a2fe-94c5b2d8bc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7e15dd9e-e12e-4318-9eed-2cdc121d5d1a tempest-VolumesTransfersV355Test-342143843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23cffe2c-e69f-4086-a2fe-94c5b2d8bc68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5411d5b8-a207-4eb7-a0f5-5283d7dc8036', 'volume_name': 'volume-5411d5b8-a207-4eb7-a0f5-5283d7dc8036', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7e15dd9e-e12e-4318-9eed-2cdc121d5d1a tempest-VolumesTransfersV355Test-342143843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f9ce658-65f8-4c94-b647-b1311f091e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7e15dd9e-e12e-4318-9eed-2cdc121d5d1a tempest-VolumesTransfersV355Test-342143843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f9ce658-65f8-4c94-b647-b1311f091e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7e15dd9e-e12e-4318-9eed-2cdc121d5d1a tempest-VolumesTransfersV355Test-342143843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd42850-6a6b-4bd4-9d2d-1398644128d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:55 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-7e15dd9e-e12e-4318-9eed-2cdc121d5d1a tempest-VolumesTransfersV355Test-342143843 None] Volume 5411d5b8-a207-4eb7-a0f5-5283d7dc8036: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5411d5b8-a207-4eb7-a0f5-5283d7dc8036', 'volume_size': 1} Jul 11 04:37:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7e15dd9e-e12e-4318-9eed-2cdc121d5d1a tempest-VolumesTransfersV355Test-342143843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:37:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7e15dd9e-e12e-4318-9eed-2cdc121d5d1a tempest-VolumesTransfersV355Test-342143843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:37:55 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7e15dd9e-e12e-4318-9eed-2cdc121d5d1a tempest-VolumesTransfersV355Test-342143843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-650376762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5411d5b8-a207-4eb7-a0f5-5283d7dc8036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bfe153d0f94fc7bc0d6fcfd67f0108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:37:55Z,use_quota=True,user_id='d8136f4bd2f44f26bb31b5d461c4f6f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:37:55 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-7e15dd9e-e12e-4318-9eed-2cdc121d5d1a tempest-VolumesTransfersV355Test-342143843 None] Creating volume 5411d5b8-a207-4eb7-a0f5-5283d7dc8036 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:37:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7e15dd9e-e12e-4318-9eed-2cdc121d5d1a tempest-VolumesTransfersV355Test-342143843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:37:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7e15dd9e-e12e-4318-9eed-2cdc121d5d1a tempest-VolumesTransfersV355Test-342143843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:37:55 devstack sudo[100597]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:55 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7e15dd9e-e12e-4318-9eed-2cdc121d5d1a tempest-VolumesTransfersV355Test-342143843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:37:55 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7e15dd9e-e12e-4318-9eed-2cdc121d5d1a tempest-VolumesTransfersV355Test-342143843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:37:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7e15dd9e-e12e-4318-9eed-2cdc121d5d1a tempest-VolumesTransfersV355Test-342143843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:37:55 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7e15dd9e-e12e-4318-9eed-2cdc121d5d1a tempest-VolumesTransfersV355Test-342143843 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:37:55 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-7e15dd9e-e12e-4318-9eed-2cdc121d5d1a tempest-VolumesTransfersV355Test-342143843 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:37:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7e15dd9e-e12e-4318-9eed-2cdc121d5d1a tempest-VolumesTransfersV355Test-342143843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5411d5b8-a207-4eb7-a0f5-5283d7dc8036 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c56308cb-6d35-4a31-a029-cd180cea7d2a tempest-VolumesExtendTest-929829731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.895s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:55 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-c56308cb-6d35-4a31-a029-cd180cea7d2a tempest-VolumesExtendTest-929829731 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:37:55 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-c56308cb-6d35-4a31-a029-cd180cea7d2a tempest-VolumesExtendTest-929829731 None] Deleted volume successfully. Jul 11 04:37:55 devstack sudo[100600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5411d5b8-a207-4eb7-a0f5-5283d7dc8036 1073741824 Jul 11 04:37:55 devstack sudo[100600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:55 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c56308cb-6d35-4a31-a029-cd180cea7d2a tempest-VolumesExtendTest-929829731 None] Lock "cinder-0a5d91bb-05ce-4aeb-8410-11b3fb1df38f-delete_volume" released by "delete_volume" :: held 2.703s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:37:56 devstack sudo[100600]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7e15dd9e-e12e-4318-9eed-2cdc121d5d1a tempest-VolumesTransfersV355Test-342143843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5411d5b8-a207-4eb7-a0f5-5283d7dc8036 1073741824" returned: 0 in 1.007s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7e15dd9e-e12e-4318-9eed-2cdc121d5d1a tempest-VolumesTransfersV355Test-342143843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5411d5b8-a207-4eb7-a0f5-5283d7dc8036 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:56 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5411d5b8-a207-4eb7-a0f5-5283d7dc8036 Jul 11 04:37:56 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:57 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7e15dd9e-e12e-4318-9eed-2cdc121d5d1a tempest-VolumesTransfersV355Test-342143843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5411d5b8-a207-4eb7-a0f5-5283d7dc8036" returned: 0 in 0.738s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:57 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7e15dd9e-e12e-4318-9eed-2cdc121d5d1a tempest-VolumesTransfersV355Test-342143843 None] <== create_volume: return (1816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:37:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7e15dd9e-e12e-4318-9eed-2cdc121d5d1a tempest-VolumesTransfersV355Test-342143843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.820s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:37:57 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7e15dd9e-e12e-4318-9eed-2cdc121d5d1a tempest-VolumesTransfersV355Test-342143843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd42850-6a6b-4bd4-9d2d-1398644128d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5411d5b8-a207-4eb7-a0f5-5283d7dc8036', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:57 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7e15dd9e-e12e-4318-9eed-2cdc121d5d1a tempest-VolumesTransfersV355Test-342143843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f9b70e3-c75f-4221-a1e4-68c63f42a329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:57 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-7e15dd9e-e12e-4318-9eed-2cdc121d5d1a tempest-VolumesTransfersV355Test-342143843 None] Volume volume-5411d5b8-a207-4eb7-a0f5-5283d7dc8036 (5411d5b8-a207-4eb7-a0f5-5283d7dc8036): created successfully Jul 11 04:37:57 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7e15dd9e-e12e-4318-9eed-2cdc121d5d1a tempest-VolumesTransfersV355Test-342143843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f9b70e3-c75f-4221-a1e4-68c63f42a329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:57 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7e15dd9e-e12e-4318-9eed-2cdc121d5d1a tempest-VolumesTransfersV355Test-342143843 None] Flow 'volume_create_manager' (1379b391-9bab-4616-802c-4c6f3ea0ea30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:37:57 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-7e15dd9e-e12e-4318-9eed-2cdc121d5d1a tempest-VolumesTransfersV355Test-342143843 None] Created volume successfully. Jul 11 04:37:58 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-15a00c69-a6a4-4803-a4ef-4390a194366c tempest-VolumesGetTest-1221404998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:37:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-15a00c69-a6a4-4803-a4ef-4390a194366c tempest-VolumesGetTest-1221404998 None] Flow 'volume_create_manager' (d557ffde-b151-4dd3-b10c-b9494aed1f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:37:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-15a00c69-a6a4-4803-a4ef-4390a194366c tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bff500b-c6c9-4823-a054-5fef35f84e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-15a00c69-a6a4-4803-a4ef-4390a194366c tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bff500b-c6c9-4823-a054-5fef35f84e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-884352212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ad21e2e-3336-4424-a5e6-8696edc4e5df,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8998b9f4cdb9498aa9a5e1476b63e03d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:37:58Z,use_quota=True,user_id='990c203db7fc4453a266794ad4d5b5c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-15a00c69-a6a4-4803-a4ef-4390a194366c tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9af2e71-12b8-4028-8c35-e4e3e105390d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-15a00c69-a6a4-4803-a4ef-4390a194366c tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9af2e71-12b8-4028-8c35-e4e3e105390d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-15a00c69-a6a4-4803-a4ef-4390a194366c tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79e8f5a1-5c19-4ad6-80bd-ad92970ef49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-15a00c69-a6a4-4803-a4ef-4390a194366c tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79e8f5a1-5c19-4ad6-80bd-ad92970ef49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ad21e2e-3336-4424-a5e6-8696edc4e5df', 'volume_name': 'volume-8ad21e2e-3336-4424-a5e6-8696edc4e5df', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-15a00c69-a6a4-4803-a4ef-4390a194366c tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54840c33-3c4d-4636-b81d-a390d1ee9210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-15a00c69-a6a4-4803-a4ef-4390a194366c tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54840c33-3c4d-4636-b81d-a390d1ee9210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-15a00c69-a6a4-4803-a4ef-4390a194366c tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05c6693d-3d1d-4c0f-8ed8-9ec8c4880710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:58 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-15a00c69-a6a4-4803-a4ef-4390a194366c tempest-VolumesGetTest-1221404998 None] Volume 8ad21e2e-3336-4424-a5e6-8696edc4e5df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ad21e2e-3336-4424-a5e6-8696edc4e5df', 'volume_size': 1} Jul 11 04:37:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-15a00c69-a6a4-4803-a4ef-4390a194366c tempest-VolumesGetTest-1221404998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:37:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-15a00c69-a6a4-4803-a4ef-4390a194366c tempest-VolumesGetTest-1221404998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:37:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-15a00c69-a6a4-4803-a4ef-4390a194366c tempest-VolumesGetTest-1221404998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-884352212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ad21e2e-3336-4424-a5e6-8696edc4e5df,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8998b9f4cdb9498aa9a5e1476b63e03d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:37:58Z,use_quota=True,user_id='990c203db7fc4453a266794ad4d5b5c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:37:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-15a00c69-a6a4-4803-a4ef-4390a194366c tempest-VolumesGetTest-1221404998 None] Creating volume 8ad21e2e-3336-4424-a5e6-8696edc4e5df {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:37:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-15a00c69-a6a4-4803-a4ef-4390a194366c tempest-VolumesGetTest-1221404998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:37:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-15a00c69-a6a4-4803-a4ef-4390a194366c tempest-VolumesGetTest-1221404998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:37:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-15a00c69-a6a4-4803-a4ef-4390a194366c tempest-VolumesGetTest-1221404998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:37:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-15a00c69-a6a4-4803-a4ef-4390a194366c tempest-VolumesGetTest-1221404998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:37:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-15a00c69-a6a4-4803-a4ef-4390a194366c tempest-VolumesGetTest-1221404998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:37:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-15a00c69-a6a4-4803-a4ef-4390a194366c tempest-VolumesGetTest-1221404998 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:37:58 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-15a00c69-a6a4-4803-a4ef-4390a194366c tempest-VolumesGetTest-1221404998 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:37:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-15a00c69-a6a4-4803-a4ef-4390a194366c tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8ad21e2e-3336-4424-a5e6-8696edc4e5df 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:58 devstack sudo[100632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8ad21e2e-3336-4424-a5e6-8696edc4e5df 1073741824 Jul 11 04:37:58 devstack sudo[100632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:58 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-eb5f836d-2fba-44e3-87dc-b60e6518cea8 tempest-VolumesTransfersV355Test-669604094 None] Transfer volume completed successfully. Jul 11 04:37:59 devstack sudo[100632]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-15a00c69-a6a4-4803-a4ef-4390a194366c tempest-VolumesGetTest-1221404998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8ad21e2e-3336-4424-a5e6-8696edc4e5df 1073741824" returned: 0 in 0.881s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-15a00c69-a6a4-4803-a4ef-4390a194366c tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8ad21e2e-3336-4424-a5e6-8696edc4e5df {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:59 devstack sudo[100638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8ad21e2e-3336-4424-a5e6-8696edc4e5df Jul 11 04:37:59 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:59 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:37:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:37:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:37:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:37:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:37:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:37:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:37:59 devstack sudo[100640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:37:59 devstack sudo[100640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:37:59 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-15a00c69-a6a4-4803-a4ef-4390a194366c tempest-VolumesGetTest-1221404998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8ad21e2e-3336-4424-a5e6-8696edc4e5df" returned: 0 in 0.640s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-15a00c69-a6a4-4803-a4ef-4390a194366c tempest-VolumesGetTest-1221404998 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:37:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-15a00c69-a6a4-4803-a4ef-4390a194366c tempest-VolumesGetTest-1221404998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:37:59 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:UPDATE=127,cinder:SELECT=104,cinder:INSERT=40,cinder:DELETE=11 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:37:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-15a00c69-a6a4-4803-a4ef-4390a194366c tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05c6693d-3d1d-4c0f-8ed8-9ec8c4880710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ad21e2e-3336-4424-a5e6-8696edc4e5df', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-15a00c69-a6a4-4803-a4ef-4390a194366c tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e12c34d-6427-4cd8-b684-1b76fbd566b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:37:59 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-15a00c69-a6a4-4803-a4ef-4390a194366c tempest-VolumesGetTest-1221404998 None] Volume volume-8ad21e2e-3336-4424-a5e6-8696edc4e5df (8ad21e2e-3336-4424-a5e6-8696edc4e5df): created successfully Jul 11 04:37:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-15a00c69-a6a4-4803-a4ef-4390a194366c tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e12c34d-6427-4cd8-b684-1b76fbd566b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:37:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-15a00c69-a6a4-4803-a4ef-4390a194366c tempest-VolumesGetTest-1221404998 None] Flow 'volume_create_manager' (d557ffde-b151-4dd3-b10c-b9494aed1f68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:37:59 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-15a00c69-a6a4-4803-a4ef-4390a194366c tempest-VolumesGetTest-1221404998 None] Created volume successfully. Jul 11 04:37:59 devstack sudo[100640]: pam_unix(sudo:session): session closed for user root Jul 11 04:37:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.680s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:37:59 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:37:59 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager._thread_info {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:37:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread count: 28 {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:37:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread info: [<_MainThread(MainThread, started 124675027595392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:37:59 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-2afc091b-46f1-45d4-89d1-c9d35122190e tempest-VolumesTransfersV355Test-2142417133 None] Acquiring lock "cinder-5411d5b8-a207-4eb7-a0f5-5283d7dc8036-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:37:59 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-2afc091b-46f1-45d4-89d1-c9d35122190e tempest-VolumesTransfersV355Test-2142417133 None] Lock "cinder-5411d5b8-a207-4eb7-a0f5-5283d7dc8036-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:37:59 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-2afc091b-46f1-45d4-89d1-c9d35122190e tempest-VolumesTransfersV355Test-2142417133 None] Acquiring lock "cinder-quobyte-5411d5b8-a207-4eb7-a0f5-5283d7dc8036" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:37:59 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-2afc091b-46f1-45d4-89d1-c9d35122190e tempest-VolumesTransfersV355Test-2142417133 None] Lock "cinder-quobyte-5411d5b8-a207-4eb7-a0f5-5283d7dc8036" acquired by "delete_volume" :: waited 0.019s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:38:00 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[1769f8df-e594-436d-8460-ea54b690cc83]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:38:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2afc091b-46f1-45d4-89d1-c9d35122190e tempest-VolumesTransfersV355Test-2142417133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5411d5b8-a207-4eb7-a0f5-5283d7dc8036 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:00 devstack sudo[100644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5411d5b8-a207-4eb7-a0f5-5283d7dc8036 Jul 11 04:38:00 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:00 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2afc091b-46f1-45d4-89d1-c9d35122190e tempest-VolumesTransfersV355Test-2142417133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5411d5b8-a207-4eb7-a0f5-5283d7dc8036" returned: 0 in 0.822s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2afc091b-46f1-45d4-89d1-c9d35122190e tempest-VolumesTransfersV355Test-2142417133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5411d5b8-a207-4eb7-a0f5-5283d7dc8036 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:00 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-4651ded8-34a5-4f50-b2b3-a698f990f724 tempest-VolumesGetTest-1221404998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:38:00 devstack sudo[100649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5411d5b8-a207-4eb7-a0f5-5283d7dc8036 Jul 11 04:38:00 devstack sudo[100649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4651ded8-34a5-4f50-b2b3-a698f990f724 tempest-VolumesGetTest-1221404998 None] Flow 'volume_create_manager' (b3594ef9-3735-4d38-867d-cb651f65e3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:38:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4651ded8-34a5-4f50-b2b3-a698f990f724 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e30a4898-e3b3-4182-9ded-d8fb18e5f93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4651ded8-34a5-4f50-b2b3-a698f990f724 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e30a4898-e3b3-4182-9ded-d8fb18e5f93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:38:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1581093095',display_name='tempest-VolumesGetTest-Volume-440599812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4afe1a0-3b4a-4f31-beaa-e32af46e007e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8998b9f4cdb9498aa9a5e1476b63e03d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:38:01Z,use_quota=True,user_id='990c203db7fc4453a266794ad4d5b5c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4651ded8-34a5-4f50-b2b3-a698f990f724 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44db0b25-9eb5-4872-a20f-3ee4d3308022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4651ded8-34a5-4f50-b2b3-a698f990f724 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44db0b25-9eb5-4872-a20f-3ee4d3308022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4651ded8-34a5-4f50-b2b3-a698f990f724 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bbfbc5c-db6e-4745-a123-2462740d3aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4651ded8-34a5-4f50-b2b3-a698f990f724 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bbfbc5c-db6e-4745-a123-2462740d3aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4afe1a0-3b4a-4f31-beaa-e32af46e007e', 'volume_name': 'volume-c4afe1a0-3b4a-4f31-beaa-e32af46e007e', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4651ded8-34a5-4f50-b2b3-a698f990f724 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31f2989a-f21d-41c8-8cbe-3baf7a2e0141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4651ded8-34a5-4f50-b2b3-a698f990f724 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31f2989a-f21d-41c8-8cbe-3baf7a2e0141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4651ded8-34a5-4f50-b2b3-a698f990f724 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ff88dd1-242f-44ed-929d-094234f047e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:00 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-4651ded8-34a5-4f50-b2b3-a698f990f724 tempest-VolumesGetTest-1221404998 None] Volume c4afe1a0-3b4a-4f31-beaa-e32af46e007e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4afe1a0-3b4a-4f31-beaa-e32af46e007e', 'volume_size': 1} Jul 11 04:38:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4651ded8-34a5-4f50-b2b3-a698f990f724 tempest-VolumesGetTest-1221404998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:38:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4651ded8-34a5-4f50-b2b3-a698f990f724 tempest-VolumesGetTest-1221404998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:38:00 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4651ded8-34a5-4f50-b2b3-a698f990f724 tempest-VolumesGetTest-1221404998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:38:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1581093095',display_name='tempest-VolumesGetTest-Volume-440599812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4afe1a0-3b4a-4f31-beaa-e32af46e007e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8998b9f4cdb9498aa9a5e1476b63e03d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:38:01Z,use_quota=True,user_id='990c203db7fc4453a266794ad4d5b5c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:38:00 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-4651ded8-34a5-4f50-b2b3-a698f990f724 tempest-VolumesGetTest-1221404998 None] Creating volume c4afe1a0-3b4a-4f31-beaa-e32af46e007e {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:38:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4651ded8-34a5-4f50-b2b3-a698f990f724 tempest-VolumesGetTest-1221404998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:38:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4651ded8-34a5-4f50-b2b3-a698f990f724 tempest-VolumesGetTest-1221404998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:38:00 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4651ded8-34a5-4f50-b2b3-a698f990f724 tempest-VolumesGetTest-1221404998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:38:00 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4651ded8-34a5-4f50-b2b3-a698f990f724 tempest-VolumesGetTest-1221404998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:38:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4651ded8-34a5-4f50-b2b3-a698f990f724 tempest-VolumesGetTest-1221404998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:38:00 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4651ded8-34a5-4f50-b2b3-a698f990f724 tempest-VolumesGetTest-1221404998 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:38:00 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-4651ded8-34a5-4f50-b2b3-a698f990f724 tempest-VolumesGetTest-1221404998 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:38:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4651ded8-34a5-4f50-b2b3-a698f990f724 tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c4afe1a0-3b4a-4f31-beaa-e32af46e007e 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:00 devstack sudo[100651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c4afe1a0-3b4a-4f31-beaa-e32af46e007e 1073741824 Jul 11 04:38:00 devstack sudo[100651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:01 devstack sudo[100649]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2afc091b-46f1-45d4-89d1-c9d35122190e tempest-VolumesTransfersV355Test-2142417133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5411d5b8-a207-4eb7-a0f5-5283d7dc8036" returned: 0 in 0.643s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:01 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-2afc091b-46f1-45d4-89d1-c9d35122190e tempest-VolumesTransfersV355Test-2142417133 None] Lock "cinder-quobyte-5411d5b8-a207-4eb7-a0f5-5283d7dc8036" released by "delete_volume" :: held 1.503s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:38:01 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-2afc091b-46f1-45d4-89d1-c9d35122190e tempest-VolumesTransfersV355Test-2142417133 None] Created reservations ['a8b60334-78eb-4a28-a240-639841629b52', '4847ff17-a506-4d45-9f5f-b1c66437d024', 'd773aaf7-c2a1-41dd-bfb3-7394d3c28352', 'a4f9eacd-d60d-4a3f-bd68-5c61f18c590b'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:38:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2afc091b-46f1-45d4-89d1-c9d35122190e tempest-VolumesTransfersV355Test-2142417133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:38:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2afc091b-46f1-45d4-89d1-c9d35122190e tempest-VolumesTransfersV355Test-2142417133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:38:01 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2afc091b-46f1-45d4-89d1-c9d35122190e tempest-VolumesTransfersV355Test-2142417133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:38:01 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2afc091b-46f1-45d4-89d1-c9d35122190e tempest-VolumesTransfersV355Test-2142417133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:38:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2afc091b-46f1-45d4-89d1-c9d35122190e tempest-VolumesTransfersV355Test-2142417133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:38:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2afc091b-46f1-45d4-89d1-c9d35122190e tempest-VolumesTransfersV355Test-2142417133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:01 devstack sudo[100657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:38:01 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:01 devstack sudo[100651]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4651ded8-34a5-4f50-b2b3-a698f990f724 tempest-VolumesGetTest-1221404998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c4afe1a0-3b4a-4f31-beaa-e32af46e007e 1073741824" returned: 0 in 0.862s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4651ded8-34a5-4f50-b2b3-a698f990f724 tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c4afe1a0-3b4a-4f31-beaa-e32af46e007e {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:01 devstack sudo[100660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c4afe1a0-3b4a-4f31-beaa-e32af46e007e Jul 11 04:38:01 devstack sudo[100660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:02 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2afc091b-46f1-45d4-89d1-c9d35122190e tempest-VolumesTransfersV355Test-2142417133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.718s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:02 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-2afc091b-46f1-45d4-89d1-c9d35122190e tempest-VolumesTransfersV355Test-2142417133 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:38:02 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-2afc091b-46f1-45d4-89d1-c9d35122190e tempest-VolumesTransfersV355Test-2142417133 None] Deleted volume successfully. Jul 11 04:38:02 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-2afc091b-46f1-45d4-89d1-c9d35122190e tempest-VolumesTransfersV355Test-2142417133 None] Lock "cinder-5411d5b8-a207-4eb7-a0f5-5283d7dc8036-delete_volume" released by "delete_volume" :: held 2.440s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:38:02 devstack sudo[100660]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4651ded8-34a5-4f50-b2b3-a698f990f724 tempest-VolumesGetTest-1221404998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c4afe1a0-3b4a-4f31-beaa-e32af46e007e" returned: 0 in 0.629s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:02 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4651ded8-34a5-4f50-b2b3-a698f990f724 tempest-VolumesGetTest-1221404998 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:38:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4651ded8-34a5-4f50-b2b3-a698f990f724 tempest-VolumesGetTest-1221404998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:38:02 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4651ded8-34a5-4f50-b2b3-a698f990f724 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ff88dd1-242f-44ed-929d-094234f047e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4afe1a0-3b4a-4f31-beaa-e32af46e007e', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:02 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4651ded8-34a5-4f50-b2b3-a698f990f724 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6893e0d1-6ef5-4ae5-827e-f068ff4c4162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:02 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-4651ded8-34a5-4f50-b2b3-a698f990f724 tempest-VolumesGetTest-1221404998 None] Volume volume-c4afe1a0-3b4a-4f31-beaa-e32af46e007e (c4afe1a0-3b4a-4f31-beaa-e32af46e007e): created successfully Jul 11 04:38:02 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4651ded8-34a5-4f50-b2b3-a698f990f724 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6893e0d1-6ef5-4ae5-827e-f068ff4c4162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:02 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4651ded8-34a5-4f50-b2b3-a698f990f724 tempest-VolumesGetTest-1221404998 None] Flow 'volume_create_manager' (b3594ef9-3735-4d38-867d-cb651f65e3c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:38:02 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-4651ded8-34a5-4f50-b2b3-a698f990f724 tempest-VolumesGetTest-1221404998 None] Created volume successfully. Jul 11 04:38:02 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b34f0f1-60a6-4a69-935d-51479e326847 tempest-VolumesTransfersV355Test-342143843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:38:02 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6b34f0f1-60a6-4a69-935d-51479e326847 tempest-VolumesTransfersV355Test-342143843 None] Flow 'volume_create_manager' (3214149c-0fc3-453a-977d-f0feda48c9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:38:02 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6b34f0f1-60a6-4a69-935d-51479e326847 tempest-VolumesTransfersV355Test-342143843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00a54a0b-ba2a-4f8d-8b93-aea411bf107e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:02 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6b34f0f1-60a6-4a69-935d-51479e326847 tempest-VolumesTransfersV355Test-342143843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00a54a0b-ba2a-4f8d-8b93-aea411bf107e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-44446028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65694c4a-339d-4691-8136-34a5542d391a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bfe153d0f94fc7bc0d6fcfd67f0108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:38:03Z,use_quota=True,user_id='d8136f4bd2f44f26bb31b5d461c4f6f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:02 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6b34f0f1-60a6-4a69-935d-51479e326847 tempest-VolumesTransfersV355Test-342143843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed50e30c-7660-43ef-bad9-a60aa404a930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:02 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6b34f0f1-60a6-4a69-935d-51479e326847 tempest-VolumesTransfersV355Test-342143843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed50e30c-7660-43ef-bad9-a60aa404a930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:02 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6b34f0f1-60a6-4a69-935d-51479e326847 tempest-VolumesTransfersV355Test-342143843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a94cb9-31ff-4818-acb5-534e36a48440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:02 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6b34f0f1-60a6-4a69-935d-51479e326847 tempest-VolumesTransfersV355Test-342143843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a94cb9-31ff-4818-acb5-534e36a48440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65694c4a-339d-4691-8136-34a5542d391a', 'volume_name': 'volume-65694c4a-339d-4691-8136-34a5542d391a', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:02 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6b34f0f1-60a6-4a69-935d-51479e326847 tempest-VolumesTransfersV355Test-342143843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f2c39ca-0da4-4116-a492-fd222a078fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:02 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6b34f0f1-60a6-4a69-935d-51479e326847 tempest-VolumesTransfersV355Test-342143843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f2c39ca-0da4-4116-a492-fd222a078fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:02 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6b34f0f1-60a6-4a69-935d-51479e326847 tempest-VolumesTransfersV355Test-342143843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03a082b8-9359-41ab-ae4f-20a3ff72c54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:02 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-6b34f0f1-60a6-4a69-935d-51479e326847 tempest-VolumesTransfersV355Test-342143843 None] Volume 65694c4a-339d-4691-8136-34a5542d391a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65694c4a-339d-4691-8136-34a5542d391a', 'volume_size': 1} Jul 11 04:38:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6b34f0f1-60a6-4a69-935d-51479e326847 tempest-VolumesTransfersV355Test-342143843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:38:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6b34f0f1-60a6-4a69-935d-51479e326847 tempest-VolumesTransfersV355Test-342143843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:38:02 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6b34f0f1-60a6-4a69-935d-51479e326847 tempest-VolumesTransfersV355Test-342143843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-44446028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65694c4a-339d-4691-8136-34a5542d391a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bfe153d0f94fc7bc0d6fcfd67f0108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:38:03Z,use_quota=True,user_id='d8136f4bd2f44f26bb31b5d461c4f6f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:38:02 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-6b34f0f1-60a6-4a69-935d-51479e326847 tempest-VolumesTransfersV355Test-342143843 None] Creating volume 65694c4a-339d-4691-8136-34a5542d391a {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:38:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6b34f0f1-60a6-4a69-935d-51479e326847 tempest-VolumesTransfersV355Test-342143843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:38:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6b34f0f1-60a6-4a69-935d-51479e326847 tempest-VolumesTransfersV355Test-342143843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:38:02 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6b34f0f1-60a6-4a69-935d-51479e326847 tempest-VolumesTransfersV355Test-342143843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:38:02 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6b34f0f1-60a6-4a69-935d-51479e326847 tempest-VolumesTransfersV355Test-342143843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:38:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6b34f0f1-60a6-4a69-935d-51479e326847 tempest-VolumesTransfersV355Test-342143843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:38:02 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6b34f0f1-60a6-4a69-935d-51479e326847 tempest-VolumesTransfersV355Test-342143843 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:38:02 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-6b34f0f1-60a6-4a69-935d-51479e326847 tempest-VolumesTransfersV355Test-342143843 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:38:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6b34f0f1-60a6-4a69-935d-51479e326847 tempest-VolumesTransfersV355Test-342143843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65694c4a-339d-4691-8136-34a5542d391a 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:02 devstack sudo[100664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65694c4a-339d-4691-8136-34a5542d391a 1073741824 Jul 11 04:38:02 devstack sudo[100664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:03 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-dac8cac4-2722-44fe-bac9-5ce4e5f7025d tempest-VolumesGetTest-1221404998 None] Acquiring lock "cinder-c4afe1a0-3b4a-4f31-beaa-e32af46e007e-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:38:03 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-dac8cac4-2722-44fe-bac9-5ce4e5f7025d tempest-VolumesGetTest-1221404998 None] Lock "cinder-c4afe1a0-3b4a-4f31-beaa-e32af46e007e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:38:03 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-dac8cac4-2722-44fe-bac9-5ce4e5f7025d tempest-VolumesGetTest-1221404998 None] Acquiring lock "cinder-quobyte-c4afe1a0-3b4a-4f31-beaa-e32af46e007e" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:38:03 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-dac8cac4-2722-44fe-bac9-5ce4e5f7025d tempest-VolumesGetTest-1221404998 None] Lock "cinder-quobyte-c4afe1a0-3b4a-4f31-beaa-e32af46e007e" acquired by "delete_volume" :: waited 0.015s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:38:03 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d727148-e400-4b48-8060-e777f2daa536]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:38:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dac8cac4-2722-44fe-bac9-5ce4e5f7025d tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c4afe1a0-3b4a-4f31-beaa-e32af46e007e {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:03 devstack sudo[100666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c4afe1a0-3b4a-4f31-beaa-e32af46e007e Jul 11 04:38:03 devstack sudo[100666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:03 devstack sudo[100664]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6b34f0f1-60a6-4a69-935d-51479e326847 tempest-VolumesTransfersV355Test-342143843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65694c4a-339d-4691-8136-34a5542d391a 1073741824" returned: 0 in 0.973s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6b34f0f1-60a6-4a69-935d-51479e326847 tempest-VolumesTransfersV355Test-342143843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65694c4a-339d-4691-8136-34a5542d391a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:03 devstack sudo[100672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65694c4a-339d-4691-8136-34a5542d391a Jul 11 04:38:03 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:03 devstack sudo[100666]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dac8cac4-2722-44fe-bac9-5ce4e5f7025d tempest-VolumesGetTest-1221404998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c4afe1a0-3b4a-4f31-beaa-e32af46e007e" returned: 0 in 0.809s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dac8cac4-2722-44fe-bac9-5ce4e5f7025d tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c4afe1a0-3b4a-4f31-beaa-e32af46e007e {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:04 devstack sudo[100677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c4afe1a0-3b4a-4f31-beaa-e32af46e007e Jul 11 04:38:04 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:04 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6b34f0f1-60a6-4a69-935d-51479e326847 tempest-VolumesTransfersV355Test-342143843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65694c4a-339d-4691-8136-34a5542d391a" returned: 0 in 0.723s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:04 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6b34f0f1-60a6-4a69-935d-51479e326847 tempest-VolumesTransfersV355Test-342143843 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:38:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6b34f0f1-60a6-4a69-935d-51479e326847 tempest-VolumesTransfersV355Test-342143843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:38:04 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6b34f0f1-60a6-4a69-935d-51479e326847 tempest-VolumesTransfersV355Test-342143843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03a082b8-9359-41ab-ae4f-20a3ff72c54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65694c4a-339d-4691-8136-34a5542d391a', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:04 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6b34f0f1-60a6-4a69-935d-51479e326847 tempest-VolumesTransfersV355Test-342143843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3baad5af-b088-49b9-8c70-39a0c49ab23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:04 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-6b34f0f1-60a6-4a69-935d-51479e326847 tempest-VolumesTransfersV355Test-342143843 None] Volume volume-65694c4a-339d-4691-8136-34a5542d391a (65694c4a-339d-4691-8136-34a5542d391a): created successfully Jul 11 04:38:04 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6b34f0f1-60a6-4a69-935d-51479e326847 tempest-VolumesTransfersV355Test-342143843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3baad5af-b088-49b9-8c70-39a0c49ab23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:04 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6b34f0f1-60a6-4a69-935d-51479e326847 tempest-VolumesTransfersV355Test-342143843 None] Flow 'volume_create_manager' (3214149c-0fc3-453a-977d-f0feda48c9b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:38:04 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-6b34f0f1-60a6-4a69-935d-51479e326847 tempest-VolumesTransfersV355Test-342143843 None] Created volume successfully. Jul 11 04:38:04 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dac8cac4-2722-44fe-bac9-5ce4e5f7025d tempest-VolumesGetTest-1221404998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c4afe1a0-3b4a-4f31-beaa-e32af46e007e" returned: 0 in 0.733s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:04 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-dac8cac4-2722-44fe-bac9-5ce4e5f7025d tempest-VolumesGetTest-1221404998 None] Lock "cinder-quobyte-c4afe1a0-3b4a-4f31-beaa-e32af46e007e" released by "delete_volume" :: held 1.597s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:38:04 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-dac8cac4-2722-44fe-bac9-5ce4e5f7025d tempest-VolumesGetTest-1221404998 None] Created reservations ['551cc4c8-9b99-472c-8c9b-8bb1432267cf', '09d0d1da-fe03-4072-b42e-41b65679ae7b', '8c30c3a4-2bb8-434d-a9f4-c9510255fdb5', '9a0607ce-fd43-407d-becb-0a0b3cba9a9e'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:38:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-dac8cac4-2722-44fe-bac9-5ce4e5f7025d tempest-VolumesGetTest-1221404998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:38:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-dac8cac4-2722-44fe-bac9-5ce4e5f7025d tempest-VolumesGetTest-1221404998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:38:04 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-dac8cac4-2722-44fe-bac9-5ce4e5f7025d tempest-VolumesGetTest-1221404998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:38:04 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-dac8cac4-2722-44fe-bac9-5ce4e5f7025d tempest-VolumesGetTest-1221404998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:38:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-dac8cac4-2722-44fe-bac9-5ce4e5f7025d tempest-VolumesGetTest-1221404998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:38:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dac8cac4-2722-44fe-bac9-5ce4e5f7025d tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:04 devstack sudo[100717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:38:04 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:05 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-227c8d0e-32b0-44a4-b75a-ec6565988150 tempest-VolumesTransfersV355Test-2142417133 None] Acquiring lock "cinder-65694c4a-339d-4691-8136-34a5542d391a-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:38:05 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-227c8d0e-32b0-44a4-b75a-ec6565988150 tempest-VolumesTransfersV355Test-2142417133 None] Lock "cinder-65694c4a-339d-4691-8136-34a5542d391a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:38:05 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-227c8d0e-32b0-44a4-b75a-ec6565988150 tempest-VolumesTransfersV355Test-2142417133 None] Acquiring lock "cinder-quobyte-65694c4a-339d-4691-8136-34a5542d391a" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:38:05 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-227c8d0e-32b0-44a4-b75a-ec6565988150 tempest-VolumesTransfersV355Test-2142417133 None] Lock "cinder-quobyte-65694c4a-339d-4691-8136-34a5542d391a" acquired by "delete_volume" :: waited 0.015s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:38:05 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e7699e-b384-4067-99c8-805752014213]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:38:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-227c8d0e-32b0-44a4-b75a-ec6565988150 tempest-VolumesTransfersV355Test-2142417133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65694c4a-339d-4691-8136-34a5542d391a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:05 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-07ade12a-3408-4fef-a902-19a17b15e63d tempest-VolumesGetTest-1221404998 None] Acquiring lock "cinder-8ad21e2e-3336-4424-a5e6-8696edc4e5df-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:38:05 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-07ade12a-3408-4fef-a902-19a17b15e63d tempest-VolumesGetTest-1221404998 None] Lock "cinder-8ad21e2e-3336-4424-a5e6-8696edc4e5df-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:38:05 devstack sudo[100719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65694c4a-339d-4691-8136-34a5542d391a Jul 11 04:38:05 devstack sudo[100719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:05 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-07ade12a-3408-4fef-a902-19a17b15e63d tempest-VolumesGetTest-1221404998 None] Acquiring lock "cinder-quobyte-8ad21e2e-3336-4424-a5e6-8696edc4e5df" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:38:05 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-07ade12a-3408-4fef-a902-19a17b15e63d tempest-VolumesGetTest-1221404998 None] Lock "cinder-quobyte-8ad21e2e-3336-4424-a5e6-8696edc4e5df" acquired by "delete_volume" :: waited 0.017s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:38:05 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7635bf7-f997-410c-b1a1-6c776222ba30]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:38:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-07ade12a-3408-4fef-a902-19a17b15e63d tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8ad21e2e-3336-4424-a5e6-8696edc4e5df {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:05 devstack sudo[100722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8ad21e2e-3336-4424-a5e6-8696edc4e5df Jul 11 04:38:05 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:05 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dac8cac4-2722-44fe-bac9-5ce4e5f7025d tempest-VolumesGetTest-1221404998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.702s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:05 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-dac8cac4-2722-44fe-bac9-5ce4e5f7025d tempest-VolumesGetTest-1221404998 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:38:05 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-dac8cac4-2722-44fe-bac9-5ce4e5f7025d tempest-VolumesGetTest-1221404998 None] Deleted volume successfully. Jul 11 04:38:05 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-dac8cac4-2722-44fe-bac9-5ce4e5f7025d tempest-VolumesGetTest-1221404998 None] Lock "cinder-c4afe1a0-3b4a-4f31-beaa-e32af46e007e-delete_volume" released by "delete_volume" :: held 2.534s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:38:06 devstack sudo[100719]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-227c8d0e-32b0-44a4-b75a-ec6565988150 tempest-VolumesTransfersV355Test-2142417133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65694c4a-339d-4691-8136-34a5542d391a" returned: 0 in 0.850s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-227c8d0e-32b0-44a4-b75a-ec6565988150 tempest-VolumesTransfersV355Test-2142417133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65694c4a-339d-4691-8136-34a5542d391a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:06 devstack sudo[100730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65694c4a-339d-4691-8136-34a5542d391a Jul 11 04:38:06 devstack sudo[100730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:06 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-07ade12a-3408-4fef-a902-19a17b15e63d tempest-VolumesGetTest-1221404998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8ad21e2e-3336-4424-a5e6-8696edc4e5df" returned: 0 in 0.801s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-07ade12a-3408-4fef-a902-19a17b15e63d tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8ad21e2e-3336-4424-a5e6-8696edc4e5df {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:06 devstack sudo[100734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8ad21e2e-3336-4424-a5e6-8696edc4e5df Jul 11 04:38:06 devstack sudo[100734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:06 devstack sudo[100730]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-227c8d0e-32b0-44a4-b75a-ec6565988150 tempest-VolumesTransfersV355Test-2142417133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65694c4a-339d-4691-8136-34a5542d391a" returned: 0 in 0.682s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:06 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-227c8d0e-32b0-44a4-b75a-ec6565988150 tempest-VolumesTransfersV355Test-2142417133 None] Lock "cinder-quobyte-65694c4a-339d-4691-8136-34a5542d391a" released by "delete_volume" :: held 1.579s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:38:06 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-227c8d0e-32b0-44a4-b75a-ec6565988150 tempest-VolumesTransfersV355Test-2142417133 None] Created reservations ['8200b652-e00a-4554-8ecd-8ca8dbc0180f', '0a12c968-4b90-4f4e-b211-696f659a198c', 'c453b1ee-685f-4438-87bd-99f5961b46ac', 'ea9c6a20-0c5d-47bc-bb21-346674742cff'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:38:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-227c8d0e-32b0-44a4-b75a-ec6565988150 tempest-VolumesTransfersV355Test-2142417133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:38:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-227c8d0e-32b0-44a4-b75a-ec6565988150 tempest-VolumesTransfersV355Test-2142417133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:38:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-227c8d0e-32b0-44a4-b75a-ec6565988150 tempest-VolumesTransfersV355Test-2142417133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:38:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-227c8d0e-32b0-44a4-b75a-ec6565988150 tempest-VolumesTransfersV355Test-2142417133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:38:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-227c8d0e-32b0-44a4-b75a-ec6565988150 tempest-VolumesTransfersV355Test-2142417133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:38:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-227c8d0e-32b0-44a4-b75a-ec6565988150 tempest-VolumesTransfersV355Test-2142417133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:06 devstack sudo[100734]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-07ade12a-3408-4fef-a902-19a17b15e63d tempest-VolumesGetTest-1221404998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8ad21e2e-3336-4424-a5e6-8696edc4e5df" returned: 0 in 0.691s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:06 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-07ade12a-3408-4fef-a902-19a17b15e63d tempest-VolumesGetTest-1221404998 None] Lock "cinder-quobyte-8ad21e2e-3336-4424-a5e6-8696edc4e5df" released by "delete_volume" :: held 1.534s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:38:06 devstack sudo[100739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:38:06 devstack sudo[100739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:07 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-07ade12a-3408-4fef-a902-19a17b15e63d tempest-VolumesGetTest-1221404998 None] Created reservations ['1f33df70-3bd1-4661-91f9-ab69ceaf2fa7', '35bb5229-3f66-47fe-95f3-fdb5e70ed6b2', 'ba03e152-d64f-48d9-8165-1222846d6e55', 'de0cb359-83af-4009-b797-eb4b6a9aa541'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:38:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-07ade12a-3408-4fef-a902-19a17b15e63d tempest-VolumesGetTest-1221404998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:38:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-07ade12a-3408-4fef-a902-19a17b15e63d tempest-VolumesGetTest-1221404998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:38:07 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-07ade12a-3408-4fef-a902-19a17b15e63d tempest-VolumesGetTest-1221404998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:38:07 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-07ade12a-3408-4fef-a902-19a17b15e63d tempest-VolumesGetTest-1221404998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:38:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-07ade12a-3408-4fef-a902-19a17b15e63d tempest-VolumesGetTest-1221404998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:38:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-07ade12a-3408-4fef-a902-19a17b15e63d tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:07 devstack sudo[100741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:38:07 devstack sudo[100741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:07 devstack sudo[100739]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-227c8d0e-32b0-44a4-b75a-ec6565988150 tempest-VolumesTransfersV355Test-2142417133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.797s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:07 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-227c8d0e-32b0-44a4-b75a-ec6565988150 tempest-VolumesTransfersV355Test-2142417133 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:38:07 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-227c8d0e-32b0-44a4-b75a-ec6565988150 tempest-VolumesTransfersV355Test-2142417133 None] Deleted volume successfully. Jul 11 04:38:07 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-227c8d0e-32b0-44a4-b75a-ec6565988150 tempest-VolumesTransfersV355Test-2142417133 None] Lock "cinder-65694c4a-339d-4691-8136-34a5542d391a-delete_volume" released by "delete_volume" :: held 2.636s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:38:07 devstack sudo[100741]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-07ade12a-3408-4fef-a902-19a17b15e63d tempest-VolumesGetTest-1221404998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.829s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:07 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-07ade12a-3408-4fef-a902-19a17b15e63d tempest-VolumesGetTest-1221404998 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:38:07 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-07ade12a-3408-4fef-a902-19a17b15e63d tempest-VolumesGetTest-1221404998 None] Deleted volume successfully. Jul 11 04:38:07 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-07ade12a-3408-4fef-a902-19a17b15e63d tempest-VolumesGetTest-1221404998 None] Lock "cinder-8ad21e2e-3336-4424-a5e6-8696edc4e5df-delete_volume" released by "delete_volume" :: held 2.569s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:38:08 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-4217b924-052b-48c6-b5a9-f1e2095ba945 tempest-VolumesGetTest-1221404998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:38:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4217b924-052b-48c6-b5a9-f1e2095ba945 tempest-VolumesGetTest-1221404998 None] Flow 'volume_create_manager' (19e23dc1-50c7-4f55-8376-758b9fc8fa2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:38:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4217b924-052b-48c6-b5a9-f1e2095ba945 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01632369-80ca-4b4e-9726-17b7c15c294b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4217b924-052b-48c6-b5a9-f1e2095ba945 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01632369-80ca-4b4e-9726-17b7c15c294b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1321130084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f5cd45e-d1b2-44f9-8ba9-197472455f12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8998b9f4cdb9498aa9a5e1476b63e03d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:38:08Z,use_quota=True,user_id='990c203db7fc4453a266794ad4d5b5c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4217b924-052b-48c6-b5a9-f1e2095ba945 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de54e686-d475-4214-be9c-872e94756f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4217b924-052b-48c6-b5a9-f1e2095ba945 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de54e686-d475-4214-be9c-872e94756f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4217b924-052b-48c6-b5a9-f1e2095ba945 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dba34604-dfa2-40d1-b74f-e7276519f6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4217b924-052b-48c6-b5a9-f1e2095ba945 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dba34604-dfa2-40d1-b74f-e7276519f6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f5cd45e-d1b2-44f9-8ba9-197472455f12', 'volume_name': 'volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4217b924-052b-48c6-b5a9-f1e2095ba945 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ca610ac-e225-441d-9d0e-fcda5040cee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4217b924-052b-48c6-b5a9-f1e2095ba945 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ca610ac-e225-441d-9d0e-fcda5040cee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4217b924-052b-48c6-b5a9-f1e2095ba945 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e30922-2459-4031-a501-c2981b17552c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:08 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-4217b924-052b-48c6-b5a9-f1e2095ba945 tempest-VolumesGetTest-1221404998 None] Volume 9f5cd45e-d1b2-44f9-8ba9-197472455f12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12', 'volume_size': 1} Jul 11 04:38:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4217b924-052b-48c6-b5a9-f1e2095ba945 tempest-VolumesGetTest-1221404998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:38:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4217b924-052b-48c6-b5a9-f1e2095ba945 tempest-VolumesGetTest-1221404998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:38:08 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4217b924-052b-48c6-b5a9-f1e2095ba945 tempest-VolumesGetTest-1221404998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1321130084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f5cd45e-d1b2-44f9-8ba9-197472455f12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8998b9f4cdb9498aa9a5e1476b63e03d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:38:08Z,use_quota=True,user_id='990c203db7fc4453a266794ad4d5b5c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:38:08 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-4217b924-052b-48c6-b5a9-f1e2095ba945 tempest-VolumesGetTest-1221404998 None] Creating volume 9f5cd45e-d1b2-44f9-8ba9-197472455f12 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:38:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4217b924-052b-48c6-b5a9-f1e2095ba945 tempest-VolumesGetTest-1221404998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:38:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4217b924-052b-48c6-b5a9-f1e2095ba945 tempest-VolumesGetTest-1221404998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:38:08 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4217b924-052b-48c6-b5a9-f1e2095ba945 tempest-VolumesGetTest-1221404998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:38:08 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4217b924-052b-48c6-b5a9-f1e2095ba945 tempest-VolumesGetTest-1221404998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:38:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4217b924-052b-48c6-b5a9-f1e2095ba945 tempest-VolumesGetTest-1221404998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:38:08 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4217b924-052b-48c6-b5a9-f1e2095ba945 tempest-VolumesGetTest-1221404998 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:38:08 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-4217b924-052b-48c6-b5a9-f1e2095ba945 tempest-VolumesGetTest-1221404998 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:38:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4217b924-052b-48c6-b5a9-f1e2095ba945 tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:08 devstack sudo[100754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12 1073741824 Jul 11 04:38:08 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:09 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4217b924-052b-48c6-b5a9-f1e2095ba945 tempest-VolumesGetTest-1221404998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12 1073741824" returned: 0 in 0.936s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4217b924-052b-48c6-b5a9-f1e2095ba945 tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:09 devstack sudo[100760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12 Jul 11 04:38:09 devstack sudo[100760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:09 devstack sudo[100760]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4217b924-052b-48c6-b5a9-f1e2095ba945 tempest-VolumesGetTest-1221404998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12" returned: 0 in 0.743s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:09 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4217b924-052b-48c6-b5a9-f1e2095ba945 tempest-VolumesGetTest-1221404998 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:38:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4217b924-052b-48c6-b5a9-f1e2095ba945 tempest-VolumesGetTest-1221404998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:38:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4217b924-052b-48c6-b5a9-f1e2095ba945 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e30922-2459-4031-a501-c2981b17552c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4217b924-052b-48c6-b5a9-f1e2095ba945 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2477caab-6e46-4243-87ae-4b3b88f48b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:10 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-4217b924-052b-48c6-b5a9-f1e2095ba945 tempest-VolumesGetTest-1221404998 None] Volume volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12 (9f5cd45e-d1b2-44f9-8ba9-197472455f12): created successfully Jul 11 04:38:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4217b924-052b-48c6-b5a9-f1e2095ba945 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2477caab-6e46-4243-87ae-4b3b88f48b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4217b924-052b-48c6-b5a9-f1e2095ba945 tempest-VolumesGetTest-1221404998 None] Flow 'volume_create_manager' (19e23dc1-50c7-4f55-8376-758b9fc8fa2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:38:10 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-4217b924-052b-48c6-b5a9-f1e2095ba945 tempest-VolumesGetTest-1221404998 None] Created volume successfully. Jul 11 04:38:10 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:38:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Flow 'volume_create_manager' (330026ee-d3e9-4b9c-90c7-cf332193135a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:38:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12e1e9c3-265b-4ba8-bf16-96e07e619622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12e1e9c3-265b-4ba8-bf16-96e07e619622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-146068936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb5780bf-55bd-4c98-9d31-d0ffa18a730b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8998b9f4cdb9498aa9a5e1476b63e03d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=9f5cd45e-d1b2-44f9-8ba9-197472455f12,status='creating',terminated_at=None,updated_at=2026-07-11T02:38:11Z,use_quota=True,user_id='990c203db7fc4453a266794ad4d5b5c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b14b7c62-d261-42ad-a454-0156492aa0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b14b7c62-d261-42ad-a454-0156492aa0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfadfbc6-1c24-4882-9928-c1f93987bec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfadfbc6-1c24-4882-9928-c1f93987bec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'eb5780bf-55bd-4c98-9d31-d0ffa18a730b', 'volume_name': 'volume-eb5780bf-55bd-4c98-9d31-d0ffa18a730b', 'volume_size': 1, 'source_volid': '9f5cd45e-d1b2-44f9-8ba9-197472455f12', 'source_volstatus': 'available'}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e37937-2104-4a7b-898b-d2fa7aea7faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e37937-2104-4a7b-898b-d2fa7aea7faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc684004-95b8-4bdd-aee0-67a0c61563d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:10 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Volume eb5780bf-55bd-4c98-9d31-d0ffa18a730b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-eb5780bf-55bd-4c98-9d31-d0ffa18a730b', 'volume_size': 1, 'source_volid': '9f5cd45e-d1b2-44f9-8ba9-197472455f12', 'source_volstatus': 'available'} Jul 11 04:38:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:38:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:38:10 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Cloning volume 9f5cd45e-d1b2-44f9-8ba9-197472455f12 to volume eb5780bf-55bd-4c98-9d31-d0ffa18a730b Jul 11 04:38:10 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Creating offline snapshot 3f55e11b-e16d-48c7-8564-56b77479bcbe of volume 9f5cd45e-d1b2-44f9-8ba9-197472455f12 {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:38:11 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[d393a60b-d471-4b5b-829a-5bec61b129ab]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:38:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:11 devstack sudo[100770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12 Jul 11 04:38:11 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:11 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12" returned: 0 in 0.837s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12.3f55e11b-e16d-48c7-8564-56b77479bcbe 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:11 devstack sudo[100775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12.3f55e11b-e16d-48c7-8564-56b77479bcbe 1G Jul 11 04:38:11 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:12 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12.3f55e11b-e16d-48c7-8564-56b77479bcbe 1G" returned: 0 in 0.916s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12.3f55e11b-e16d-48c7-8564-56b77479bcbe {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:12 devstack sudo[100781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12.3f55e11b-e16d-48c7-8564-56b77479bcbe Jul 11 04:38:12 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:13 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce520750-54af-475a-83ee-6bb027717a91 tempest-VolumesCloneNegativeTest-1298961692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:38:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ce520750-54af-475a-83ee-6bb027717a91 tempest-VolumesCloneNegativeTest-1298961692 None] Flow 'volume_create_manager' (9eeeb31f-a2c8-4265-b104-06627c18db9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:38:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ce520750-54af-475a-83ee-6bb027717a91 tempest-VolumesCloneNegativeTest-1298961692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d8a5367-4c3f-4eb7-aea9-ebe775758a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ce520750-54af-475a-83ee-6bb027717a91 tempest-VolumesCloneNegativeTest-1298961692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d8a5367-4c3f-4eb7-aea9-ebe775758a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-612032306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6b5cf30-6bbd-4c4f-ab8d-49e1fdf6782c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29e0f3d9019d477288eb27376eef6e3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:38:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:38:13Z,use_quota=True,user_id='4d39a5f1e50c448f86ddcd44cc0f2d0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ce520750-54af-475a-83ee-6bb027717a91 tempest-VolumesCloneNegativeTest-1298961692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (342ba926-109b-49cc-a2aa-0cc78733a8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ce520750-54af-475a-83ee-6bb027717a91 tempest-VolumesCloneNegativeTest-1298961692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (342ba926-109b-49cc-a2aa-0cc78733a8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ce520750-54af-475a-83ee-6bb027717a91 tempest-VolumesCloneNegativeTest-1298961692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4307ab60-51e2-443d-9629-a6a4860800be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ce520750-54af-475a-83ee-6bb027717a91 tempest-VolumesCloneNegativeTest-1298961692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4307ab60-51e2-443d-9629-a6a4860800be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6b5cf30-6bbd-4c4f-ab8d-49e1fdf6782c', 'volume_name': 'volume-d6b5cf30-6bbd-4c4f-ab8d-49e1fdf6782c', 'volume_size': 2}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ce520750-54af-475a-83ee-6bb027717a91 tempest-VolumesCloneNegativeTest-1298961692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb4662f9-994c-43ee-9bc4-0f9f31faf401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ce520750-54af-475a-83ee-6bb027717a91 tempest-VolumesCloneNegativeTest-1298961692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb4662f9-994c-43ee-9bc4-0f9f31faf401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ce520750-54af-475a-83ee-6bb027717a91 tempest-VolumesCloneNegativeTest-1298961692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11ffcd7c-f3dd-4a14-8dd6-e37ea653d236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:13 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-ce520750-54af-475a-83ee-6bb027717a91 tempest-VolumesCloneNegativeTest-1298961692 None] Volume d6b5cf30-6bbd-4c4f-ab8d-49e1fdf6782c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6b5cf30-6bbd-4c4f-ab8d-49e1fdf6782c', 'volume_size': 2} Jul 11 04:38:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ce520750-54af-475a-83ee-6bb027717a91 tempest-VolumesCloneNegativeTest-1298961692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:38:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-0e456ffd-3278-4855-9c21-fadb444be451 req-0727f6d4-e612-4b0f-9a94-12b7de3601f5 tempest-TestStampPattern-25865344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:38:13 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12.3f55e11b-e16d-48c7-8564-56b77479bcbe" returned: 0 in 0.724s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:13 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12.3f55e11b-e16d-48c7-8564-56b77479bcbe is being set with open permissions: ugo+rw Jul 11 04:38:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12.3f55e11b-e16d-48c7-8564-56b77479bcbe {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:13 devstack sudo[100794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12.3f55e11b-e16d-48c7-8564-56b77479bcbe Jul 11 04:38:13 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:14 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12.3f55e11b-e16d-48c7-8564-56b77479bcbe" returned: 0 in 0.616s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:14 devstack sudo[100797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12.info Jul 11 04:38:14 devstack sudo[100797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:14 devstack sudo[100797]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12.info" returned: 0 in 0.631s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:14 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12.info is being set with open permissions: ugo+rw Jul 11 04:38:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:14 devstack sudo[100800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12.info Jul 11 04:38:14 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:15 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12.info" returned: 0 in 0.629s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:15 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Acquiring lock "cinder-quobyte-eb5780bf-55bd-4c98-9d31-d0ffa18a730b" by "_copy_volume_from_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:38:15 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Lock "cinder-quobyte-eb5780bf-55bd-4c98-9d31-d0ffa18a730b" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:38:15 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] snapshot: 3f55e11b-e16d-48c7-8564-56b77479bcbe, volume: eb5780bf-55bd-4c98-9d31-d0ffa18a730b, {{(pid=86964) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 04:38:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:38:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:38:15 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:38:15 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:38:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:38:15 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[c593c7c8-d60c-4c12-a831-6f2b7a4484fb]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:38:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12.3f55e11b-e16d-48c7-8564-56b77479bcbe {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:15 devstack sudo[100803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12.3f55e11b-e16d-48c7-8564-56b77479bcbe Jul 11 04:38:15 devstack sudo[100803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:16 devstack sudo[100803]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12.3f55e11b-e16d-48c7-8564-56b77479bcbe" returned: 0 in 0.733s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:16 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:38:16 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12 {{(pid=86964) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 04:38:16 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Creating direct copy from snapshot {{(pid=86964) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 04:38:16 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab30e7db-ea89-4010-93da-a090ca3f4d2d]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:38:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:16 devstack sudo[100809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12 Jul 11 04:38:16 devstack sudo[100809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:16 devstack sudo[100809]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12" returned: 0 in 0.735s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:16 devstack cinder-volume[86964]: DEBUG cinder.utils [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Path /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-eb5780bf-55bd-4c98-9d31-d0ffa18a730b not found in is_blk_device check {{(pid=86964) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 04:38:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-eb5780bf-55bd-4c98-9d31-d0ffa18a730b {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:16 devstack sudo[100814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-eb5780bf-55bd-4c98-9d31-d0ffa18a730b Jul 11 04:38:16 devstack sudo[100814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:21 devstack sudo[100814]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-eb5780bf-55bd-4c98-9d31-d0ffa18a730b" returned: 0 in 4.411s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:21 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a82ffca-12c5-4d1a-a1f3-31787e8a93a4]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:38:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:21 devstack sudo[100834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12 Jul 11 04:38:21 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:22 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12" returned: 0 in 0.926s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:22 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Image conversion details: src /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12, size 1024.00 MB, duration 4.41 sec, destination /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-eb5780bf-55bd-4c98-9d31-d0ffa18a730b {{(pid=86964) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 04:38:22 devstack cinder-volume[86964]: INFO cinder.image.image_utils [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Converted 1024.00 MB image at 232.09 MB/s Jul 11 04:38:22 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-eb5780bf-55bd-4c98-9d31-d0ffa18a730b is being set with open permissions: ugo+rw Jul 11 04:38:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-eb5780bf-55bd-4c98-9d31-d0ffa18a730b {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:22 devstack sudo[100839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-eb5780bf-55bd-4c98-9d31-d0ffa18a730b Jul 11 04:38:22 devstack sudo[100839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:22 devstack sudo[100839]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-eb5780bf-55bd-4c98-9d31-d0ffa18a730b" returned: 0 in 0.629s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:22 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Lock "cinder-quobyte-eb5780bf-55bd-4c98-9d31-d0ffa18a730b" released by "_copy_volume_from_snapshot" :: held 7.511s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:38:22 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Acquiring lock "cinder-quobyte-3f55e11b-e16d-48c7-8564-56b77479bcbe" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:38:22 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Lock "cinder-quobyte-3f55e11b-e16d-48c7-8564-56b77479bcbe" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:38:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Deleting offline snapshot 3f55e11b-e16d-48c7-8564-56b77479bcbe of volume 9f5cd45e-d1b2-44f9-8ba9-197472455f12 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:38:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] snapshot_file for this snap is: volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12.3f55e11b-e16d-48c7-8564-56b77479bcbe {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:38:23 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[68dcf97e-6531-46a1-938a-11ebf3bee580]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:38:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12.3f55e11b-e16d-48c7-8564-56b77479bcbe {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:23 devstack sudo[100842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12.3f55e11b-e16d-48c7-8564-56b77479bcbe Jul 11 04:38:23 devstack sudo[100842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:23 devstack sudo[100842]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12.3f55e11b-e16d-48c7-8564-56b77479bcbe" returned: 0 in 0.737s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:23 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:38:23 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[05eb303c-f6cc-453b-a766-c65a63edfb02]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:38:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:23 devstack sudo[100847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12 Jul 11 04:38:23 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:24 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:UPDATE=50,cinder:SELECT=43,cinder:DELETE=4,cinder:INSERT=9 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:38:24 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12" returned: 0 in 0.727s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12.3f55e11b-e16d-48c7-8564-56b77479bcbe {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:24 devstack sudo[100852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12.3f55e11b-e16d-48c7-8564-56b77479bcbe Jul 11 04:38:24 devstack sudo[100852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:25 devstack sudo[100852]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12.3f55e11b-e16d-48c7-8564-56b77479bcbe" returned: 0 in 0.720s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12.3f55e11b-e16d-48c7-8564-56b77479bcbe {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:25 devstack sudo[100857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12.3f55e11b-e16d-48c7-8564-56b77479bcbe Jul 11 04:38:25 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:25 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12.3f55e11b-e16d-48c7-8564-56b77479bcbe" returned: 0 in 0.630s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:25 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Lock "cinder-quobyte-3f55e11b-e16d-48c7-8564-56b77479bcbe" released by "_delete_snapshot" :: held 2.894s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:38:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.929s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:38:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ce520750-54af-475a-83ee-6bb027717a91 tempest-VolumesCloneNegativeTest-1298961692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.754s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:38:25 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ce520750-54af-475a-83ee-6bb027717a91 tempest-VolumesCloneNegativeTest-1298961692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-612032306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6b5cf30-6bbd-4c4f-ab8d-49e1fdf6782c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29e0f3d9019d477288eb27376eef6e3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:38:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:38:13Z,use_quota=True,user_id='4d39a5f1e50c448f86ddcd44cc0f2d0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:38:25 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-ce520750-54af-475a-83ee-6bb027717a91 tempest-VolumesCloneNegativeTest-1298961692 None] Creating volume d6b5cf30-6bbd-4c4f-ab8d-49e1fdf6782c {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:38:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ce520750-54af-475a-83ee-6bb027717a91 tempest-VolumesCloneNegativeTest-1298961692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:38:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ce520750-54af-475a-83ee-6bb027717a91 tempest-VolumesCloneNegativeTest-1298961692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:38:25 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ce520750-54af-475a-83ee-6bb027717a91 tempest-VolumesCloneNegativeTest-1298961692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:38:25 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ce520750-54af-475a-83ee-6bb027717a91 tempest-VolumesCloneNegativeTest-1298961692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:38:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ce520750-54af-475a-83ee-6bb027717a91 tempest-VolumesCloneNegativeTest-1298961692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:38:25 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ce520750-54af-475a-83ee-6bb027717a91 tempest-VolumesCloneNegativeTest-1298961692 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:38:25 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-ce520750-54af-475a-83ee-6bb027717a91 tempest-VolumesCloneNegativeTest-1298961692 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:38:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ce520750-54af-475a-83ee-6bb027717a91 tempest-VolumesCloneNegativeTest-1298961692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d6b5cf30-6bbd-4c4f-ab8d-49e1fdf6782c 2147483648 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:25 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc684004-95b8-4bdd-aee0-67a0c61563d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb5780bf-55bd-4c98-9d31-d0ffa18a730b', 'volume_size': 1, 'source_volid': '9f5cd45e-d1b2-44f9-8ba9-197472455f12', 'source_volstatus': 'available'}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:25 devstack sudo[100861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d6b5cf30-6bbd-4c4f-ab8d-49e1fdf6782c 2147483648 Jul 11 04:38:25 devstack sudo[100861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:25 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a38b3de9-6273-4b27-9076-97a28aa676bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:25 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Volume volume-eb5780bf-55bd-4c98-9d31-d0ffa18a730b (eb5780bf-55bd-4c98-9d31-d0ffa18a730b): created successfully Jul 11 04:38:25 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a38b3de9-6273-4b27-9076-97a28aa676bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:25 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Flow 'volume_create_manager' (330026ee-d3e9-4b9c-90c7-cf332193135a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:38:25 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-c0a9c227-1df8-48af-8947-ec998b4d1d59 tempest-VolumesGetTest-1221404998 None] Created volume successfully. Jul 11 04:38:26 devstack sudo[100861]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ce520750-54af-475a-83ee-6bb027717a91 tempest-VolumesCloneNegativeTest-1298961692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d6b5cf30-6bbd-4c4f-ab8d-49e1fdf6782c 2147483648" returned: 0 in 0.936s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ce520750-54af-475a-83ee-6bb027717a91 tempest-VolumesCloneNegativeTest-1298961692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d6b5cf30-6bbd-4c4f-ab8d-49e1fdf6782c {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:26 devstack sudo[100867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d6b5cf30-6bbd-4c4f-ab8d-49e1fdf6782c Jul 11 04:38:26 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:26 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-07ced4b0-c6b8-4c81-a02f-32abb0b664f5 tempest-VolumesGetTest-1221404998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:38:26 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-07ced4b0-c6b8-4c81-a02f-32abb0b664f5 tempest-VolumesGetTest-1221404998 None] Flow 'volume_create_manager' (cac520f1-2773-48cc-98fa-c2ae701e168b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:38:26 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-07ced4b0-c6b8-4c81-a02f-32abb0b664f5 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f2f5855-fe67-47a5-b0e4-1363a675d94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-07ced4b0-c6b8-4c81-a02f-32abb0b664f5 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f2f5855-fe67-47a5-b0e4-1363a675d94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:38:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2048858993',display_name='tempest-VolumesGetTest-Volume-1163933346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=435c0db8-3596-40cc-992e-4113005ac0f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8998b9f4cdb9498aa9a5e1476b63e03d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:38:27Z,use_quota=True,user_id='990c203db7fc4453a266794ad4d5b5c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-07ced4b0-c6b8-4c81-a02f-32abb0b664f5 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7097007b-64aa-4e46-b326-46537fc6e655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-07ced4b0-c6b8-4c81-a02f-32abb0b664f5 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7097007b-64aa-4e46-b326-46537fc6e655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-07ced4b0-c6b8-4c81-a02f-32abb0b664f5 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6a16fb2-dd43-4aed-bdb1-b718cd6765df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-07ced4b0-c6b8-4c81-a02f-32abb0b664f5 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6a16fb2-dd43-4aed-bdb1-b718cd6765df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '435c0db8-3596-40cc-992e-4113005ac0f0', 'volume_name': 'volume-435c0db8-3596-40cc-992e-4113005ac0f0', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-07ced4b0-c6b8-4c81-a02f-32abb0b664f5 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82ef0df8-32e3-45d9-88c9-d7c6f0c178c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-07ced4b0-c6b8-4c81-a02f-32abb0b664f5 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82ef0df8-32e3-45d9-88c9-d7c6f0c178c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-07ced4b0-c6b8-4c81-a02f-32abb0b664f5 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3003039b-9789-4c03-af3f-d2f719e4f9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:27 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-07ced4b0-c6b8-4c81-a02f-32abb0b664f5 tempest-VolumesGetTest-1221404998 None] Volume 435c0db8-3596-40cc-992e-4113005ac0f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-435c0db8-3596-40cc-992e-4113005ac0f0', 'volume_size': 1} Jul 11 04:38:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-07ced4b0-c6b8-4c81-a02f-32abb0b664f5 tempest-VolumesGetTest-1221404998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:38:27 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ce520750-54af-475a-83ee-6bb027717a91 tempest-VolumesCloneNegativeTest-1298961692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d6b5cf30-6bbd-4c4f-ab8d-49e1fdf6782c" returned: 0 in 0.647s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:27 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ce520750-54af-475a-83ee-6bb027717a91 tempest-VolumesCloneNegativeTest-1298961692 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:38:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ce520750-54af-475a-83ee-6bb027717a91 tempest-VolumesCloneNegativeTest-1298961692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:38:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-0e456ffd-3278-4855-9c21-fadb444be451 req-0727f6d4-e612-4b0f-9a94-12b7de3601f5 tempest-TestStampPattern-25865344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 14.088s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:38:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ce520750-54af-475a-83ee-6bb027717a91 tempest-VolumesCloneNegativeTest-1298961692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11ffcd7c-f3dd-4a14-8dd6-e37ea653d236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6b5cf30-6bbd-4c4f-ab8d-49e1fdf6782c', 'volume_size': 2}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ce520750-54af-475a-83ee-6bb027717a91 tempest-VolumesCloneNegativeTest-1298961692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51e39e43-fa36-4df2-a1bb-213b1a348953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:27 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6534386-6b09-4892-9f5d-5610e22ea118]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:38:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-0e456ffd-3278-4855-9c21-fadb444be451 req-0727f6d4-e612-4b0f-9a94-12b7de3601f5 tempest-TestStampPattern-25865344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:27 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-ce520750-54af-475a-83ee-6bb027717a91 tempest-VolumesCloneNegativeTest-1298961692 None] Volume volume-d6b5cf30-6bbd-4c4f-ab8d-49e1fdf6782c (d6b5cf30-6bbd-4c4f-ab8d-49e1fdf6782c): created successfully Jul 11 04:38:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ce520750-54af-475a-83ee-6bb027717a91 tempest-VolumesCloneNegativeTest-1298961692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51e39e43-fa36-4df2-a1bb-213b1a348953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ce520750-54af-475a-83ee-6bb027717a91 tempest-VolumesCloneNegativeTest-1298961692 None] Flow 'volume_create_manager' (9eeeb31f-a2c8-4265-b104-06627c18db9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:38:27 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-ce520750-54af-475a-83ee-6bb027717a91 tempest-VolumesCloneNegativeTest-1298961692 None] Created volume successfully. Jul 11 04:38:27 devstack sudo[100870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0 Jul 11 04:38:27 devstack sudo[100870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:28 devstack sudo[100870]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-0e456ffd-3278-4855-9c21-fadb444be451 req-0727f6d4-e612-4b0f-9a94-12b7de3601f5 tempest-TestStampPattern-25865344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0" returned: 0 in 0.726s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-0e456ffd-3278-4855-9c21-fadb444be451 req-0727f6d4-e612-4b0f-9a94-12b7de3601f5 tempest-TestStampPattern-25865344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.752s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:38:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-07ced4b0-c6b8-4c81-a02f-32abb0b664f5 tempest-VolumesGetTest-1221404998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.243s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:38:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-07ced4b0-c6b8-4c81-a02f-32abb0b664f5 tempest-VolumesGetTest-1221404998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:38:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2048858993',display_name='tempest-VolumesGetTest-Volume-1163933346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=435c0db8-3596-40cc-992e-4113005ac0f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8998b9f4cdb9498aa9a5e1476b63e03d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:38:27Z,use_quota=True,user_id='990c203db7fc4453a266794ad4d5b5c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:38:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-07ced4b0-c6b8-4c81-a02f-32abb0b664f5 tempest-VolumesGetTest-1221404998 None] Creating volume 435c0db8-3596-40cc-992e-4113005ac0f0 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:38:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-07ced4b0-c6b8-4c81-a02f-32abb0b664f5 tempest-VolumesGetTest-1221404998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:38:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-07ced4b0-c6b8-4c81-a02f-32abb0b664f5 tempest-VolumesGetTest-1221404998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:38:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-07ced4b0-c6b8-4c81-a02f-32abb0b664f5 tempest-VolumesGetTest-1221404998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:38:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-07ced4b0-c6b8-4c81-a02f-32abb0b664f5 tempest-VolumesGetTest-1221404998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:38:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-07ced4b0-c6b8-4c81-a02f-32abb0b664f5 tempest-VolumesGetTest-1221404998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:38:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-07ced4b0-c6b8-4c81-a02f-32abb0b664f5 tempest-VolumesGetTest-1221404998 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:38:28 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-07ced4b0-c6b8-4c81-a02f-32abb0b664f5 tempest-VolumesGetTest-1221404998 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:38:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-07ced4b0-c6b8-4c81-a02f-32abb0b664f5 tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-435c0db8-3596-40cc-992e-4113005ac0f0 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:28 devstack sudo[100875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-435c0db8-3596-40cc-992e-4113005ac0f0 1073741824 Jul 11 04:38:28 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-0e456ffd-3278-4855-9c21-fadb444be451 req-0727f6d4-e612-4b0f-9a94-12b7de3601f5 tempest-TestStampPattern-25865344 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95', 'name': 'volume-45f7be47-35fe-47b5-9b29-102708f56eb0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8898494a-95e2-4a41-ad14-b5e616b3df89', 'enforce_multipath': True} {{(pid=86964) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 04:38:28 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-0e456ffd-3278-4855-9c21-fadb444be451 req-0727f6d4-e612-4b0f-9a94-12b7de3601f5 tempest-TestStampPattern-25865344 None] attachment_update completed successfully. Jul 11 04:38:28 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-8c644c00-b02a-4bba-a323-a447af5799c0 tempest-VolumesCloneNegativeTest-1298961692 None] Acquiring lock "cinder-d6b5cf30-6bbd-4c4f-ab8d-49e1fdf6782c-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:38:28 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-8c644c00-b02a-4bba-a323-a447af5799c0 tempest-VolumesCloneNegativeTest-1298961692 None] Lock "cinder-d6b5cf30-6bbd-4c4f-ab8d-49e1fdf6782c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:38:28 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-8c644c00-b02a-4bba-a323-a447af5799c0 tempest-VolumesCloneNegativeTest-1298961692 None] Acquiring lock "cinder-quobyte-d6b5cf30-6bbd-4c4f-ab8d-49e1fdf6782c" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:38:28 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-8c644c00-b02a-4bba-a323-a447af5799c0 tempest-VolumesCloneNegativeTest-1298961692 None] Lock "cinder-quobyte-d6b5cf30-6bbd-4c4f-ab8d-49e1fdf6782c" acquired by "delete_volume" :: waited 0.019s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:38:28 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[8626a54e-8987-4df1-a852-49400f4ee379]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:38:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8c644c00-b02a-4bba-a323-a447af5799c0 tempest-VolumesCloneNegativeTest-1298961692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d6b5cf30-6bbd-4c4f-ab8d-49e1fdf6782c {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:28 devstack sudo[100944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d6b5cf30-6bbd-4c4f-ab8d-49e1fdf6782c Jul 11 04:38:28 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:29 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-07ced4b0-c6b8-4c81-a02f-32abb0b664f5 tempest-VolumesGetTest-1221404998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-435c0db8-3596-40cc-992e-4113005ac0f0 1073741824" returned: 0 in 0.928s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-07ced4b0-c6b8-4c81-a02f-32abb0b664f5 tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-435c0db8-3596-40cc-992e-4113005ac0f0 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:29 devstack sudo[100949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-435c0db8-3596-40cc-992e-4113005ac0f0 Jul 11 04:38:29 devstack sudo[100949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:29 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8c644c00-b02a-4bba-a323-a447af5799c0 tempest-VolumesCloneNegativeTest-1298961692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d6b5cf30-6bbd-4c4f-ab8d-49e1fdf6782c" returned: 0 in 0.814s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8c644c00-b02a-4bba-a323-a447af5799c0 tempest-VolumesCloneNegativeTest-1298961692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d6b5cf30-6bbd-4c4f-ab8d-49e1fdf6782c {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:29 devstack sudo[101270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d6b5cf30-6bbd-4c4f-ab8d-49e1fdf6782c Jul 11 04:38:29 devstack sudo[101270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:29 devstack sudo[100949]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-07ced4b0-c6b8-4c81-a02f-32abb0b664f5 tempest-VolumesGetTest-1221404998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-435c0db8-3596-40cc-992e-4113005ac0f0" returned: 0 in 0.667s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:29 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-07ced4b0-c6b8-4c81-a02f-32abb0b664f5 tempest-VolumesGetTest-1221404998 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:38:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-07ced4b0-c6b8-4c81-a02f-32abb0b664f5 tempest-VolumesGetTest-1221404998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:38:29 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-07ced4b0-c6b8-4c81-a02f-32abb0b664f5 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3003039b-9789-4c03-af3f-d2f719e4f9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-435c0db8-3596-40cc-992e-4113005ac0f0', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:29 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-07ced4b0-c6b8-4c81-a02f-32abb0b664f5 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d62ed89-7f3d-40b0-9918-4e4f5fa4f579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:29 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-07ced4b0-c6b8-4c81-a02f-32abb0b664f5 tempest-VolumesGetTest-1221404998 None] Volume volume-435c0db8-3596-40cc-992e-4113005ac0f0 (435c0db8-3596-40cc-992e-4113005ac0f0): created successfully Jul 11 04:38:29 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-07ced4b0-c6b8-4c81-a02f-32abb0b664f5 tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d62ed89-7f3d-40b0-9918-4e4f5fa4f579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:29 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-07ced4b0-c6b8-4c81-a02f-32abb0b664f5 tempest-VolumesGetTest-1221404998 None] Flow 'volume_create_manager' (cac520f1-2773-48cc-98fa-c2ae701e168b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:38:29 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-07ced4b0-c6b8-4c81-a02f-32abb0b664f5 tempest-VolumesGetTest-1221404998 None] Created volume successfully. Jul 11 04:38:30 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-43da34aa-3f95-4269-a445-509e908e1a1c tempest-VolumesGetTest-1221404998 None] Acquiring lock "cinder-435c0db8-3596-40cc-992e-4113005ac0f0-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:38:30 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-43da34aa-3f95-4269-a445-509e908e1a1c tempest-VolumesGetTest-1221404998 None] Lock "cinder-435c0db8-3596-40cc-992e-4113005ac0f0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:38:30 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-43da34aa-3f95-4269-a445-509e908e1a1c tempest-VolumesGetTest-1221404998 None] Acquiring lock "cinder-quobyte-435c0db8-3596-40cc-992e-4113005ac0f0" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:38:30 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-43da34aa-3f95-4269-a445-509e908e1a1c tempest-VolumesGetTest-1221404998 None] Lock "cinder-quobyte-435c0db8-3596-40cc-992e-4113005ac0f0" acquired by "delete_volume" :: waited 0.013s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:38:30 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[3655c27b-69b3-48d6-a352-1b5c42ab1bcb]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:38:30 devstack sudo[101270]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-43da34aa-3f95-4269-a445-509e908e1a1c tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-435c0db8-3596-40cc-992e-4113005ac0f0 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8c644c00-b02a-4bba-a323-a447af5799c0 tempest-VolumesCloneNegativeTest-1298961692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d6b5cf30-6bbd-4c4f-ab8d-49e1fdf6782c" returned: 0 in 0.709s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:30 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-8c644c00-b02a-4bba-a323-a447af5799c0 tempest-VolumesCloneNegativeTest-1298961692 None] Lock "cinder-quobyte-d6b5cf30-6bbd-4c4f-ab8d-49e1fdf6782c" released by "delete_volume" :: held 1.567s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:38:30 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-8c644c00-b02a-4bba-a323-a447af5799c0 tempest-VolumesCloneNegativeTest-1298961692 None] Created reservations ['51c346a3-7319-4a48-96e9-8f81fc0c299e', '93c45d93-84b3-4671-bbc4-2b8b1afd3c99', '0cbeb66c-0a89-4083-a721-f90c21b32512', '677e661f-fa08-43c2-a614-ae2ae7d5642e'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:38:30 devstack sudo[101274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-435c0db8-3596-40cc-992e-4113005ac0f0 Jul 11 04:38:30 devstack sudo[101274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-8c644c00-b02a-4bba-a323-a447af5799c0 tempest-VolumesCloneNegativeTest-1298961692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:38:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-8c644c00-b02a-4bba-a323-a447af5799c0 tempest-VolumesCloneNegativeTest-1298961692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:38:30 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-8c644c00-b02a-4bba-a323-a447af5799c0 tempest-VolumesCloneNegativeTest-1298961692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:38:30 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-8c644c00-b02a-4bba-a323-a447af5799c0 tempest-VolumesCloneNegativeTest-1298961692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:38:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-8c644c00-b02a-4bba-a323-a447af5799c0 tempest-VolumesCloneNegativeTest-1298961692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:38:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8c644c00-b02a-4bba-a323-a447af5799c0 tempest-VolumesCloneNegativeTest-1298961692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:30 devstack sudo[101276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:38:30 devstack sudo[101276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:31 devstack sudo[101276]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8c644c00-b02a-4bba-a323-a447af5799c0 tempest-VolumesCloneNegativeTest-1298961692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.648s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:31 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-8c644c00-b02a-4bba-a323-a447af5799c0 tempest-VolumesCloneNegativeTest-1298961692 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:38:31 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-8c644c00-b02a-4bba-a323-a447af5799c0 tempest-VolumesCloneNegativeTest-1298961692 None] Deleted volume successfully. Jul 11 04:38:31 devstack sudo[101274]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-43da34aa-3f95-4269-a445-509e908e1a1c tempest-VolumesGetTest-1221404998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-435c0db8-3596-40cc-992e-4113005ac0f0" returned: 0 in 0.819s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-43da34aa-3f95-4269-a445-509e908e1a1c tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-435c0db8-3596-40cc-992e-4113005ac0f0 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:31 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-8c644c00-b02a-4bba-a323-a447af5799c0 tempest-VolumesCloneNegativeTest-1298961692 None] Lock "cinder-d6b5cf30-6bbd-4c4f-ab8d-49e1fdf6782c-delete_volume" released by "delete_volume" :: held 2.461s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:38:31 devstack sudo[101283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-435c0db8-3596-40cc-992e-4113005ac0f0 Jul 11 04:38:31 devstack sudo[101283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:31 devstack sudo[101283]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-43da34aa-3f95-4269-a445-509e908e1a1c tempest-VolumesGetTest-1221404998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-435c0db8-3596-40cc-992e-4113005ac0f0" returned: 0 in 0.701s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:31 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-43da34aa-3f95-4269-a445-509e908e1a1c tempest-VolumesGetTest-1221404998 None] Lock "cinder-quobyte-435c0db8-3596-40cc-992e-4113005ac0f0" released by "delete_volume" :: held 1.561s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:38:31 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-43da34aa-3f95-4269-a445-509e908e1a1c tempest-VolumesGetTest-1221404998 None] Created reservations ['e13c932e-7213-4d0e-9d25-0d3e362a3a81', '7eb67fa4-63b7-4ad2-aace-fcbf24c5da1e', '14d63559-1ae5-493a-8d57-3e45a2d5fe4c', '190268b1-ef1c-48dd-a49e-12cfa2ea9d76'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:38:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-43da34aa-3f95-4269-a445-509e908e1a1c tempest-VolumesGetTest-1221404998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:38:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-43da34aa-3f95-4269-a445-509e908e1a1c tempest-VolumesGetTest-1221404998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:38:31 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-43da34aa-3f95-4269-a445-509e908e1a1c tempest-VolumesGetTest-1221404998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:38:32 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-43da34aa-3f95-4269-a445-509e908e1a1c tempest-VolumesGetTest-1221404998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:38:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-43da34aa-3f95-4269-a445-509e908e1a1c tempest-VolumesGetTest-1221404998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:38:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-43da34aa-3f95-4269-a445-509e908e1a1c tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:32 devstack sudo[101286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:38:32 devstack sudo[101286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:32 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4042d866-6012-46e8-8e69-4527480aabb6 tempest-VolumesGetTest-1221404998 None] Acquiring lock "cinder-eb5780bf-55bd-4c98-9d31-d0ffa18a730b-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:38:32 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4042d866-6012-46e8-8e69-4527480aabb6 tempest-VolumesGetTest-1221404998 None] Lock "cinder-eb5780bf-55bd-4c98-9d31-d0ffa18a730b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:38:32 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4042d866-6012-46e8-8e69-4527480aabb6 tempest-VolumesGetTest-1221404998 None] Acquiring lock "cinder-quobyte-eb5780bf-55bd-4c98-9d31-d0ffa18a730b" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:38:32 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4042d866-6012-46e8-8e69-4527480aabb6 tempest-VolumesGetTest-1221404998 None] Lock "cinder-quobyte-eb5780bf-55bd-4c98-9d31-d0ffa18a730b" acquired by "delete_volume" :: waited 0.024s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:38:32 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8a76fc-b708-4d57-8fb8-3541ba18543a]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:38:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4042d866-6012-46e8-8e69-4527480aabb6 tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-eb5780bf-55bd-4c98-9d31-d0ffa18a730b {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:32 devstack sudo[101286]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-43da34aa-3f95-4269-a445-509e908e1a1c tempest-VolumesGetTest-1221404998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.829s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:32 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-43da34aa-3f95-4269-a445-509e908e1a1c tempest-VolumesGetTest-1221404998 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:38:32 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-43da34aa-3f95-4269-a445-509e908e1a1c tempest-VolumesGetTest-1221404998 None] Deleted volume successfully. Jul 11 04:38:32 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-43da34aa-3f95-4269-a445-509e908e1a1c tempest-VolumesGetTest-1221404998 None] Lock "cinder-435c0db8-3596-40cc-992e-4113005ac0f0-delete_volume" released by "delete_volume" :: held 2.633s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:38:32 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-eb5780bf-55bd-4c98-9d31-d0ffa18a730b Jul 11 04:38:32 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:33 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4042d866-6012-46e8-8e69-4527480aabb6 tempest-VolumesGetTest-1221404998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-eb5780bf-55bd-4c98-9d31-d0ffa18a730b" returned: 0 in 0.861s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4042d866-6012-46e8-8e69-4527480aabb6 tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-eb5780bf-55bd-4c98-9d31-d0ffa18a730b {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:33 devstack sudo[101306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-eb5780bf-55bd-4c98-9d31-d0ffa18a730b Jul 11 04:38:33 devstack sudo[101306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:34 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-006b6d07-3803-4628-b889-ef245348a279 tempest-VolumesListTestJSON-471253850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:38:34 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-006b6d07-3803-4628-b889-ef245348a279 tempest-VolumesListTestJSON-471253850 None] Flow 'volume_create_manager' (cf3653f0-7d3e-4f08-929c-f2b3e03aad8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:38:34 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-006b6d07-3803-4628-b889-ef245348a279 tempest-VolumesListTestJSON-471253850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdb9cd11-5a21-4f07-8927-99a7afe3c642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:34 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-006b6d07-3803-4628-b889-ef245348a279 tempest-VolumesListTestJSON-471253850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdb9cd11-5a21-4f07-8927-99a7afe3c642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2098456000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcfa1698-f34e-4120-afb4-41b58d13f2d0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9259d1019d9348dda1808fe68dbd581a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:38:34Z,use_quota=True,user_id='33b69efb5cd34ed5af01735fa31dabed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:34 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-006b6d07-3803-4628-b889-ef245348a279 tempest-VolumesListTestJSON-471253850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e960cf-3091-4825-a27b-0e661048f1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:34 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-006b6d07-3803-4628-b889-ef245348a279 tempest-VolumesListTestJSON-471253850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e960cf-3091-4825-a27b-0e661048f1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:34 devstack sudo[101306]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:34 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-006b6d07-3803-4628-b889-ef245348a279 tempest-VolumesListTestJSON-471253850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08d762ae-063a-4e83-b014-42f5c5a3d504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:34 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-006b6d07-3803-4628-b889-ef245348a279 tempest-VolumesListTestJSON-471253850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08d762ae-063a-4e83-b014-42f5c5a3d504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcfa1698-f34e-4120-afb4-41b58d13f2d0', 'volume_name': 'volume-fcfa1698-f34e-4120-afb4-41b58d13f2d0', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:34 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-006b6d07-3803-4628-b889-ef245348a279 tempest-VolumesListTestJSON-471253850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36a93ce1-34e9-458b-a4c7-792ca83bbe5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:34 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-006b6d07-3803-4628-b889-ef245348a279 tempest-VolumesListTestJSON-471253850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36a93ce1-34e9-458b-a4c7-792ca83bbe5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:34 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-006b6d07-3803-4628-b889-ef245348a279 tempest-VolumesListTestJSON-471253850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d101651d-94fa-48f5-950b-1dd5d8590e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:34 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-006b6d07-3803-4628-b889-ef245348a279 tempest-VolumesListTestJSON-471253850 None] Volume fcfa1698-f34e-4120-afb4-41b58d13f2d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcfa1698-f34e-4120-afb4-41b58d13f2d0', 'volume_size': 1} Jul 11 04:38:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-006b6d07-3803-4628-b889-ef245348a279 tempest-VolumesListTestJSON-471253850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:38:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-006b6d07-3803-4628-b889-ef245348a279 tempest-VolumesListTestJSON-471253850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:38:34 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-006b6d07-3803-4628-b889-ef245348a279 tempest-VolumesListTestJSON-471253850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2098456000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcfa1698-f34e-4120-afb4-41b58d13f2d0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9259d1019d9348dda1808fe68dbd581a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:38:34Z,use_quota=True,user_id='33b69efb5cd34ed5af01735fa31dabed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:38:34 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-006b6d07-3803-4628-b889-ef245348a279 tempest-VolumesListTestJSON-471253850 None] Creating volume fcfa1698-f34e-4120-afb4-41b58d13f2d0 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:38:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-006b6d07-3803-4628-b889-ef245348a279 tempest-VolumesListTestJSON-471253850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:38:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-006b6d07-3803-4628-b889-ef245348a279 tempest-VolumesListTestJSON-471253850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:38:34 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-006b6d07-3803-4628-b889-ef245348a279 tempest-VolumesListTestJSON-471253850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:38:34 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-006b6d07-3803-4628-b889-ef245348a279 tempest-VolumesListTestJSON-471253850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:38:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-006b6d07-3803-4628-b889-ef245348a279 tempest-VolumesListTestJSON-471253850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:38:34 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-006b6d07-3803-4628-b889-ef245348a279 tempest-VolumesListTestJSON-471253850 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:38:34 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-006b6d07-3803-4628-b889-ef245348a279 tempest-VolumesListTestJSON-471253850 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:38:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-006b6d07-3803-4628-b889-ef245348a279 tempest-VolumesListTestJSON-471253850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fcfa1698-f34e-4120-afb4-41b58d13f2d0 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4042d866-6012-46e8-8e69-4527480aabb6 tempest-VolumesGetTest-1221404998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-eb5780bf-55bd-4c98-9d31-d0ffa18a730b" returned: 0 in 0.727s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:34 devstack sudo[101309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fcfa1698-f34e-4120-afb4-41b58d13f2d0 1073741824 Jul 11 04:38:34 devstack sudo[101309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4042d866-6012-46e8-8e69-4527480aabb6 tempest-VolumesGetTest-1221404998 None] Lock "cinder-quobyte-eb5780bf-55bd-4c98-9d31-d0ffa18a730b" released by "delete_volume" :: held 1.656s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:38:34 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-4042d866-6012-46e8-8e69-4527480aabb6 tempest-VolumesGetTest-1221404998 None] Created reservations ['e58e36b0-9e30-420f-8825-c05fcf6689ea', 'de2e36bb-70c4-47ff-bd42-681d4d7d749d', '2c5f751b-020b-4a14-8d1c-b172118e5462', '6a1e8ea2-0b52-4964-939c-fb71df278481'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:38:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4042d866-6012-46e8-8e69-4527480aabb6 tempest-VolumesGetTest-1221404998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:38:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4042d866-6012-46e8-8e69-4527480aabb6 tempest-VolumesGetTest-1221404998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:38:34 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4042d866-6012-46e8-8e69-4527480aabb6 tempest-VolumesGetTest-1221404998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:38:34 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4042d866-6012-46e8-8e69-4527480aabb6 tempest-VolumesGetTest-1221404998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:38:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4042d866-6012-46e8-8e69-4527480aabb6 tempest-VolumesGetTest-1221404998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:38:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4042d866-6012-46e8-8e69-4527480aabb6 tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:34 devstack sudo[101311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:38:34 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-7c7dcfc6-e231-4f89-9d49-fe1fd9ac20f0 tempest-VolumesGetTest-1221404998 None] Acquiring lock "cinder-9f5cd45e-d1b2-44f9-8ba9-197472455f12-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:38:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-7c7dcfc6-e231-4f89-9d49-fe1fd9ac20f0 tempest-VolumesGetTest-1221404998 None] Lock "cinder-9f5cd45e-d1b2-44f9-8ba9-197472455f12-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:38:35 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-7c7dcfc6-e231-4f89-9d49-fe1fd9ac20f0 tempest-VolumesGetTest-1221404998 None] Acquiring lock "cinder-quobyte-9f5cd45e-d1b2-44f9-8ba9-197472455f12" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:38:35 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-7c7dcfc6-e231-4f89-9d49-fe1fd9ac20f0 tempest-VolumesGetTest-1221404998 None] Lock "cinder-quobyte-9f5cd45e-d1b2-44f9-8ba9-197472455f12" acquired by "delete_volume" :: waited 0.022s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:38:35 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[734affd6-4e20-4139-a632-767cb8ae2707]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:38:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7c7dcfc6-e231-4f89-9d49-fe1fd9ac20f0 tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:35 devstack sudo[101322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12 Jul 11 04:38:35 devstack sudo[101322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:35 devstack sudo[101309]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:35 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-006b6d07-3803-4628-b889-ef245348a279 tempest-VolumesListTestJSON-471253850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fcfa1698-f34e-4120-afb4-41b58d13f2d0 1073741824" returned: 0 in 1.004s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4042d866-6012-46e8-8e69-4527480aabb6 tempest-VolumesGetTest-1221404998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.832s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:35 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-4042d866-6012-46e8-8e69-4527480aabb6 tempest-VolumesGetTest-1221404998 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:38:35 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-4042d866-6012-46e8-8e69-4527480aabb6 tempest-VolumesGetTest-1221404998 None] Deleted volume successfully. Jul 11 04:38:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-006b6d07-3803-4628-b889-ef245348a279 tempest-VolumesListTestJSON-471253850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fcfa1698-f34e-4120-afb4-41b58d13f2d0 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:35 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4042d866-6012-46e8-8e69-4527480aabb6 tempest-VolumesGetTest-1221404998 None] Lock "cinder-eb5780bf-55bd-4c98-9d31-d0ffa18a730b-delete_volume" released by "delete_volume" :: held 2.807s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:38:35 devstack sudo[101329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fcfa1698-f34e-4120-afb4-41b58d13f2d0 Jul 11 04:38:35 devstack sudo[101329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:36 devstack sudo[101322]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7c7dcfc6-e231-4f89-9d49-fe1fd9ac20f0 tempest-VolumesGetTest-1221404998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12" returned: 0 in 0.893s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7c7dcfc6-e231-4f89-9d49-fe1fd9ac20f0 tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:36 devstack sudo[101336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12 Jul 11 04:38:36 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:36 devstack sudo[101329]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-006b6d07-3803-4628-b889-ef245348a279 tempest-VolumesListTestJSON-471253850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fcfa1698-f34e-4120-afb4-41b58d13f2d0" returned: 0 in 0.709s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-006b6d07-3803-4628-b889-ef245348a279 tempest-VolumesListTestJSON-471253850 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:38:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-006b6d07-3803-4628-b889-ef245348a279 tempest-VolumesListTestJSON-471253850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.780s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:38:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-006b6d07-3803-4628-b889-ef245348a279 tempest-VolumesListTestJSON-471253850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d101651d-94fa-48f5-950b-1dd5d8590e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcfa1698-f34e-4120-afb4-41b58d13f2d0', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-006b6d07-3803-4628-b889-ef245348a279 tempest-VolumesListTestJSON-471253850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af5391a9-5d4f-4843-a8b3-9c8d18f2986a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:36 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-006b6d07-3803-4628-b889-ef245348a279 tempest-VolumesListTestJSON-471253850 None] Volume volume-fcfa1698-f34e-4120-afb4-41b58d13f2d0 (fcfa1698-f34e-4120-afb4-41b58d13f2d0): created successfully Jul 11 04:38:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-006b6d07-3803-4628-b889-ef245348a279 tempest-VolumesListTestJSON-471253850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af5391a9-5d4f-4843-a8b3-9c8d18f2986a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-006b6d07-3803-4628-b889-ef245348a279 tempest-VolumesListTestJSON-471253850 None] Flow 'volume_create_manager' (cf3653f0-7d3e-4f08-929c-f2b3e03aad8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:38:36 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-006b6d07-3803-4628-b889-ef245348a279 tempest-VolumesListTestJSON-471253850 None] Created volume successfully. Jul 11 04:38:36 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7c7dcfc6-e231-4f89-9d49-fe1fd9ac20f0 tempest-VolumesGetTest-1221404998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9f5cd45e-d1b2-44f9-8ba9-197472455f12" returned: 0 in 0.660s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:36 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-7c7dcfc6-e231-4f89-9d49-fe1fd9ac20f0 tempest-VolumesGetTest-1221404998 None] Lock "cinder-quobyte-9f5cd45e-d1b2-44f9-8ba9-197472455f12" released by "delete_volume" :: held 1.632s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:38:36 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-7c7dcfc6-e231-4f89-9d49-fe1fd9ac20f0 tempest-VolumesGetTest-1221404998 None] Created reservations ['eb734e7b-1a15-4e32-b727-2332d99aec9c', 'a5a5e41e-c6e9-41b5-828b-c1c93322c518', '41f8bd0f-544d-4775-89ac-9bee8eda9640', 'e22f6880-e72f-4e24-bd56-1f8f895f95be'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:38:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7c7dcfc6-e231-4f89-9d49-fe1fd9ac20f0 tempest-VolumesGetTest-1221404998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:38:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7c7dcfc6-e231-4f89-9d49-fe1fd9ac20f0 tempest-VolumesGetTest-1221404998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:38:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7c7dcfc6-e231-4f89-9d49-fe1fd9ac20f0 tempest-VolumesGetTest-1221404998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:38:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7c7dcfc6-e231-4f89-9d49-fe1fd9ac20f0 tempest-VolumesGetTest-1221404998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:38:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7c7dcfc6-e231-4f89-9d49-fe1fd9ac20f0 tempest-VolumesGetTest-1221404998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:38:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7c7dcfc6-e231-4f89-9d49-fe1fd9ac20f0 tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:36 devstack sudo[101341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:38:36 devstack sudo[101341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:36 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbb36fe6-2513-4b9e-8bc8-e8009069275e tempest-VolumesListTestJSON-471253850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:38:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fbb36fe6-2513-4b9e-8bc8-e8009069275e tempest-VolumesListTestJSON-471253850 None] Flow 'volume_create_manager' (aa61e667-2e69-4985-a93b-de06842e1ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:38:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fbb36fe6-2513-4b9e-8bc8-e8009069275e tempest-VolumesListTestJSON-471253850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f36c11da-9345-4cf9-8235-c3a492d80154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fbb36fe6-2513-4b9e-8bc8-e8009069275e tempest-VolumesListTestJSON-471253850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f36c11da-9345-4cf9-8235-c3a492d80154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-757875611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d169985b-0f8f-45ba-9ea7-261f2b5f4dbd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9259d1019d9348dda1808fe68dbd581a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:38:37Z,use_quota=True,user_id='33b69efb5cd34ed5af01735fa31dabed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fbb36fe6-2513-4b9e-8bc8-e8009069275e tempest-VolumesListTestJSON-471253850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (607d283d-2aee-4def-b168-ab2763beecb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fbb36fe6-2513-4b9e-8bc8-e8009069275e tempest-VolumesListTestJSON-471253850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (607d283d-2aee-4def-b168-ab2763beecb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fbb36fe6-2513-4b9e-8bc8-e8009069275e tempest-VolumesListTestJSON-471253850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46fd3fda-2153-4e1c-898a-903f2277f8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fbb36fe6-2513-4b9e-8bc8-e8009069275e tempest-VolumesListTestJSON-471253850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46fd3fda-2153-4e1c-898a-903f2277f8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd169985b-0f8f-45ba-9ea7-261f2b5f4dbd', 'volume_name': 'volume-d169985b-0f8f-45ba-9ea7-261f2b5f4dbd', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fbb36fe6-2513-4b9e-8bc8-e8009069275e tempest-VolumesListTestJSON-471253850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e7237ba-8b08-4e16-b1d5-651c84cbd65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fbb36fe6-2513-4b9e-8bc8-e8009069275e tempest-VolumesListTestJSON-471253850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e7237ba-8b08-4e16-b1d5-651c84cbd65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fbb36fe6-2513-4b9e-8bc8-e8009069275e tempest-VolumesListTestJSON-471253850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a212b6f-573a-4277-ac00-c98859cbf8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:36 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-fbb36fe6-2513-4b9e-8bc8-e8009069275e tempest-VolumesListTestJSON-471253850 None] Volume d169985b-0f8f-45ba-9ea7-261f2b5f4dbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d169985b-0f8f-45ba-9ea7-261f2b5f4dbd', 'volume_size': 1} Jul 11 04:38:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fbb36fe6-2513-4b9e-8bc8-e8009069275e tempest-VolumesListTestJSON-471253850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:38:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fbb36fe6-2513-4b9e-8bc8-e8009069275e tempest-VolumesListTestJSON-471253850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:38:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-fbb36fe6-2513-4b9e-8bc8-e8009069275e tempest-VolumesListTestJSON-471253850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-757875611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d169985b-0f8f-45ba-9ea7-261f2b5f4dbd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9259d1019d9348dda1808fe68dbd581a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:38:37Z,use_quota=True,user_id='33b69efb5cd34ed5af01735fa31dabed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:38:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-fbb36fe6-2513-4b9e-8bc8-e8009069275e tempest-VolumesListTestJSON-471253850 None] Creating volume d169985b-0f8f-45ba-9ea7-261f2b5f4dbd {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:38:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fbb36fe6-2513-4b9e-8bc8-e8009069275e tempest-VolumesListTestJSON-471253850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:38:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fbb36fe6-2513-4b9e-8bc8-e8009069275e tempest-VolumesListTestJSON-471253850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:38:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-fbb36fe6-2513-4b9e-8bc8-e8009069275e tempest-VolumesListTestJSON-471253850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:38:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-fbb36fe6-2513-4b9e-8bc8-e8009069275e tempest-VolumesListTestJSON-471253850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:38:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fbb36fe6-2513-4b9e-8bc8-e8009069275e tempest-VolumesListTestJSON-471253850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:38:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-fbb36fe6-2513-4b9e-8bc8-e8009069275e tempest-VolumesListTestJSON-471253850 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:38:36 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-fbb36fe6-2513-4b9e-8bc8-e8009069275e tempest-VolumesListTestJSON-471253850 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:38:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fbb36fe6-2513-4b9e-8bc8-e8009069275e tempest-VolumesListTestJSON-471253850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d169985b-0f8f-45ba-9ea7-261f2b5f4dbd 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:37 devstack sudo[101352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d169985b-0f8f-45ba-9ea7-261f2b5f4dbd 1073741824 Jul 11 04:38:37 devstack sudo[101352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:37 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-5108d149-9bf4-43fe-9d9a-e4928b89dda8 req-42698a93-8f62-4175-9bae-6df06ad89c70 tempest-TestStampPattern-25865344 None] Terminate volume connection completed successfully. Jul 11 04:38:37 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-5108d149-9bf4-43fe-9d9a-e4928b89dda8 req-42698a93-8f62-4175-9bae-6df06ad89c70 tempest-TestStampPattern-25865344 None] Deleting attachment 8898494a-95e2-4a41-ad14-b5e616b3df89. {{(pid=86964) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 04:38:37 devstack sudo[101341]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7c7dcfc6-e231-4f89-9d49-fe1fd9ac20f0 tempest-VolumesGetTest-1221404998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.714s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:37 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-7c7dcfc6-e231-4f89-9d49-fe1fd9ac20f0 tempest-VolumesGetTest-1221404998 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:38:37 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-7c7dcfc6-e231-4f89-9d49-fe1fd9ac20f0 tempest-VolumesGetTest-1221404998 None] Deleted volume successfully. Jul 11 04:38:37 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-7c7dcfc6-e231-4f89-9d49-fe1fd9ac20f0 tempest-VolumesGetTest-1221404998 None] Lock "cinder-9f5cd45e-d1b2-44f9-8ba9-197472455f12-delete_volume" released by "delete_volume" :: held 2.632s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:38:37 devstack sudo[101352]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fbb36fe6-2513-4b9e-8bc8-e8009069275e tempest-VolumesListTestJSON-471253850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d169985b-0f8f-45ba-9ea7-261f2b5f4dbd 1073741824" returned: 0 in 0.952s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fbb36fe6-2513-4b9e-8bc8-e8009069275e tempest-VolumesListTestJSON-471253850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d169985b-0f8f-45ba-9ea7-261f2b5f4dbd {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:37 devstack sudo[101377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d169985b-0f8f-45ba-9ea7-261f2b5f4dbd Jul 11 04:38:38 devstack sudo[101377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:38 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:38:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Flow 'volume_create_manager' (bae82730-7dcd-48a6-98f0-3583dbb8987d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:38:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff2ab3a2-879a-460c-9d18-d4b19b0fc0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff2ab3a2-879a-460c-9d18-d4b19b0fc0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-469859088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d281491f-d8f7-4056-886b-1504b6daee59,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8998b9f4cdb9498aa9a5e1476b63e03d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:38:38Z,use_quota=True,user_id='990c203db7fc4453a266794ad4d5b5c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c3436f-458c-4ecc-9452-c19a3fed9be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c3436f-458c-4ecc-9452-c19a3fed9be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c270086-7422-4a11-94f9-f765d9cf62f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:38 devstack cinder-volume[86964]: DEBUG cinder.image.glance [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Creating Keystone auth plugin from conf {{(pid=86964) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 04:38:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c270086-7422-4a11-94f9-f765d9cf62f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd281491f-d8f7-4056-886b-1504b6daee59', 'volume_name': 'volume-d281491f-d8f7-4056-886b-1504b6daee59', 'volume_size': 1, 'image_id': 'a34636df-e58a-4a3a-9b16-7e804af976d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a34636df-e58a-4a3a-9b16-7e804af976d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ffa684dc47340c1a363723e49759fc3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a34636df-e58a-4a3a-9b16-7e804af976d8', 'created_at': datetime.datetime(2026, 7, 11, 2, 18, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 18, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a34636df-e58a-4a3a-9b16-7e804af976d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a69f6a49-8c98-4b8e-8a51-a2d9a22fa5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a69f6a49-8c98-4b8e-8a51-a2d9a22fa5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (295ade4b-19fb-4da0-93b9-8a451ff6cd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:38 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Volume d281491f-d8f7-4056-886b-1504b6daee59: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d281491f-d8f7-4056-886b-1504b6daee59', 'volume_size': 1, 'image_id': 'a34636df-e58a-4a3a-9b16-7e804af976d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a34636df-e58a-4a3a-9b16-7e804af976d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ffa684dc47340c1a363723e49759fc3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a34636df-e58a-4a3a-9b16-7e804af976d8', 'created_at': datetime.datetime(2026, 7, 11, 2, 18, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 18, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a34636df-e58a-4a3a-9b16-7e804af976d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 11 04:38:38 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Trying to clone d281491f-d8f7-4056-886b-1504b6daee59 from image a34636df-e58a-4a3a-9b16-7e804af976d8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a34636df-e58a-4a3a-9b16-7e804af976d8', 'metadata': {}}]). {{(pid=86964) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 04:38:38 devstack sudo[101377]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fbb36fe6-2513-4b9e-8bc8-e8009069275e tempest-VolumesListTestJSON-471253850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d169985b-0f8f-45ba-9ea7-261f2b5f4dbd" returned: 0 in 0.690s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:38 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-fbb36fe6-2513-4b9e-8bc8-e8009069275e tempest-VolumesListTestJSON-471253850 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:38:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fbb36fe6-2513-4b9e-8bc8-e8009069275e tempest-VolumesListTestJSON-471253850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:38:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fbb36fe6-2513-4b9e-8bc8-e8009069275e tempest-VolumesListTestJSON-471253850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a212b6f-573a-4277-ac00-c98859cbf8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d169985b-0f8f-45ba-9ea7-261f2b5f4dbd', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fbb36fe6-2513-4b9e-8bc8-e8009069275e tempest-VolumesListTestJSON-471253850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ba98e7f-5597-4145-abc4-6d2a66728253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:38 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-fbb36fe6-2513-4b9e-8bc8-e8009069275e tempest-VolumesListTestJSON-471253850 None] Volume volume-d169985b-0f8f-45ba-9ea7-261f2b5f4dbd (d169985b-0f8f-45ba-9ea7-261f2b5f4dbd): created successfully Jul 11 04:38:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fbb36fe6-2513-4b9e-8bc8-e8009069275e tempest-VolumesListTestJSON-471253850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ba98e7f-5597-4145-abc4-6d2a66728253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fbb36fe6-2513-4b9e-8bc8-e8009069275e tempest-VolumesListTestJSON-471253850 None] Flow 'volume_create_manager' (aa61e667-2e69-4985-a93b-de06842e1ffa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:38:38 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-fbb36fe6-2513-4b9e-8bc8-e8009069275e tempest-VolumesListTestJSON-471253850 None] Created volume successfully. Jul 11 04:38:38 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_0ro5awn7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86964) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 11 04:38:38 devstack cinder-volume[86964]: INFO cinder.image.image_utils [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Image download 20.69 MB at 20.69 MB/s Jul 11 04:38:38 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[65203833-d8e9-4261-830b-4bce501dbcb4]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:38:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_0ro5awn7devstack@QuobyteHD {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:38 devstack sudo[101381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_0ro5awn7devstack@QuobyteHD Jul 11 04:38:38 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-32a4f2d2-18f0-4173-9483-2ad67ab6abd1 tempest-TestStampPattern-25865344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:38:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-32a4f2d2-18f0-4173-9483-2ad67ab6abd1 tempest-TestStampPattern-25865344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:38:39 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-32a4f2d2-18f0-4173-9483-2ad67ab6abd1 tempest-TestStampPattern-25865344 None] Creating offline snapshot 5abeb1fa-bed6-4e15-814f-dd8b56d2c774 of volume 45f7be47-35fe-47b5-9b29-102708f56eb0 {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:38:39 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7d3618-d4e6-4439-b2b4-f7f256d98931]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:38:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-32a4f2d2-18f0-4173-9483-2ad67ab6abd1 tempest-TestStampPattern-25865344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:39 devstack sudo[101383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0 Jul 11 04:38:39 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:39 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-205c13c0-a00d-4bf6-9a7e-92bb6aead9e4 tempest-VolumesListTestJSON-471253850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:38:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-205c13c0-a00d-4bf6-9a7e-92bb6aead9e4 tempest-VolumesListTestJSON-471253850 None] Flow 'volume_create_manager' (2c8abbdf-636d-4c0f-b047-92faf7ac9404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:38:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-205c13c0-a00d-4bf6-9a7e-92bb6aead9e4 tempest-VolumesListTestJSON-471253850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba4e485c-be1c-4932-bdb6-3019ee9d158d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-205c13c0-a00d-4bf6-9a7e-92bb6aead9e4 tempest-VolumesListTestJSON-471253850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba4e485c-be1c-4932-bdb6-3019ee9d158d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-749955111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d66fbbc-f42f-4eba-b961-30c194c6651e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9259d1019d9348dda1808fe68dbd581a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:38:39Z,use_quota=True,user_id='33b69efb5cd34ed5af01735fa31dabed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-205c13c0-a00d-4bf6-9a7e-92bb6aead9e4 tempest-VolumesListTestJSON-471253850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9c2be89-b15d-4027-ac1b-78cd02fd0175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-205c13c0-a00d-4bf6-9a7e-92bb6aead9e4 tempest-VolumesListTestJSON-471253850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9c2be89-b15d-4027-ac1b-78cd02fd0175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-205c13c0-a00d-4bf6-9a7e-92bb6aead9e4 tempest-VolumesListTestJSON-471253850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5990224-c616-4127-894a-2ed5f1aea9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-205c13c0-a00d-4bf6-9a7e-92bb6aead9e4 tempest-VolumesListTestJSON-471253850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5990224-c616-4127-894a-2ed5f1aea9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d66fbbc-f42f-4eba-b961-30c194c6651e', 'volume_name': 'volume-7d66fbbc-f42f-4eba-b961-30c194c6651e', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-205c13c0-a00d-4bf6-9a7e-92bb6aead9e4 tempest-VolumesListTestJSON-471253850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32076e10-078f-468c-9e5f-f1c628cdab56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-205c13c0-a00d-4bf6-9a7e-92bb6aead9e4 tempest-VolumesListTestJSON-471253850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32076e10-078f-468c-9e5f-f1c628cdab56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-205c13c0-a00d-4bf6-9a7e-92bb6aead9e4 tempest-VolumesListTestJSON-471253850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (765c83e4-9bdb-4e5e-ac70-df1a2869c9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:39 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-205c13c0-a00d-4bf6-9a7e-92bb6aead9e4 tempest-VolumesListTestJSON-471253850 None] Volume 7d66fbbc-f42f-4eba-b961-30c194c6651e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d66fbbc-f42f-4eba-b961-30c194c6651e', 'volume_size': 1} Jul 11 04:38:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-205c13c0-a00d-4bf6-9a7e-92bb6aead9e4 tempest-VolumesListTestJSON-471253850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:38:39 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_0ro5awn7devstack@QuobyteHD" returned: 0 in 0.858s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:39 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Temporary image a34636df-e58a-4a3a-9b16-7e804af976d8 is fetched for user 990c203db7fc4453a266794ad4d5b5c7. {{(pid=86964) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 11 04:38:39 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb36d58-5d22-4292-816e-1fa766f3a28a]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:38:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_0ro5awn7devstack@QuobyteHD {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:39 devstack sudo[101389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_0ro5awn7devstack@QuobyteHD Jul 11 04:38:39 devstack sudo[101389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:40 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-32a4f2d2-18f0-4173-9483-2ad67ab6abd1 tempest-TestStampPattern-25865344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0" returned: 0 in 0.774s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-32a4f2d2-18f0-4173-9483-2ad67ab6abd1 tempest-TestStampPattern-25865344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0.5abeb1fa-bed6-4e15-814f-dd8b56d2c774 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:40 devstack sudo[101394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0.5abeb1fa-bed6-4e15-814f-dd8b56d2c774 1G Jul 11 04:38:40 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:40 devstack sudo[101389]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_0ro5awn7devstack@QuobyteHD" returned: 0 in 0.750s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:38:40 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-32a4f2d2-18f0-4173-9483-2ad67ab6abd1 tempest-TestStampPattern-25865344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0.5abeb1fa-bed6-4e15-814f-dd8b56d2c774 1G" returned: 0 in 0.777s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-32a4f2d2-18f0-4173-9483-2ad67ab6abd1 tempest-TestStampPattern-25865344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45f7be47-35fe-47b5-9b29-102708f56eb0 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0.5abeb1fa-bed6-4e15-814f-dd8b56d2c774 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:40 devstack sudo[101402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45f7be47-35fe-47b5-9b29-102708f56eb0 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0.5abeb1fa-bed6-4e15-814f-dd8b56d2c774 Jul 11 04:38:40 devstack sudo[101402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:41 devstack sudo[101402]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-32a4f2d2-18f0-4173-9483-2ad67ab6abd1 tempest-TestStampPattern-25865344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45f7be47-35fe-47b5-9b29-102708f56eb0 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0.5abeb1fa-bed6-4e15-814f-dd8b56d2c774" returned: 0 in 0.674s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:41 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-32a4f2d2-18f0-4173-9483-2ad67ab6abd1 tempest-TestStampPattern-25865344 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0.5abeb1fa-bed6-4e15-814f-dd8b56d2c774 is being set with open permissions: ugo+rw Jul 11 04:38:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-32a4f2d2-18f0-4173-9483-2ad67ab6abd1 tempest-TestStampPattern-25865344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0.5abeb1fa-bed6-4e15-814f-dd8b56d2c774 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:41 devstack sudo[101408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0.5abeb1fa-bed6-4e15-814f-dd8b56d2c774 Jul 11 04:38:41 devstack sudo[101408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:42 devstack sudo[101408]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-32a4f2d2-18f0-4173-9483-2ad67ab6abd1 tempest-TestStampPattern-25865344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0.5abeb1fa-bed6-4e15-814f-dd8b56d2c774" returned: 0 in 0.638s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-32a4f2d2-18f0-4173-9483-2ad67ab6abd1 tempest-TestStampPattern-25865344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:42 devstack sudo[101411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0.info Jul 11 04:38:42 devstack sudo[101411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:42 devstack sudo[101411]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-32a4f2d2-18f0-4173-9483-2ad67ab6abd1 tempest-TestStampPattern-25865344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0.info" returned: 0 in 0.638s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:42 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-32a4f2d2-18f0-4173-9483-2ad67ab6abd1 tempest-TestStampPattern-25865344 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0.info is being set with open permissions: ugo+rw Jul 11 04:38:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-32a4f2d2-18f0-4173-9483-2ad67ab6abd1 tempest-TestStampPattern-25865344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:42 devstack sudo[101414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0.info Jul 11 04:38:42 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:43 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-32a4f2d2-18f0-4173-9483-2ad67ab6abd1 tempest-TestStampPattern-25865344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0.info" returned: 0 in 0.630s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-32a4f2d2-18f0-4173-9483-2ad67ab6abd1 tempest-TestStampPattern-25865344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.228s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:38:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-205c13c0-a00d-4bf6-9a7e-92bb6aead9e4 tempest-VolumesListTestJSON-471253850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.928s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:38:43 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-205c13c0-a00d-4bf6-9a7e-92bb6aead9e4 tempest-VolumesListTestJSON-471253850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-749955111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d66fbbc-f42f-4eba-b961-30c194c6651e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9259d1019d9348dda1808fe68dbd581a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:38:39Z,use_quota=True,user_id='33b69efb5cd34ed5af01735fa31dabed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:38:43 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-205c13c0-a00d-4bf6-9a7e-92bb6aead9e4 tempest-VolumesListTestJSON-471253850 None] Creating volume 7d66fbbc-f42f-4eba-b961-30c194c6651e {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:38:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-205c13c0-a00d-4bf6-9a7e-92bb6aead9e4 tempest-VolumesListTestJSON-471253850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:38:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-205c13c0-a00d-4bf6-9a7e-92bb6aead9e4 tempest-VolumesListTestJSON-471253850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:38:43 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-205c13c0-a00d-4bf6-9a7e-92bb6aead9e4 tempest-VolumesListTestJSON-471253850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:38:43 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-205c13c0-a00d-4bf6-9a7e-92bb6aead9e4 tempest-VolumesListTestJSON-471253850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:38:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-205c13c0-a00d-4bf6-9a7e-92bb6aead9e4 tempest-VolumesListTestJSON-471253850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:38:43 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-205c13c0-a00d-4bf6-9a7e-92bb6aead9e4 tempest-VolumesListTestJSON-471253850 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:38:43 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-205c13c0-a00d-4bf6-9a7e-92bb6aead9e4 tempest-VolumesListTestJSON-471253850 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:38:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-205c13c0-a00d-4bf6-9a7e-92bb6aead9e4 tempest-VolumesListTestJSON-471253850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7d66fbbc-f42f-4eba-b961-30c194c6651e 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:43 devstack sudo[101417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7d66fbbc-f42f-4eba-b961-30c194c6651e 1073741824 Jul 11 04:38:43 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:43 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-32a4f2d2-18f0-4173-9483-2ad67ab6abd1 tempest-TestStampPattern-25865344 None] Create snapshot completed successfully Jul 11 04:38:44 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-205c13c0-a00d-4bf6-9a7e-92bb6aead9e4 tempest-VolumesListTestJSON-471253850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7d66fbbc-f42f-4eba-b961-30c194c6651e 1073741824" returned: 0 in 0.834s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-205c13c0-a00d-4bf6-9a7e-92bb6aead9e4 tempest-VolumesListTestJSON-471253850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7d66fbbc-f42f-4eba-b961-30c194c6651e {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:44 devstack sudo[101422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7d66fbbc-f42f-4eba-b961-30c194c6651e Jul 11 04:38:44 devstack sudo[101422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:45 devstack sudo[101422]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-205c13c0-a00d-4bf6-9a7e-92bb6aead9e4 tempest-VolumesListTestJSON-471253850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7d66fbbc-f42f-4eba-b961-30c194c6651e" returned: 0 in 0.674s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-205c13c0-a00d-4bf6-9a7e-92bb6aead9e4 tempest-VolumesListTestJSON-471253850 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:38:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-205c13c0-a00d-4bf6-9a7e-92bb6aead9e4 tempest-VolumesListTestJSON-471253850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:38:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.534s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:38:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-469859088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d281491f-d8f7-4056-886b-1504b6daee59,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8998b9f4cdb9498aa9a5e1476b63e03d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:38:38Z,use_quota=True,user_id='990c203db7fc4453a266794ad4d5b5c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:38:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Creating volume d281491f-d8f7-4056-886b-1504b6daee59 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:38:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:38:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:38:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:38:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:38:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:38:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:38:45 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:38:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d281491f-d8f7-4056-886b-1504b6daee59 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-205c13c0-a00d-4bf6-9a7e-92bb6aead9e4 tempest-VolumesListTestJSON-471253850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (765c83e4-9bdb-4e5e-ac70-df1a2869c9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d66fbbc-f42f-4eba-b961-30c194c6651e', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:45 devstack sudo[101425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d281491f-d8f7-4056-886b-1504b6daee59 1073741824 Jul 11 04:38:45 devstack sudo[101425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-205c13c0-a00d-4bf6-9a7e-92bb6aead9e4 tempest-VolumesListTestJSON-471253850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8b593dd-1063-427e-8e45-aabccf536d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:45 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-205c13c0-a00d-4bf6-9a7e-92bb6aead9e4 tempest-VolumesListTestJSON-471253850 None] Volume volume-7d66fbbc-f42f-4eba-b961-30c194c6651e (7d66fbbc-f42f-4eba-b961-30c194c6651e): created successfully Jul 11 04:38:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-205c13c0-a00d-4bf6-9a7e-92bb6aead9e4 tempest-VolumesListTestJSON-471253850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8b593dd-1063-427e-8e45-aabccf536d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-205c13c0-a00d-4bf6-9a7e-92bb6aead9e4 tempest-VolumesListTestJSON-471253850 None] Flow 'volume_create_manager' (2c8abbdf-636d-4c0f-b047-92faf7ac9404) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:38:45 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-205c13c0-a00d-4bf6-9a7e-92bb6aead9e4 tempest-VolumesListTestJSON-471253850 None] Created volume successfully. Jul 11 04:38:45 devstack sudo[101425]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d281491f-d8f7-4056-886b-1504b6daee59 1073741824" returned: 0 in 0.856s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d281491f-d8f7-4056-886b-1504b6daee59 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:45 devstack sudo[101432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d281491f-d8f7-4056-886b-1504b6daee59 Jul 11 04:38:45 devstack sudo[101432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:46 devstack sudo[101432]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d281491f-d8f7-4056-886b-1504b6daee59" returned: 0 in 0.737s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:46 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:38:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:38:46 devstack cinder-volume[86964]: DEBUG cinder.volume.volume_utils [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Attempting download of a34636df-e58a-4a3a-9b16-7e804af976d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/a34636df-e58a-4a3a-9b16-7e804af976d8', 'metadata': {}}])) to volume d281491f-d8f7-4056-886b-1504b6daee59. {{(pid=86964) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 04:38:46 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[28deaaba-fe07-41d0-bb72-a59ff98f5b22]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:38:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a34636df-e58a-4a3a-9b16-7e804af976d8_4usblq3u {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:46 devstack sudo[101435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a34636df-e58a-4a3a-9b16-7e804af976d8_4usblq3u Jul 11 04:38:46 devstack sudo[101435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:47 devstack sudo[101435]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a34636df-e58a-4a3a-9b16-7e804af976d8_4usblq3u" returned: 0 in 0.810s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a34636df-e58a-4a3a-9b16-7e804af976d8_4usblq3u {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:47 devstack sudo[101439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a34636df-e58a-4a3a-9b16-7e804af976d8_4usblq3u Jul 11 04:38:47 devstack sudo[101439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:48 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d0be9c60-3c58-4d3f-9f1b-bf249c98b32c tempest-VolumesListTestJSON-471253850 None] Acquiring lock "cinder-7d66fbbc-f42f-4eba-b961-30c194c6651e-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:38:48 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d0be9c60-3c58-4d3f-9f1b-bf249c98b32c tempest-VolumesListTestJSON-471253850 None] Lock "cinder-7d66fbbc-f42f-4eba-b961-30c194c6651e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:38:48 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d0be9c60-3c58-4d3f-9f1b-bf249c98b32c tempest-VolumesListTestJSON-471253850 None] Acquiring lock "cinder-quobyte-7d66fbbc-f42f-4eba-b961-30c194c6651e" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:38:48 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d0be9c60-3c58-4d3f-9f1b-bf249c98b32c tempest-VolumesListTestJSON-471253850 None] Lock "cinder-quobyte-7d66fbbc-f42f-4eba-b961-30c194c6651e" acquired by "delete_volume" :: waited 0.020s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:38:48 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[0086deca-3f24-4b39-84db-9e44798d549f]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:38:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d0be9c60-3c58-4d3f-9f1b-bf249c98b32c tempest-VolumesListTestJSON-471253850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7d66fbbc-f42f-4eba-b961-30c194c6651e {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:48 devstack sudo[101441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7d66fbbc-f42f-4eba-b961-30c194c6651e Jul 11 04:38:48 devstack sudo[101441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:48 devstack sudo[101439]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a34636df-e58a-4a3a-9b16-7e804af976d8_4usblq3u" returned: 1 in 0.778s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a34636df-e58a-4a3a-9b16-7e804af976d8_4usblq3u' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:38:48 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1c4ab0-7416-4cec-8b86-cb67aa7872ba]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:38:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_0ro5awn7devstack@QuobyteHD {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:48 devstack sudo[101445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_0ro5awn7devstack@QuobyteHD Jul 11 04:38:48 devstack sudo[101445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:48 devstack sudo[101441]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d0be9c60-3c58-4d3f-9f1b-bf249c98b32c tempest-VolumesListTestJSON-471253850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7d66fbbc-f42f-4eba-b961-30c194c6651e" returned: 0 in 0.787s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d0be9c60-3c58-4d3f-9f1b-bf249c98b32c tempest-VolumesListTestJSON-471253850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7d66fbbc-f42f-4eba-b961-30c194c6651e {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:49 devstack sudo[101457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7d66fbbc-f42f-4eba-b961-30c194c6651e Jul 11 04:38:49 devstack sudo[101457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:49 devstack sudo[101445]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_0ro5awn7devstack@QuobyteHD" returned: 0 in 0.737s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:49 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] a34636df-e58a-4a3a-9b16-7e804af976d8 was qcow2, converting to raw {{(pid=86964) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 11 04:38:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_0ro5awn7devstack@QuobyteHD /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d281491f-d8f7-4056-886b-1504b6daee59 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:49 devstack sudo[101469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_0ro5awn7devstack@QuobyteHD /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d281491f-d8f7-4056-886b-1504b6daee59 Jul 11 04:38:49 devstack sudo[101469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:49 devstack sudo[101457]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d0be9c60-3c58-4d3f-9f1b-bf249c98b32c tempest-VolumesListTestJSON-471253850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7d66fbbc-f42f-4eba-b961-30c194c6651e" returned: 0 in 0.695s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:49 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d0be9c60-3c58-4d3f-9f1b-bf249c98b32c tempest-VolumesListTestJSON-471253850 None] Lock "cinder-quobyte-7d66fbbc-f42f-4eba-b961-30c194c6651e" released by "delete_volume" :: held 1.529s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:38:49 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-d0be9c60-3c58-4d3f-9f1b-bf249c98b32c tempest-VolumesListTestJSON-471253850 None] Created reservations ['c6b7dfc2-e039-46c0-a53f-781c3efe3a00', '8225e23a-9541-4945-ab9b-e9ef6d18c87d', '4b0241d6-721a-415d-9455-3caa96662cb8', 'd6c4569a-34e1-404a-a950-7d36a21e7f53'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:38:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d0be9c60-3c58-4d3f-9f1b-bf249c98b32c tempest-VolumesListTestJSON-471253850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:38:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d0be9c60-3c58-4d3f-9f1b-bf249c98b32c tempest-VolumesListTestJSON-471253850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:38:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-d0be9c60-3c58-4d3f-9f1b-bf249c98b32c tempest-VolumesListTestJSON-471253850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:38:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-d0be9c60-3c58-4d3f-9f1b-bf249c98b32c tempest-VolumesListTestJSON-471253850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:38:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d0be9c60-3c58-4d3f-9f1b-bf249c98b32c tempest-VolumesListTestJSON-471253850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:38:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d0be9c60-3c58-4d3f-9f1b-bf249c98b32c tempest-VolumesListTestJSON-471253850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:49 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:38:49 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-5476cf8b-0e61-41a3-9fe2-98a806763ead tempest-VolumesListTestJSON-471253850 None] Acquiring lock "cinder-d169985b-0f8f-45ba-9ea7-261f2b5f4dbd-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:38:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-5476cf8b-0e61-41a3-9fe2-98a806763ead tempest-VolumesListTestJSON-471253850 None] Lock "cinder-d169985b-0f8f-45ba-9ea7-261f2b5f4dbd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:38:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-5476cf8b-0e61-41a3-9fe2-98a806763ead tempest-VolumesListTestJSON-471253850 None] Acquiring lock "cinder-quobyte-d169985b-0f8f-45ba-9ea7-261f2b5f4dbd" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:38:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-5476cf8b-0e61-41a3-9fe2-98a806763ead tempest-VolumesListTestJSON-471253850 None] Lock "cinder-quobyte-d169985b-0f8f-45ba-9ea7-261f2b5f4dbd" acquired by "delete_volume" :: waited 0.018s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:38:50 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[7552a2e3-41b3-4a4a-8b6c-9972efb2beb1]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:38:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5476cf8b-0e61-41a3-9fe2-98a806763ead tempest-VolumesListTestJSON-471253850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d169985b-0f8f-45ba-9ea7-261f2b5f4dbd {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:50 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d0be9c60-3c58-4d3f-9f1b-bf249c98b32c tempest-VolumesListTestJSON-471253850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.801s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:50 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-d0be9c60-3c58-4d3f-9f1b-bf249c98b32c tempest-VolumesListTestJSON-471253850 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:38:50 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-d0be9c60-3c58-4d3f-9f1b-bf249c98b32c tempest-VolumesListTestJSON-471253850 None] Deleted volume successfully. Jul 11 04:38:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d0be9c60-3c58-4d3f-9f1b-bf249c98b32c tempest-VolumesListTestJSON-471253850 None] Lock "cinder-7d66fbbc-f42f-4eba-b961-30c194c6651e-delete_volume" released by "delete_volume" :: held 2.591s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:38:50 devstack sudo[101507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d169985b-0f8f-45ba-9ea7-261f2b5f4dbd Jul 11 04:38:50 devstack sudo[101507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:51 devstack sudo[101469]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_0ro5awn7devstack@QuobyteHD /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d281491f-d8f7-4056-886b-1504b6daee59" returned: 0 in 2.152s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:51 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_0ro5awn7devstack@QuobyteHD, size 112.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d281491f-d8f7-4056-886b-1504b6daee59 {{(pid=86964) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 04:38:51 devstack cinder-volume[86964]: INFO cinder.image.image_utils [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Converted 112.00 MB image at 52.02 MB/s Jul 11 04:38:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d281491f-d8f7-4056-886b-1504b6daee59 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:51 devstack sudo[101510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d281491f-d8f7-4056-886b-1504b6daee59 1G Jul 11 04:38:51 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:51 devstack sudo[101507]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5476cf8b-0e61-41a3-9fe2-98a806763ead tempest-VolumesListTestJSON-471253850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d169985b-0f8f-45ba-9ea7-261f2b5f4dbd" returned: 0 in 0.899s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5476cf8b-0e61-41a3-9fe2-98a806763ead tempest-VolumesListTestJSON-471253850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d169985b-0f8f-45ba-9ea7-261f2b5f4dbd {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:51 devstack sudo[101515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d169985b-0f8f-45ba-9ea7-261f2b5f4dbd Jul 11 04:38:51 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:52 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d281491f-d8f7-4056-886b-1504b6daee59 1G" returned: 0 in 0.772s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:52 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdebe8fc-dab2-4772-b0c3-0abd22c80e93]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:38:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d281491f-d8f7-4056-886b-1504b6daee59 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:52 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5476cf8b-0e61-41a3-9fe2-98a806763ead tempest-VolumesListTestJSON-471253850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d169985b-0f8f-45ba-9ea7-261f2b5f4dbd" returned: 0 in 0.680s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:52 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-5476cf8b-0e61-41a3-9fe2-98a806763ead tempest-VolumesListTestJSON-471253850 None] Lock "cinder-quobyte-d169985b-0f8f-45ba-9ea7-261f2b5f4dbd" released by "delete_volume" :: held 1.626s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:38:52 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-5476cf8b-0e61-41a3-9fe2-98a806763ead tempest-VolumesListTestJSON-471253850 None] Created reservations ['2b30c739-6651-4a3a-80fe-0c4d454966dc', 'd425ddb8-f0a7-4618-b64d-a9246d985d3e', '276f52e5-612b-4195-a1ea-ebf377c7840d', 'f7cdb62a-0611-4a23-8e84-8757a674c906'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:38:52 devstack sudo[101521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d281491f-d8f7-4056-886b-1504b6daee59 Jul 11 04:38:52 devstack sudo[101521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5476cf8b-0e61-41a3-9fe2-98a806763ead tempest-VolumesListTestJSON-471253850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:38:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5476cf8b-0e61-41a3-9fe2-98a806763ead tempest-VolumesListTestJSON-471253850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:38:52 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-5476cf8b-0e61-41a3-9fe2-98a806763ead tempest-VolumesListTestJSON-471253850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:38:52 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-5476cf8b-0e61-41a3-9fe2-98a806763ead tempest-VolumesListTestJSON-471253850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:38:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5476cf8b-0e61-41a3-9fe2-98a806763ead tempest-VolumesListTestJSON-471253850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:38:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5476cf8b-0e61-41a3-9fe2-98a806763ead tempest-VolumesListTestJSON-471253850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:52 devstack sudo[101523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:38:52 devstack sudo[101523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:52 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6e02350a-a196-41d2-b8f8-7ccc0c9a7887 tempest-VolumesListTestJSON-471253850 None] Acquiring lock "cinder-fcfa1698-f34e-4120-afb4-41b58d13f2d0-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:38:52 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6e02350a-a196-41d2-b8f8-7ccc0c9a7887 tempest-VolumesListTestJSON-471253850 None] Lock "cinder-fcfa1698-f34e-4120-afb4-41b58d13f2d0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:38:52 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6e02350a-a196-41d2-b8f8-7ccc0c9a7887 tempest-VolumesListTestJSON-471253850 None] Acquiring lock "cinder-quobyte-fcfa1698-f34e-4120-afb4-41b58d13f2d0" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:38:52 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6e02350a-a196-41d2-b8f8-7ccc0c9a7887 tempest-VolumesListTestJSON-471253850 None] Lock "cinder-quobyte-fcfa1698-f34e-4120-afb4-41b58d13f2d0" acquired by "delete_volume" :: waited 0.028s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:38:52 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a809946-9873-41f5-a2c5-4cafa6495983]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:38:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6e02350a-a196-41d2-b8f8-7ccc0c9a7887 tempest-VolumesListTestJSON-471253850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fcfa1698-f34e-4120-afb4-41b58d13f2d0 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:53 devstack sudo[101521]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d281491f-d8f7-4056-886b-1504b6daee59" returned: 0 in 0.931s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d281491f-d8f7-4056-886b-1504b6daee59 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:53 devstack sudo[101523]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5476cf8b-0e61-41a3-9fe2-98a806763ead tempest-VolumesListTestJSON-471253850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.716s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:53 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-5476cf8b-0e61-41a3-9fe2-98a806763ead tempest-VolumesListTestJSON-471253850 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:38:53 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-5476cf8b-0e61-41a3-9fe2-98a806763ead tempest-VolumesListTestJSON-471253850 None] Deleted volume successfully. Jul 11 04:38:53 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-5476cf8b-0e61-41a3-9fe2-98a806763ead tempest-VolumesListTestJSON-471253850 None] Lock "cinder-d169985b-0f8f-45ba-9ea7-261f2b5f4dbd-delete_volume" released by "delete_volume" :: held 2.663s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:38:53 devstack sudo[101529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d281491f-d8f7-4056-886b-1504b6daee59 Jul 11 04:38:53 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:53 devstack sudo[101528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fcfa1698-f34e-4120-afb4-41b58d13f2d0 Jul 11 04:38:53 devstack sudo[101528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:53 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d281491f-d8f7-4056-886b-1504b6daee59" returned: 1 in 0.814s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d281491f-d8f7-4056-886b-1504b6daee59' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:38:53 devstack cinder-volume[86964]: DEBUG cinder.volume.volume_utils [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Downloaded image a34636df-e58a-4a3a-9b16-7e804af976d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/a34636df-e58a-4a3a-9b16-7e804af976d8', 'metadata': {}}])) to volume d281491f-d8f7-4056-886b-1504b6daee59 successfully. {{(pid=86964) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 04:38:53 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Temporary image a34636df-e58a-4a3a-9b16-7e804af976d8 for user 990c203db7fc4453a266794ad4d5b5c7 is deleted. {{(pid=86964) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 11 04:38:53 devstack cinder-volume[86964]: DEBUG cinder.volume.volume_utils [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Marking volume d281491f-d8f7-4056-886b-1504b6daee59 as bootable. {{(pid=86964) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 04:38:53 devstack sudo[101528]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6e02350a-a196-41d2-b8f8-7ccc0c9a7887 tempest-VolumesListTestJSON-471253850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fcfa1698-f34e-4120-afb4-41b58d13f2d0" returned: 0 in 0.876s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6e02350a-a196-41d2-b8f8-7ccc0c9a7887 tempest-VolumesListTestJSON-471253850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fcfa1698-f34e-4120-afb4-41b58d13f2d0 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:53 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Copying metadata from image a34636df-e58a-4a3a-9b16-7e804af976d8 to d281491f-d8f7-4056-886b-1504b6daee59. {{(pid=86964) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 04:38:53 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Creating volume glance metadata for volume d281491f-d8f7-4056-886b-1504b6daee59 backed by image a34636df-e58a-4a3a-9b16-7e804af976d8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a34636df-e58a-4a3a-9b16-7e804af976d8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86964) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 04:38:53 devstack sudo[101538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fcfa1698-f34e-4120-afb4-41b58d13f2d0 Jul 11 04:38:53 devstack sudo[101538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:53 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (295ade4b-19fb-4da0-93b9-8a451ff6cd12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d281491f-d8f7-4056-886b-1504b6daee59', 'volume_size': 1, 'image_id': 'a34636df-e58a-4a3a-9b16-7e804af976d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a34636df-e58a-4a3a-9b16-7e804af976d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ffa684dc47340c1a363723e49759fc3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a34636df-e58a-4a3a-9b16-7e804af976d8', 'created_at': datetime.datetime(2026, 7, 11, 2, 18, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 18, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a34636df-e58a-4a3a-9b16-7e804af976d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:53 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (379ff17e-8c38-43e7-9e07-79a48bdd87a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:54 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Volume volume-d281491f-d8f7-4056-886b-1504b6daee59 (d281491f-d8f7-4056-886b-1504b6daee59): created successfully Jul 11 04:38:54 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (379ff17e-8c38-43e7-9e07-79a48bdd87a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:54 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Flow 'volume_create_manager' (bae82730-7dcd-48a6-98f0-3583dbb8987d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:38:54 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-b7fc493e-36f9-465a-94bc-d6ea3731d50f tempest-VolumesGetTest-1221404998 None] Created volume successfully. Jul 11 04:38:54 devstack sudo[101538]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:54 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:38:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6e02350a-a196-41d2-b8f8-7ccc0c9a7887 tempest-VolumesListTestJSON-471253850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fcfa1698-f34e-4120-afb4-41b58d13f2d0" returned: 0 in 0.760s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:54 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6e02350a-a196-41d2-b8f8-7ccc0c9a7887 tempest-VolumesListTestJSON-471253850 None] Lock "cinder-quobyte-fcfa1698-f34e-4120-afb4-41b58d13f2d0" released by "delete_volume" :: held 1.708s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:38:54 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Flow 'volume_create_manager' (b64fc48d-18cb-407e-bcb9-c29dd52ee65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:38:54 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f98744-925a-4ffd-ae96-3e96e61138b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:54 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f98744-925a-4ffd-ae96-3e96e61138b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1781898894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f953588-501b-44cf-bd36-e83a5a74bfbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='597256c8a28b4fcc91ee2a96a26876f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5abeb1fa-bed6-4e15-814f-dd8b56d2c774,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:38:55Z,use_quota=True,user_id='35b3f658ccf442bfadb717ab1d84094f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:54 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (834e38ca-9948-4bab-9fb8-d413c334bfe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:54 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (834e38ca-9948-4bab-9fb8-d413c334bfe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:54 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3abd821d-e7b9-41a8-a722-8bc14866279b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:54 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3abd821d-e7b9-41a8-a722-8bc14866279b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4f953588-501b-44cf-bd36-e83a5a74bfbe', 'volume_name': 'volume-4f953588-501b-44cf-bd36-e83a5a74bfbe', 'volume_size': 1, 'snapshot_id': '5abeb1fa-bed6-4e15-814f-dd8b56d2c774'}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:54 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e736d71e-cb86-497b-8a5e-2961c9be81f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:54 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e736d71e-cb86-497b-8a5e-2961c9be81f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:54 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7243fff8-af3d-42d0-abac-c524f1024040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:54 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Volume 4f953588-501b-44cf-bd36-e83a5a74bfbe: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4f953588-501b-44cf-bd36-e83a5a74bfbe', 'volume_size': 1, 'snapshot_id': '5abeb1fa-bed6-4e15-814f-dd8b56d2c774'} Jul 11 04:38:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:38:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:38:54 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Acquiring lock "cinder-quobyte-5abeb1fa-bed6-4e15-814f-dd8b56d2c774-4f953588-501b-44cf-bd36-e83a5a74bfbe" by "_create_volume_from_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:38:54 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Lock "cinder-quobyte-5abeb1fa-bed6-4e15-814f-dd8b56d2c774-4f953588-501b-44cf-bd36-e83a5a74bfbe" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:38:54 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Creating volume 4f953588-501b-44cf-bd36-e83a5a74bfbe from snapshot 5abeb1fa-bed6-4e15-814f-dd8b56d2c774 {{(pid=86964) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 04:38:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:38:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:38:54 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:38:54 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:38:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:38:54 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:38:54 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Acquiring lock "cinder-quobyte-4f953588-501b-44cf-bd36-e83a5a74bfbe" by "_copy_volume_from_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:38:54 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Lock "cinder-quobyte-4f953588-501b-44cf-bd36-e83a5a74bfbe" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:38:54 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] snapshot: 5abeb1fa-bed6-4e15-814f-dd8b56d2c774, volume: 4f953588-501b-44cf-bd36-e83a5a74bfbe, {{(pid=86964) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 04:38:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:38:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:38:54 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:38:54 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:38:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:38:54 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-6e02350a-a196-41d2-b8f8-7ccc0c9a7887 tempest-VolumesListTestJSON-471253850 None] Created reservations ['2c5a66b2-fbbd-483e-8664-3e8056258b98', '3c4a7fd7-4bd8-4de5-bbb8-64ff416698f9', 'c435264f-0a31-448d-b5a7-b6f8e4a3881c', '29565c05-8c34-4d58-a112-fc94c760da97'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:38:54 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab5278c-1d6d-4e3c-898c-e09898ebb3d0]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:38:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0.5abeb1fa-bed6-4e15-814f-dd8b56d2c774 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6e02350a-a196-41d2-b8f8-7ccc0c9a7887 tempest-VolumesListTestJSON-471253850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:38:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6e02350a-a196-41d2-b8f8-7ccc0c9a7887 tempest-VolumesListTestJSON-471253850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:38:54 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6e02350a-a196-41d2-b8f8-7ccc0c9a7887 tempest-VolumesListTestJSON-471253850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:38:55 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6e02350a-a196-41d2-b8f8-7ccc0c9a7887 tempest-VolumesListTestJSON-471253850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:38:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6e02350a-a196-41d2-b8f8-7ccc0c9a7887 tempest-VolumesListTestJSON-471253850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:38:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6e02350a-a196-41d2-b8f8-7ccc0c9a7887 tempest-VolumesListTestJSON-471253850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:55 devstack sudo[101542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:38:55 devstack sudo[101542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:55 devstack sudo[101541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0.5abeb1fa-bed6-4e15-814f-dd8b56d2c774 Jul 11 04:38:55 devstack sudo[101541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:55 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-204ea6ff-ed9e-40e4-b285-e9c938eb539b tempest-VolumesGetTest-1221404998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:38:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-204ea6ff-ed9e-40e4-b285-e9c938eb539b tempest-VolumesGetTest-1221404998 None] Flow 'volume_create_manager' (aa36330a-9596-4d3b-a9a7-89e7a39288d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:38:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-204ea6ff-ed9e-40e4-b285-e9c938eb539b tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bac95272-2ffa-41c3-a93b-e57f0addcfe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-204ea6ff-ed9e-40e4-b285-e9c938eb539b tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bac95272-2ffa-41c3-a93b-e57f0addcfe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:38:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1388590949',display_name='tempest-VolumesGetTest-Volume-1950428372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa329118-97ea-4c81-b30b-8104ace6d2c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8998b9f4cdb9498aa9a5e1476b63e03d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:38:55Z,use_quota=True,user_id='990c203db7fc4453a266794ad4d5b5c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-204ea6ff-ed9e-40e4-b285-e9c938eb539b tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e46eb2bf-6d80-4881-9fe8-08add768c1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-204ea6ff-ed9e-40e4-b285-e9c938eb539b tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e46eb2bf-6d80-4881-9fe8-08add768c1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-204ea6ff-ed9e-40e4-b285-e9c938eb539b tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc93bffb-898d-4e66-9778-4747cff0b7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-204ea6ff-ed9e-40e4-b285-e9c938eb539b tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc93bffb-898d-4e66-9778-4747cff0b7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa329118-97ea-4c81-b30b-8104ace6d2c1', 'volume_name': 'volume-fa329118-97ea-4c81-b30b-8104ace6d2c1', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-204ea6ff-ed9e-40e4-b285-e9c938eb539b tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9327c2f8-06bf-4fb1-96b1-974203510285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-204ea6ff-ed9e-40e4-b285-e9c938eb539b tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9327c2f8-06bf-4fb1-96b1-974203510285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-204ea6ff-ed9e-40e4-b285-e9c938eb539b tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef6104a1-574d-412f-b85f-9bfba0071e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:55 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-204ea6ff-ed9e-40e4-b285-e9c938eb539b tempest-VolumesGetTest-1221404998 None] Volume fa329118-97ea-4c81-b30b-8104ace6d2c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa329118-97ea-4c81-b30b-8104ace6d2c1', 'volume_size': 1} Jul 11 04:38:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-204ea6ff-ed9e-40e4-b285-e9c938eb539b tempest-VolumesGetTest-1221404998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:38:55 devstack sudo[101541]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0.5abeb1fa-bed6-4e15-814f-dd8b56d2c774" returned: 0 in 1.076s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:55 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45f7be47-35fe-47b5-9b29-102708f56eb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:38:55 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0 {{(pid=86964) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 04:38:55 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Creating direct copy from snapshot {{(pid=86964) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 04:38:55 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1edb5ae-b993-4e66-bc41-1b8151b9555e]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:38:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:56 devstack sudo[101542]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6e02350a-a196-41d2-b8f8-7ccc0c9a7887 tempest-VolumesListTestJSON-471253850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 1.023s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:56 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-6e02350a-a196-41d2-b8f8-7ccc0c9a7887 tempest-VolumesListTestJSON-471253850 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:38:56 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-6e02350a-a196-41d2-b8f8-7ccc0c9a7887 tempest-VolumesListTestJSON-471253850 None] Deleted volume successfully. Jul 11 04:38:56 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6e02350a-a196-41d2-b8f8-7ccc0c9a7887 tempest-VolumesListTestJSON-471253850 None] Lock "cinder-fcfa1698-f34e-4120-afb4-41b58d13f2d0-delete_volume" released by "delete_volume" :: held 3.231s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:38:56 devstack sudo[101553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0 Jul 11 04:38:56 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:56 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root Jul 11 04:38:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0" returned: 0 in 0.914s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:38:56 devstack cinder-volume[86964]: DEBUG cinder.utils [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Path /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4f953588-501b-44cf-bd36-e83a5a74bfbe not found in is_blk_device check {{(pid=86964) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 04:38:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4f953588-501b-44cf-bd36-e83a5a74bfbe {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:56 devstack sudo[101559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4f953588-501b-44cf-bd36-e83a5a74bfbe Jul 11 04:38:56 devstack sudo[101559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:59 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a244508-7816-477c-a058-c7b2f631432e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:38:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6a244508-7816-477c-a058-c7b2f631432e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Flow 'volume_create_manager' (3a4117c2-0fa7-4882-871d-435f15d3ffee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:38:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6a244508-7816-477c-a058-c7b2f631432e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93cd4314-6fde-4ec2-8df2-e91ec39318ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:59 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:38:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:38:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:38:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:38:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:38:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:38:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:38:59 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:38:59 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:38:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6a244508-7816-477c-a058-c7b2f631432e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93cd4314-6fde-4ec2-8df2-e91ec39318ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1509378966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6936d278-4c61-4eff-8f74-b25ed083b4fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91f4a12b22034daf984532e64f89abc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:38:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:38:59Z,use_quota=True,user_id='c4eddaa71fa9434aa1f20c8a4af0924b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6a244508-7816-477c-a058-c7b2f631432e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0971faa-e6c7-4b15-b1cd-e96a1f5cbf88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6a244508-7816-477c-a058-c7b2f631432e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0971faa-e6c7-4b15-b1cd-e96a1f5cbf88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6a244508-7816-477c-a058-c7b2f631432e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34539905-a302-4487-a545-f9ce918c7a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6a244508-7816-477c-a058-c7b2f631432e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34539905-a302-4487-a545-f9ce918c7a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6936d278-4c61-4eff-8f74-b25ed083b4fd', 'volume_name': 'volume-6936d278-4c61-4eff-8f74-b25ed083b4fd', 'volume_size': 2}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6a244508-7816-477c-a058-c7b2f631432e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3cf017d-e22c-4003-a2db-3e5fa334bd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6a244508-7816-477c-a058-c7b2f631432e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3cf017d-e22c-4003-a2db-3e5fa334bd9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:38:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6a244508-7816-477c-a058-c7b2f631432e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7ba573-56b9-49aa-8897-881aea76adf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:38:59 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-6a244508-7816-477c-a058-c7b2f631432e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Volume 6936d278-4c61-4eff-8f74-b25ed083b4fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6936d278-4c61-4eff-8f74-b25ed083b4fd', 'volume_size': 2} Jul 11 04:38:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6a244508-7816-477c-a058-c7b2f631432e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:39:00 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:UPDATE=139,cinder:SELECT=84,cinder:INSERT=38,cinder:DELETE=13 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:39:00 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Jul 11 04:39:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 1.155s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:39:00 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:39:00 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager._thread_info {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:39:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread count: 28 {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:39:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread info: [<_MainThread(MainThread, started 124675027595392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:39:02 devstack sudo[101559]: pam_unix(sudo:session): session closed for user root Jul 11 04:39:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4f953588-501b-44cf-bd36-e83a5a74bfbe" returned: 0 in 5.797s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:39:02 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a50c9a7-c0fd-42de-883e-0f26a0e7388a]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:39:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:39:02 devstack sudo[101575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0 Jul 11 04:39:02 devstack sudo[101575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:39:03 devstack sudo[101575]: pam_unix(sudo:session): session closed for user root Jul 11 04:39:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0" returned: 0 in 1.132s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:39:03 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Image conversion details: src /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0, size 1024.00 MB, duration 5.80 sec, destination /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4f953588-501b-44cf-bd36-e83a5a74bfbe {{(pid=86964) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 04:39:03 devstack cinder-volume[86964]: INFO cinder.image.image_utils [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Converted 1024.00 MB image at 176.60 MB/s Jul 11 04:39:03 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4f953588-501b-44cf-bd36-e83a5a74bfbe is being set with open permissions: ugo+rw Jul 11 04:39:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4f953588-501b-44cf-bd36-e83a5a74bfbe {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:39:03 devstack sudo[101582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4f953588-501b-44cf-bd36-e83a5a74bfbe Jul 11 04:39:03 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:39:04 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root Jul 11 04:39:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4f953588-501b-44cf-bd36-e83a5a74bfbe" returned: 0 in 0.699s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:39:04 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Lock "cinder-quobyte-4f953588-501b-44cf-bd36-e83a5a74bfbe" released by "_copy_volume_from_snapshot" :: held 9.750s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:39:04 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Lock "cinder-quobyte-5abeb1fa-bed6-4e15-814f-dd8b56d2c774-4f953588-501b-44cf-bd36-e83a5a74bfbe" released by "_create_volume_from_snapshot" :: held 9.796s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:39:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.817s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:39:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-204ea6ff-ed9e-40e4-b285-e9c938eb539b tempest-VolumesGetTest-1221404998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.209s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:39:04 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-204ea6ff-ed9e-40e4-b285-e9c938eb539b tempest-VolumesGetTest-1221404998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:38:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1388590949',display_name='tempest-VolumesGetTest-Volume-1950428372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa329118-97ea-4c81-b30b-8104ace6d2c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8998b9f4cdb9498aa9a5e1476b63e03d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:38:55Z,use_quota=True,user_id='990c203db7fc4453a266794ad4d5b5c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:39:04 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-204ea6ff-ed9e-40e4-b285-e9c938eb539b tempest-VolumesGetTest-1221404998 None] Creating volume fa329118-97ea-4c81-b30b-8104ace6d2c1 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:39:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-204ea6ff-ed9e-40e4-b285-e9c938eb539b tempest-VolumesGetTest-1221404998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:39:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-204ea6ff-ed9e-40e4-b285-e9c938eb539b tempest-VolumesGetTest-1221404998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:39:04 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-204ea6ff-ed9e-40e4-b285-e9c938eb539b tempest-VolumesGetTest-1221404998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:39:04 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-204ea6ff-ed9e-40e4-b285-e9c938eb539b tempest-VolumesGetTest-1221404998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:39:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-204ea6ff-ed9e-40e4-b285-e9c938eb539b tempest-VolumesGetTest-1221404998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:39:04 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-204ea6ff-ed9e-40e4-b285-e9c938eb539b tempest-VolumesGetTest-1221404998 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:39:04 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-204ea6ff-ed9e-40e4-b285-e9c938eb539b tempest-VolumesGetTest-1221404998 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:39:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-204ea6ff-ed9e-40e4-b285-e9c938eb539b tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fa329118-97ea-4c81-b30b-8104ace6d2c1 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:39:04 devstack sudo[101596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fa329118-97ea-4c81-b30b-8104ace6d2c1 1073741824 Jul 11 04:39:04 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:39:04 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7243fff8-af3d-42d0-abac-c524f1024040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f953588-501b-44cf-bd36-e83a5a74bfbe', 'volume_size': 1, 'snapshot_id': '5abeb1fa-bed6-4e15-814f-dd8b56d2c774'}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:39:04 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c20d6b8f-4744-4ad5-9122-1aec2da22905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:39:04 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Volume volume-4f953588-501b-44cf-bd36-e83a5a74bfbe (4f953588-501b-44cf-bd36-e83a5a74bfbe): created successfully Jul 11 04:39:04 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c20d6b8f-4744-4ad5-9122-1aec2da22905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:39:04 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Flow 'volume_create_manager' (b64fc48d-18cb-407e-bcb9-c29dd52ee65f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:39:04 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-7c07b912-daf8-4ca1-b958-3489febaca42 tempest-TestStampPattern-25865344 None] Created volume successfully. Jul 11 04:39:05 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root Jul 11 04:39:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-204ea6ff-ed9e-40e4-b285-e9c938eb539b tempest-VolumesGetTest-1221404998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fa329118-97ea-4c81-b30b-8104ace6d2c1 1073741824" returned: 0 in 0.960s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:39:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-204ea6ff-ed9e-40e4-b285-e9c938eb539b tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fa329118-97ea-4c81-b30b-8104ace6d2c1 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:39:05 devstack sudo[101653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fa329118-97ea-4c81-b30b-8104ace6d2c1 Jul 11 04:39:05 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:39:06 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root Jul 11 04:39:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-204ea6ff-ed9e-40e4-b285-e9c938eb539b tempest-VolumesGetTest-1221404998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fa329118-97ea-4c81-b30b-8104ace6d2c1" returned: 0 in 0.646s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:39:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-204ea6ff-ed9e-40e4-b285-e9c938eb539b tempest-VolumesGetTest-1221404998 None] <== create_volume: return (1643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:39:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-204ea6ff-ed9e-40e4-b285-e9c938eb539b tempest-VolumesGetTest-1221404998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:39:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6a244508-7816-477c-a058-c7b2f631432e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.839s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:39:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6a244508-7816-477c-a058-c7b2f631432e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1509378966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6936d278-4c61-4eff-8f74-b25ed083b4fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91f4a12b22034daf984532e64f89abc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:38:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:38:59Z,use_quota=True,user_id='c4eddaa71fa9434aa1f20c8a4af0924b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:39:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-6a244508-7816-477c-a058-c7b2f631432e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Creating volume 6936d278-4c61-4eff-8f74-b25ed083b4fd {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:39:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6a244508-7816-477c-a058-c7b2f631432e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:39:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6a244508-7816-477c-a058-c7b2f631432e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:39:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6a244508-7816-477c-a058-c7b2f631432e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:39:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6a244508-7816-477c-a058-c7b2f631432e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:39:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6a244508-7816-477c-a058-c7b2f631432e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:39:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6a244508-7816-477c-a058-c7b2f631432e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:39:06 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-6a244508-7816-477c-a058-c7b2f631432e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:39:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6a244508-7816-477c-a058-c7b2f631432e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd 2147483648 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:39:06 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-204ea6ff-ed9e-40e4-b285-e9c938eb539b tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef6104a1-574d-412f-b85f-9bfba0071e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa329118-97ea-4c81-b30b-8104ace6d2c1', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:39:06 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-204ea6ff-ed9e-40e4-b285-e9c938eb539b tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb1ba15-1199-4462-998a-592a3b438edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:39:06 devstack sudo[101657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd 2147483648 Jul 11 04:39:06 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:39:06 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-204ea6ff-ed9e-40e4-b285-e9c938eb539b tempest-VolumesGetTest-1221404998 None] Volume volume-fa329118-97ea-4c81-b30b-8104ace6d2c1 (fa329118-97ea-4c81-b30b-8104ace6d2c1): created successfully Jul 11 04:39:06 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-204ea6ff-ed9e-40e4-b285-e9c938eb539b tempest-VolumesGetTest-1221404998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb1ba15-1199-4462-998a-592a3b438edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:39:06 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-204ea6ff-ed9e-40e4-b285-e9c938eb539b tempest-VolumesGetTest-1221404998 None] Flow 'volume_create_manager' (aa36330a-9596-4d3b-a9a7-89e7a39288d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:39:06 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-204ea6ff-ed9e-40e4-b285-e9c938eb539b tempest-VolumesGetTest-1221404998 None] Created volume successfully. Jul 11 04:39:07 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root Jul 11 04:39:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6a244508-7816-477c-a058-c7b2f631432e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd 2147483648" returned: 0 in 0.862s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:39:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6a244508-7816-477c-a058-c7b2f631432e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:39:07 devstack sudo[101663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd Jul 11 04:39:07 devstack sudo[101663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:39:07 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-7771c0b5-cc43-41ca-89a2-788d95590278 tempest-VolumesGetTest-1221404998 None] Acquiring lock "cinder-fa329118-97ea-4c81-b30b-8104ace6d2c1-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:39:07 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-7771c0b5-cc43-41ca-89a2-788d95590278 tempest-VolumesGetTest-1221404998 None] Lock "cinder-fa329118-97ea-4c81-b30b-8104ace6d2c1-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:39:07 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-7771c0b5-cc43-41ca-89a2-788d95590278 tempest-VolumesGetTest-1221404998 None] Acquiring lock "cinder-quobyte-fa329118-97ea-4c81-b30b-8104ace6d2c1" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:39:07 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-7771c0b5-cc43-41ca-89a2-788d95590278 tempest-VolumesGetTest-1221404998 None] Lock "cinder-quobyte-fa329118-97ea-4c81-b30b-8104ace6d2c1" acquired by "delete_volume" :: waited 0.028s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:39:07 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52bbdd9-184b-4473-842d-bd2c9d13236f]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:39:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7771c0b5-cc43-41ca-89a2-788d95590278 tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fa329118-97ea-4c81-b30b-8104ace6d2c1 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:39:08 devstack sudo[101685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fa329118-97ea-4c81-b30b-8104ace6d2c1 Jul 11 04:39:08 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:39:08 devstack sudo[101663]: pam_unix(sudo:session): session closed for user root Jul 11 04:39:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6a244508-7816-477c-a058-c7b2f631432e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd" returned: 0 in 0.966s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:39:08 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6a244508-7816-477c-a058-c7b2f631432e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] <== create_volume: return (1866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:39:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6a244508-7816-477c-a058-c7b2f631432e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.869s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:39:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6a244508-7816-477c-a058-c7b2f631432e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7ba573-56b9-49aa-8897-881aea76adf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6936d278-4c61-4eff-8f74-b25ed083b4fd', 'volume_size': 2}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:39:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6a244508-7816-477c-a058-c7b2f631432e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce3e56e6-f410-47e1-812f-0d286b12f997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:39:08 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-6a244508-7816-477c-a058-c7b2f631432e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Volume volume-6936d278-4c61-4eff-8f74-b25ed083b4fd (6936d278-4c61-4eff-8f74-b25ed083b4fd): created successfully Jul 11 04:39:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6a244508-7816-477c-a058-c7b2f631432e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce3e56e6-f410-47e1-812f-0d286b12f997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:39:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6a244508-7816-477c-a058-c7b2f631432e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Flow 'volume_create_manager' (3a4117c2-0fa7-4882-871d-435f15d3ffee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:39:08 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-6a244508-7816-477c-a058-c7b2f631432e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Created volume successfully. Jul 11 04:39:08 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root Jul 11 04:39:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7771c0b5-cc43-41ca-89a2-788d95590278 tempest-VolumesGetTest-1221404998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fa329118-97ea-4c81-b30b-8104ace6d2c1" returned: 0 in 0.835s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:39:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7771c0b5-cc43-41ca-89a2-788d95590278 tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fa329118-97ea-4c81-b30b-8104ace6d2c1 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:39:08 devstack sudo[101700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fa329118-97ea-4c81-b30b-8104ace6d2c1 Jul 11 04:39:08 devstack sudo[101700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:39:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-40b4f1a7-e08e-4989-b4a9-a5a9f77d0ea6 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:39:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-40b4f1a7-e08e-4989-b4a9-a5a9f77d0ea6 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:39:09 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-40b4f1a7-e08e-4989-b4a9-a5a9f77d0ea6 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Creating offline snapshot 4f0df9a6-6820-4ec0-85db-4e0e5c571efd of volume 6936d278-4c61-4eff-8f74-b25ed083b4fd {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:39:09 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6f11bf-60b9-479f-a37a-583f0a579d50]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:39:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-40b4f1a7-e08e-4989-b4a9-a5a9f77d0ea6 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:39:09 devstack sudo[101700]: pam_unix(sudo:session): session closed for user root Jul 11 04:39:09 devstack sudo[101730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd Jul 11 04:39:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7771c0b5-cc43-41ca-89a2-788d95590278 tempest-VolumesGetTest-1221404998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fa329118-97ea-4c81-b30b-8104ace6d2c1" returned: 0 in 0.788s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:39:09 devstack sudo[101730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:39:09 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-7771c0b5-cc43-41ca-89a2-788d95590278 tempest-VolumesGetTest-1221404998 None] Lock "cinder-quobyte-fa329118-97ea-4c81-b30b-8104ace6d2c1" released by "delete_volume" :: held 1.700s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:39:09 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-7771c0b5-cc43-41ca-89a2-788d95590278 tempest-VolumesGetTest-1221404998 None] Created reservations ['11ef5e6d-d047-4d98-885c-b991d72ce967', '333dee15-4824-4a06-80a5-620afd5fcf22', '59f4ea95-dba7-42a6-a3b7-466caed65b93', '8d956e95-7497-46b7-87a7-c20b50a90630'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:39:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7771c0b5-cc43-41ca-89a2-788d95590278 tempest-VolumesGetTest-1221404998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:39:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7771c0b5-cc43-41ca-89a2-788d95590278 tempest-VolumesGetTest-1221404998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:39:09 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7771c0b5-cc43-41ca-89a2-788d95590278 tempest-VolumesGetTest-1221404998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:39:09 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7771c0b5-cc43-41ca-89a2-788d95590278 tempest-VolumesGetTest-1221404998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:39:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7771c0b5-cc43-41ca-89a2-788d95590278 tempest-VolumesGetTest-1221404998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:39:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7771c0b5-cc43-41ca-89a2-788d95590278 tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:39:09 devstack sudo[101733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:39:09 devstack sudo[101733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:39:10 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-77c2c666-0131-47d2-821b-4a873e7f291b tempest-VolumesGetTest-1221404998 None] Acquiring lock "cinder-d281491f-d8f7-4056-886b-1504b6daee59-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:39:10 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-77c2c666-0131-47d2-821b-4a873e7f291b tempest-VolumesGetTest-1221404998 None] Lock "cinder-d281491f-d8f7-4056-886b-1504b6daee59-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:39:10 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-77c2c666-0131-47d2-821b-4a873e7f291b tempest-VolumesGetTest-1221404998 None] Acquiring lock "cinder-quobyte-d281491f-d8f7-4056-886b-1504b6daee59" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:39:10 devstack sudo[101730]: pam_unix(sudo:session): session closed for user root Jul 11 04:39:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-40b4f1a7-e08e-4989-b4a9-a5a9f77d0ea6 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd" returned: 0 in 0.902s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:39:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-40b4f1a7-e08e-4989-b4a9-a5a9f77d0ea6 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd.4f0df9a6-6820-4ec0-85db-4e0e5c571efd 2G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:39:10 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-77c2c666-0131-47d2-821b-4a873e7f291b tempest-VolumesGetTest-1221404998 None] Lock "cinder-quobyte-d281491f-d8f7-4056-886b-1504b6daee59" acquired by "delete_volume" :: waited 0.042s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:39:10 devstack sudo[101741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd.4f0df9a6-6820-4ec0-85db-4e0e5c571efd 2G Jul 11 04:39:10 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:39:10 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[f089bde4-874e-4d6a-b76a-97ee6f8f7db5]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:39:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-77c2c666-0131-47d2-821b-4a873e7f291b tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d281491f-d8f7-4056-886b-1504b6daee59 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:39:10 devstack sudo[101743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d281491f-d8f7-4056-886b-1504b6daee59 Jul 11 04:39:10 devstack sudo[101743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:39:10 devstack sudo[101733]: pam_unix(sudo:session): session closed for user root Jul 11 04:39:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7771c0b5-cc43-41ca-89a2-788d95590278 tempest-VolumesGetTest-1221404998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 1.095s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:39:10 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-7771c0b5-cc43-41ca-89a2-788d95590278 tempest-VolumesGetTest-1221404998 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:39:10 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-7771c0b5-cc43-41ca-89a2-788d95590278 tempest-VolumesGetTest-1221404998 None] Deleted volume successfully. Jul 11 04:39:10 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-7771c0b5-cc43-41ca-89a2-788d95590278 tempest-VolumesGetTest-1221404998 None] Lock "cinder-fa329118-97ea-4c81-b30b-8104ace6d2c1-delete_volume" released by "delete_volume" :: held 3.141s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:39:11 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root Jul 11 04:39:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-40b4f1a7-e08e-4989-b4a9-a5a9f77d0ea6 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd.4f0df9a6-6820-4ec0-85db-4e0e5c571efd 2G" returned: 0 in 1.095s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:39:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-40b4f1a7-e08e-4989-b4a9-a5a9f77d0ea6 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6936d278-4c61-4eff-8f74-b25ed083b4fd -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd.4f0df9a6-6820-4ec0-85db-4e0e5c571efd {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:39:11 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6936d278-4c61-4eff-8f74-b25ed083b4fd -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd.4f0df9a6-6820-4ec0-85db-4e0e5c571efd Jul 11 04:39:11 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:39:11 devstack sudo[101743]: pam_unix(sudo:session): session closed for user root Jul 11 04:39:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-77c2c666-0131-47d2-821b-4a873e7f291b tempest-VolumesGetTest-1221404998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d281491f-d8f7-4056-886b-1504b6daee59" returned: 0 in 1.132s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:39:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-77c2c666-0131-47d2-821b-4a873e7f291b tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d281491f-d8f7-4056-886b-1504b6daee59 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:39:11 devstack sudo[101754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d281491f-d8f7-4056-886b-1504b6daee59 Jul 11 04:39:11 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:39:12 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Jul 11 04:39:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-40b4f1a7-e08e-4989-b4a9-a5a9f77d0ea6 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6936d278-4c61-4eff-8f74-b25ed083b4fd -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd.4f0df9a6-6820-4ec0-85db-4e0e5c571efd" returned: 0 in 0.798s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:39:12 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-40b4f1a7-e08e-4989-b4a9-a5a9f77d0ea6 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd.4f0df9a6-6820-4ec0-85db-4e0e5c571efd is being set with open permissions: ugo+rw Jul 11 04:39:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-40b4f1a7-e08e-4989-b4a9-a5a9f77d0ea6 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd.4f0df9a6-6820-4ec0-85db-4e0e5c571efd {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:39:12 devstack sudo[101760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd.4f0df9a6-6820-4ec0-85db-4e0e5c571efd Jul 11 04:39:12 devstack sudo[101760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:39:12 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root Jul 11 04:39:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-77c2c666-0131-47d2-821b-4a873e7f291b tempest-VolumesGetTest-1221404998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d281491f-d8f7-4056-886b-1504b6daee59" returned: 1 in 0.909s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:39:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-77c2c666-0131-47d2-821b-4a873e7f291b tempest-VolumesGetTest-1221404998 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d281491f-d8f7-4056-886b-1504b6daee59' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:39:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-77c2c666-0131-47d2-821b-4a873e7f291b tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d281491f-d8f7-4056-886b-1504b6daee59 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:39:12 devstack sudo[101765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d281491f-d8f7-4056-886b-1504b6daee59 Jul 11 04:39:12 devstack sudo[101765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:39:13 devstack sudo[101760]: pam_unix(sudo:session): session closed for user root Jul 11 04:39:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-40b4f1a7-e08e-4989-b4a9-a5a9f77d0ea6 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd.4f0df9a6-6820-4ec0-85db-4e0e5c571efd" returned: 0 in 0.929s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:39:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-40b4f1a7-e08e-4989-b4a9-a5a9f77d0ea6 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:39:13 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd.info Jul 11 04:39:13 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:39:13 devstack sudo[101765]: pam_unix(sudo:session): session closed for user root Jul 11 04:39:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-77c2c666-0131-47d2-821b-4a873e7f291b tempest-VolumesGetTest-1221404998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d281491f-d8f7-4056-886b-1504b6daee59" returned: 0 in 0.822s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:39:13 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-77c2c666-0131-47d2-821b-4a873e7f291b tempest-VolumesGetTest-1221404998 None] Lock "cinder-quobyte-d281491f-d8f7-4056-886b-1504b6daee59" released by "delete_volume" :: held 3.020s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:39:13 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-77c2c666-0131-47d2-821b-4a873e7f291b tempest-VolumesGetTest-1221404998 None] Created reservations ['9ab7ff29-dbae-457e-a52b-bbd84fc5bacb', '4845db6f-a5e3-4573-a032-1ba0d9720953', 'b0f1d092-9727-40b2-9db5-7583909e1805', '8c358e07-9d5b-4ec9-af12-7c097b01f33b'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:39:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-77c2c666-0131-47d2-821b-4a873e7f291b tempest-VolumesGetTest-1221404998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:39:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-77c2c666-0131-47d2-821b-4a873e7f291b tempest-VolumesGetTest-1221404998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:39:13 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-77c2c666-0131-47d2-821b-4a873e7f291b tempest-VolumesGetTest-1221404998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:39:13 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-77c2c666-0131-47d2-821b-4a873e7f291b tempest-VolumesGetTest-1221404998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:39:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-77c2c666-0131-47d2-821b-4a873e7f291b tempest-VolumesGetTest-1221404998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:39:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-77c2c666-0131-47d2-821b-4a873e7f291b tempest-VolumesGetTest-1221404998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:39:13 devstack sudo[101771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:39:13 devstack sudo[101771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:39:14 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Jul 11 04:39:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-40b4f1a7-e08e-4989-b4a9-a5a9f77d0ea6 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd.info" returned: 0 in 0.957s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:39:14 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-40b4f1a7-e08e-4989-b4a9-a5a9f77d0ea6 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd.info is being set with open permissions: ugo+rw Jul 11 04:39:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-40b4f1a7-e08e-4989-b4a9-a5a9f77d0ea6 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:39:14 devstack sudo[101774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd.info Jul 11 04:39:14 devstack sudo[101774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:39:14 devstack sudo[101771]: pam_unix(sudo:session): session closed for user root Jul 11 04:39:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-77c2c666-0131-47d2-821b-4a873e7f291b tempest-VolumesGetTest-1221404998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 1.221s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:39:14 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-77c2c666-0131-47d2-821b-4a873e7f291b tempest-VolumesGetTest-1221404998 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:39:14 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-77c2c666-0131-47d2-821b-4a873e7f291b tempest-VolumesGetTest-1221404998 None] Deleted volume successfully. Jul 11 04:39:14 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-77c2c666-0131-47d2-821b-4a873e7f291b tempest-VolumesGetTest-1221404998 None] Lock "cinder-d281491f-d8f7-4056-886b-1504b6daee59-delete_volume" released by "delete_volume" :: held 4.632s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:39:15 devstack sudo[101774]: pam_unix(sudo:session): session closed for user root Jul 11 04:39:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-40b4f1a7-e08e-4989-b4a9-a5a9f77d0ea6 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd.info" returned: 0 in 0.945s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:39:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-40b4f1a7-e08e-4989-b4a9-a5a9f77d0ea6 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.761s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:39:15 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-40b4f1a7-e08e-4989-b4a9-a5a9f77d0ea6 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Create snapshot completed successfully Jul 11 04:39:15 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-147d7dfc-a81c-4c92-a1d8-b0aa41fb5652 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Acquiring lock "cinder-4f0df9a6-6820-4ec0-85db-4e0e5c571efd-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:39:15 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-147d7dfc-a81c-4c92-a1d8-b0aa41fb5652 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Lock "cinder-4f0df9a6-6820-4ec0-85db-4e0e5c571efd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:39:15 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-147d7dfc-a81c-4c92-a1d8-b0aa41fb5652 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Acquiring lock "cinder-quobyte-6936d278-4c61-4eff-8f74-b25ed083b4fd" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:39:15 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-147d7dfc-a81c-4c92-a1d8-b0aa41fb5652 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Lock "cinder-quobyte-6936d278-4c61-4eff-8f74-b25ed083b4fd" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:39:15 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-147d7dfc-a81c-4c92-a1d8-b0aa41fb5652 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Acquiring lock "cinder-quobyte-4f0df9a6-6820-4ec0-85db-4e0e5c571efd" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:39:15 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-147d7dfc-a81c-4c92-a1d8-b0aa41fb5652 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Lock "cinder-quobyte-4f0df9a6-6820-4ec0-85db-4e0e5c571efd" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:39:15 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-147d7dfc-a81c-4c92-a1d8-b0aa41fb5652 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Deleting offline snapshot 4f0df9a6-6820-4ec0-85db-4e0e5c571efd of volume 6936d278-4c61-4eff-8f74-b25ed083b4fd {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:39:15 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-147d7dfc-a81c-4c92-a1d8-b0aa41fb5652 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] snapshot_file for this snap is: volume-6936d278-4c61-4eff-8f74-b25ed083b4fd.4f0df9a6-6820-4ec0-85db-4e0e5c571efd {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:39:15 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9502edc-f29b-4130-9557-4e5d7a1f95ad]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:39:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-147d7dfc-a81c-4c92-a1d8-b0aa41fb5652 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd.4f0df9a6-6820-4ec0-85db-4e0e5c571efd {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:39:16 devstack sudo[101781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd.4f0df9a6-6820-4ec0-85db-4e0e5c571efd Jul 11 04:39:16 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:39:16 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root Jul 11 04:39:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-147d7dfc-a81c-4c92-a1d8-b0aa41fb5652 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd.4f0df9a6-6820-4ec0-85db-4e0e5c571efd" returned: 0 in 0.912s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:39:16 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-147d7dfc-a81c-4c92-a1d8-b0aa41fb5652 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6936d278-4c61-4eff-8f74-b25ed083b4fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:39:16 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66e931f-af20-4abb-b0f6-39d61ee8e591]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:39:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-147d7dfc-a81c-4c92-a1d8-b0aa41fb5652 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:39:17 devstack sudo[101787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd Jul 11 04:39:17 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:39:17 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3a4ba27-eff7-4c59-b584-58eae0a53016 tempest-VolumesNegativeTest-1818299736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:39:17 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a3a4ba27-eff7-4c59-b584-58eae0a53016 tempest-VolumesNegativeTest-1818299736 None] Flow 'volume_create_manager' (e3b59cbc-cb6e-42dd-9e8b-116ada8f975d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:39:17 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a3a4ba27-eff7-4c59-b584-58eae0a53016 tempest-VolumesNegativeTest-1818299736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005a4a14-a16c-4924-a138-0e7b8ab96165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:39:17 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a3a4ba27-eff7-4c59-b584-58eae0a53016 tempest-VolumesNegativeTest-1818299736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005a4a14-a16c-4924-a138-0e7b8ab96165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:39:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-519224941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44ec46d6-a51a-498d-9533-fa1cedbebdfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1511e8a0e6e34313b696875bf5231ef0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:39:17Z,use_quota=True,user_id='6b9d97e241f04f8ab18da1a900d75385',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:39:17 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a3a4ba27-eff7-4c59-b584-58eae0a53016 tempest-VolumesNegativeTest-1818299736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bbfb485-7634-48eb-9ea4-68ba7c49cf0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:39:17 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a3a4ba27-eff7-4c59-b584-58eae0a53016 tempest-VolumesNegativeTest-1818299736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bbfb485-7634-48eb-9ea4-68ba7c49cf0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:39:17 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a3a4ba27-eff7-4c59-b584-58eae0a53016 tempest-VolumesNegativeTest-1818299736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ef81247-e125-4121-9b27-90cd2e35fa8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:39:17 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a3a4ba27-eff7-4c59-b584-58eae0a53016 tempest-VolumesNegativeTest-1818299736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ef81247-e125-4121-9b27-90cd2e35fa8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44ec46d6-a51a-498d-9533-fa1cedbebdfd', 'volume_name': 'volume-44ec46d6-a51a-498d-9533-fa1cedbebdfd', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:39:17 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a3a4ba27-eff7-4c59-b584-58eae0a53016 tempest-VolumesNegativeTest-1818299736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (244f9c1e-5dd5-496b-87cf-556709c1fd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:39:17 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a3a4ba27-eff7-4c59-b584-58eae0a53016 tempest-VolumesNegativeTest-1818299736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (244f9c1e-5dd5-496b-87cf-556709c1fd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:39:17 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a3a4ba27-eff7-4c59-b584-58eae0a53016 tempest-VolumesNegativeTest-1818299736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bb7889b-93ae-4354-8666-7739b014b154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:39:17 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-a3a4ba27-eff7-4c59-b584-58eae0a53016 tempest-VolumesNegativeTest-1818299736 None] Volume 44ec46d6-a51a-498d-9533-fa1cedbebdfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44ec46d6-a51a-498d-9533-fa1cedbebdfd', 'volume_size': 1} Jul 11 04:39:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a3a4ba27-eff7-4c59-b584-58eae0a53016 tempest-VolumesNegativeTest-1818299736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:39:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a3a4ba27-eff7-4c59-b584-58eae0a53016 tempest-VolumesNegativeTest-1818299736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:39:17 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-a3a4ba27-eff7-4c59-b584-58eae0a53016 tempest-VolumesNegativeTest-1818299736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:39:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-519224941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44ec46d6-a51a-498d-9533-fa1cedbebdfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1511e8a0e6e34313b696875bf5231ef0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:39:17Z,use_quota=True,user_id='6b9d97e241f04f8ab18da1a900d75385',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:39:17 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-a3a4ba27-eff7-4c59-b584-58eae0a53016 tempest-VolumesNegativeTest-1818299736 None] Creating volume 44ec46d6-a51a-498d-9533-fa1cedbebdfd {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:39:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a3a4ba27-eff7-4c59-b584-58eae0a53016 tempest-VolumesNegativeTest-1818299736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:39:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a3a4ba27-eff7-4c59-b584-58eae0a53016 tempest-VolumesNegativeTest-1818299736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:39:17 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-a3a4ba27-eff7-4c59-b584-58eae0a53016 tempest-VolumesNegativeTest-1818299736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:39:17 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-a3a4ba27-eff7-4c59-b584-58eae0a53016 tempest-VolumesNegativeTest-1818299736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:39:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a3a4ba27-eff7-4c59-b584-58eae0a53016 tempest-VolumesNegativeTest-1818299736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:39:17 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-a3a4ba27-eff7-4c59-b584-58eae0a53016 tempest-VolumesNegativeTest-1818299736 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:39:17 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-a3a4ba27-eff7-4c59-b584-58eae0a53016 tempest-VolumesNegativeTest-1818299736 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:39:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a3a4ba27-eff7-4c59-b584-58eae0a53016 tempest-VolumesNegativeTest-1818299736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-44ec46d6-a51a-498d-9533-fa1cedbebdfd 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:39:17 devstack sudo[101790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-44ec46d6-a51a-498d-9533-fa1cedbebdfd 1073741824 Jul 11 04:39:17 devstack sudo[101790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:39:17 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root Jul 11 04:39:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-147d7dfc-a81c-4c92-a1d8-b0aa41fb5652 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd" returned: 0 in 0.850s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:39:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-147d7dfc-a81c-4c92-a1d8-b0aa41fb5652 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd.4f0df9a6-6820-4ec0-85db-4e0e5c571efd {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:39:17 devstack sudo[101795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd.4f0df9a6-6820-4ec0-85db-4e0e5c571efd Jul 11 04:39:17 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:39:18 devstack sudo[101790]: pam_unix(sudo:session): session closed for user root Jul 11 04:39:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a3a4ba27-eff7-4c59-b584-58eae0a53016 tempest-VolumesNegativeTest-1818299736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-44ec46d6-a51a-498d-9533-fa1cedbebdfd 1073741824" returned: 0 in 0.865s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:39:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a3a4ba27-eff7-4c59-b584-58eae0a53016 tempest-VolumesNegativeTest-1818299736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-44ec46d6-a51a-498d-9533-fa1cedbebdfd {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:39:18 devstack sudo[101800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-44ec46d6-a51a-498d-9533-fa1cedbebdfd Jul 11 04:39:18 devstack sudo[101800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:39:18 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root Jul 11 04:39:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-147d7dfc-a81c-4c92-a1d8-b0aa41fb5652 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd.4f0df9a6-6820-4ec0-85db-4e0e5c571efd" returned: 0 in 0.772s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:39:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-147d7dfc-a81c-4c92-a1d8-b0aa41fb5652 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd.4f0df9a6-6820-4ec0-85db-4e0e5c571efd {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:39:18 devstack sudo[101806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd.4f0df9a6-6820-4ec0-85db-4e0e5c571efd Jul 11 04:39:18 devstack sudo[101806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:39:18 devstack sudo[101800]: pam_unix(sudo:session): session closed for user root Jul 11 04:39:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a3a4ba27-eff7-4c59-b584-58eae0a53016 tempest-VolumesNegativeTest-1818299736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-44ec46d6-a51a-498d-9533-fa1cedbebdfd" returned: 0 in 0.666s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:39:18 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-a3a4ba27-eff7-4c59-b584-58eae0a53016 tempest-VolumesNegativeTest-1818299736 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:39:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a3a4ba27-eff7-4c59-b584-58eae0a53016 tempest-VolumesNegativeTest-1818299736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:39:18 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a3a4ba27-eff7-4c59-b584-58eae0a53016 tempest-VolumesNegativeTest-1818299736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bb7889b-93ae-4354-8666-7739b014b154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44ec46d6-a51a-498d-9533-fa1cedbebdfd', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:39:18 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a3a4ba27-eff7-4c59-b584-58eae0a53016 tempest-VolumesNegativeTest-1818299736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df3a12fc-4b6c-4fd9-bce9-a2b5c5b3fc23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:39:18 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-a3a4ba27-eff7-4c59-b584-58eae0a53016 tempest-VolumesNegativeTest-1818299736 None] Volume volume-44ec46d6-a51a-498d-9533-fa1cedbebdfd (44ec46d6-a51a-498d-9533-fa1cedbebdfd): created successfully Jul 11 04:39:18 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a3a4ba27-eff7-4c59-b584-58eae0a53016 tempest-VolumesNegativeTest-1818299736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df3a12fc-4b6c-4fd9-bce9-a2b5c5b3fc23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:39:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a3a4ba27-eff7-4c59-b584-58eae0a53016 tempest-VolumesNegativeTest-1818299736 None] Flow 'volume_create_manager' (e3b59cbc-cb6e-42dd-9e8b-116ada8f975d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:39:19 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-a3a4ba27-eff7-4c59-b584-58eae0a53016 tempest-VolumesNegativeTest-1818299736 None] Created volume successfully. Jul 11 04:39:19 devstack sudo[101806]: pam_unix(sudo:session): session closed for user root Jul 11 04:39:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-147d7dfc-a81c-4c92-a1d8-b0aa41fb5652 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd.4f0df9a6-6820-4ec0-85db-4e0e5c571efd" returned: 0 in 0.657s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:39:19 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-147d7dfc-a81c-4c92-a1d8-b0aa41fb5652 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Lock "cinder-quobyte-4f0df9a6-6820-4ec0-85db-4e0e5c571efd" released by "_delete_snapshot" :: held 3.319s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:39:19 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-147d7dfc-a81c-4c92-a1d8-b0aa41fb5652 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Lock "cinder-quobyte-6936d278-4c61-4eff-8f74-b25ed083b4fd" released by "delete_snapshot" :: held 3.357s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:39:19 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-147d7dfc-a81c-4c92-a1d8-b0aa41fb5652 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Created reservations ['4f3243ba-2b1f-4107-ac0b-731d394ff4af', '0473a324-8597-43fb-9365-2b0fb1d36ff6', '87763a93-65af-4372-b6d9-9b15094912ab', '7133990e-325d-452b-9bf3-1948f7d31009'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:39:19 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-147d7dfc-a81c-4c92-a1d8-b0aa41fb5652 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Delete snapshot completed successfully. Jul 11 04:39:19 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-147d7dfc-a81c-4c92-a1d8-b0aa41fb5652 tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Lock "cinder-4f0df9a6-6820-4ec0-85db-4e0e5c571efd-delete_snapshot" released by "delete_snapshot" :: held 3.541s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:39:20 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-0ec1afe6-052e-4490-9ed0-a6ac8bf5331e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Acquiring lock "cinder-6936d278-4c61-4eff-8f74-b25ed083b4fd-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:39:20 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-0ec1afe6-052e-4490-9ed0-a6ac8bf5331e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Lock "cinder-6936d278-4c61-4eff-8f74-b25ed083b4fd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:39:20 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-0ec1afe6-052e-4490-9ed0-a6ac8bf5331e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Acquiring lock "cinder-quobyte-6936d278-4c61-4eff-8f74-b25ed083b4fd" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:39:20 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-0ec1afe6-052e-4490-9ed0-a6ac8bf5331e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Lock "cinder-quobyte-6936d278-4c61-4eff-8f74-b25ed083b4fd" acquired by "delete_volume" :: waited 0.014s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:39:20 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f16079-64d5-4d3c-b083-7bb9eb51fa6c]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:39:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-0ec1afe6-052e-4490-9ed0-a6ac8bf5331e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:39:20 devstack sudo[101819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd Jul 11 04:39:20 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:39:21 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root Jul 11 04:39:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-0ec1afe6-052e-4490-9ed0-a6ac8bf5331e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd" returned: 0 in 0.829s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:39:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-0ec1afe6-052e-4490-9ed0-a6ac8bf5331e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:39:21 devstack sudo[101824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd Jul 11 04:39:21 devstack sudo[101824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:39:21 devstack sudo[101824]: pam_unix(sudo:session): session closed for user root Jul 11 04:39:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-0ec1afe6-052e-4490-9ed0-a6ac8bf5331e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6936d278-4c61-4eff-8f74-b25ed083b4fd" returned: 0 in 0.664s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:39:21 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-0ec1afe6-052e-4490-9ed0-a6ac8bf5331e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Lock "cinder-quobyte-6936d278-4c61-4eff-8f74-b25ed083b4fd" released by "delete_volume" :: held 1.547s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:39:21 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-0ec1afe6-052e-4490-9ed0-a6ac8bf5331e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Created reservations ['2e615c34-86f2-49e5-8d33-7db4599ddaee', 'f1a3f4bf-092c-48b1-b1cb-cace519161bd', '5c495858-1feb-49a7-82f2-4fca2e734d02', 'd7188b5e-539e-4dac-835d-be1c515fb90d'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:39:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-0ec1afe6-052e-4490-9ed0-a6ac8bf5331e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:39:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-0ec1afe6-052e-4490-9ed0-a6ac8bf5331e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:39:21 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-0ec1afe6-052e-4490-9ed0-a6ac8bf5331e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:39:21 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-0ec1afe6-052e-4490-9ed0-a6ac8bf5331e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:39:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-0ec1afe6-052e-4490-9ed0-a6ac8bf5331e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:39:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-0ec1afe6-052e-4490-9ed0-a6ac8bf5331e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:39:22 devstack sudo[101827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:39:22 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:39:22 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root Jul 11 04:39:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-0ec1afe6-052e-4490-9ed0-a6ac8bf5331e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.707s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:39:22 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-0ec1afe6-052e-4490-9ed0-a6ac8bf5331e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:39:22 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-0ec1afe6-052e-4490-9ed0-a6ac8bf5331e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Deleted volume successfully. Jul 11 04:39:22 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-0ec1afe6-052e-4490-9ed0-a6ac8bf5331e tempest-VolumesSnapshotNegativeTestJSON-270072689 None] Lock "cinder-6936d278-4c61-4eff-8f74-b25ed083b4fd-delete_volume" released by "delete_volume" :: held 2.468s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:39:31 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:UPDATE=116,cinder:SELECT=104,cinder:INSERT=33,cinder:DELETE=10 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:39:32 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=30,cinder:UPDATE=42,cinder:DELETE=4,cinder:INSERT=10 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:39:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-4540dff3-cbf4-4987-aa8d-ba88f443ff3b req-4124f567-a4a0-4a4d-adf1-b9475c0851ff tempest-TestStampPattern-25865344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:39:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-4540dff3-cbf4-4987-aa8d-ba88f443ff3b req-4124f567-a4a0-4a4d-adf1-b9475c0851ff tempest-TestStampPattern-25865344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:39:41 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c2102f-4560-4b65-9d2c-c01caf0e22b4]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:39:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-4540dff3-cbf4-4987-aa8d-ba88f443ff3b req-4124f567-a4a0-4a4d-adf1-b9475c0851ff tempest-TestStampPattern-25865344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4f953588-501b-44cf-bd36-e83a5a74bfbe {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:39:42 devstack sudo[101964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4f953588-501b-44cf-bd36-e83a5a74bfbe Jul 11 04:39:42 devstack sudo[101964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:39:42 devstack sudo[101964]: pam_unix(sudo:session): session closed for user root Jul 11 04:39:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-4540dff3-cbf4-4987-aa8d-ba88f443ff3b req-4124f567-a4a0-4a4d-adf1-b9475c0851ff tempest-TestStampPattern-25865344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4f953588-501b-44cf-bd36-e83a5a74bfbe" returned: 0 in 0.852s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:39:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-4540dff3-cbf4-4987-aa8d-ba88f443ff3b req-4124f567-a4a0-4a4d-adf1-b9475c0851ff tempest-TestStampPattern-25865344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.870s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:39:42 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-4540dff3-cbf4-4987-aa8d-ba88f443ff3b req-4124f567-a4a0-4a4d-adf1-b9475c0851ff tempest-TestStampPattern-25865344 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95', 'name': 'volume-4f953588-501b-44cf-bd36-e83a5a74bfbe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd819ff56-b598-4df7-8a36-cdba3ee63e2b', 'enforce_multipath': True} {{(pid=86964) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 04:39:42 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-4540dff3-cbf4-4987-aa8d-ba88f443ff3b req-4124f567-a4a0-4a4d-adf1-b9475c0851ff tempest-TestStampPattern-25865344 None] attachment_update completed successfully. Jul 11 04:39:49 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4aae0c0b-3914-45ce-8088-b4851866c20e tempest-VolumesNegativeTest-1818299736 None] Acquiring lock "cinder-44ec46d6-a51a-498d-9533-fa1cedbebdfd-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:39:49 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4aae0c0b-3914-45ce-8088-b4851866c20e tempest-VolumesNegativeTest-1818299736 None] Lock "cinder-44ec46d6-a51a-498d-9533-fa1cedbebdfd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:39:49 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4aae0c0b-3914-45ce-8088-b4851866c20e tempest-VolumesNegativeTest-1818299736 None] Acquiring lock "cinder-quobyte-44ec46d6-a51a-498d-9533-fa1cedbebdfd" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:39:49 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4aae0c0b-3914-45ce-8088-b4851866c20e tempest-VolumesNegativeTest-1818299736 None] Lock "cinder-quobyte-44ec46d6-a51a-498d-9533-fa1cedbebdfd" acquired by "delete_volume" :: waited 0.030s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:39:49 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cd690a-1b1a-4ba0-b3a5-af8a8b78113f]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:39:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4aae0c0b-3914-45ce-8088-b4851866c20e tempest-VolumesNegativeTest-1818299736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-44ec46d6-a51a-498d-9533-fa1cedbebdfd {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:39:49 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-a0b88734-a56b-4cc8-ab9a-7c1d6d5059e5 req-bc78c90c-6b28-47ac-b44a-482961da8d56 tempest-TestStampPattern-25865344 None] Terminate volume connection completed successfully. Jul 11 04:39:49 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-a0b88734-a56b-4cc8-ab9a-7c1d6d5059e5 req-bc78c90c-6b28-47ac-b44a-482961da8d56 tempest-TestStampPattern-25865344 None] Deleting attachment d819ff56-b598-4df7-8a36-cdba3ee63e2b. {{(pid=86964) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 04:39:49 devstack sudo[102399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-44ec46d6-a51a-498d-9533-fa1cedbebdfd Jul 11 04:39:49 devstack sudo[102399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:39:50 devstack sudo[102399]: pam_unix(sudo:session): session closed for user root Jul 11 04:39:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4aae0c0b-3914-45ce-8088-b4851866c20e tempest-VolumesNegativeTest-1818299736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-44ec46d6-a51a-498d-9533-fa1cedbebdfd" returned: 0 in 0.816s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:39:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4aae0c0b-3914-45ce-8088-b4851866c20e tempest-VolumesNegativeTest-1818299736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-44ec46d6-a51a-498d-9533-fa1cedbebdfd {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:39:50 devstack sudo[102404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-44ec46d6-a51a-498d-9533-fa1cedbebdfd Jul 11 04:39:50 devstack sudo[102404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:39:51 devstack sudo[102404]: pam_unix(sudo:session): session closed for user root Jul 11 04:39:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4aae0c0b-3914-45ce-8088-b4851866c20e tempest-VolumesNegativeTest-1818299736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-44ec46d6-a51a-498d-9533-fa1cedbebdfd" returned: 0 in 0.682s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:39:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4aae0c0b-3914-45ce-8088-b4851866c20e tempest-VolumesNegativeTest-1818299736 None] Lock "cinder-quobyte-44ec46d6-a51a-498d-9533-fa1cedbebdfd" released by "delete_volume" :: held 1.557s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:39:51 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-4aae0c0b-3914-45ce-8088-b4851866c20e tempest-VolumesNegativeTest-1818299736 None] Created reservations ['f1be53ab-b033-42ae-bd71-86fcab8b0f6c', 'a6dd20b4-0b4b-42c8-92b9-3d58cfb19f19', '8780f6b6-9c0d-4e3a-b380-8d09269a6d38', '68f5e9e9-2c10-442a-89ec-d0eeb378540c'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:39:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4aae0c0b-3914-45ce-8088-b4851866c20e tempest-VolumesNegativeTest-1818299736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:39:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4aae0c0b-3914-45ce-8088-b4851866c20e tempest-VolumesNegativeTest-1818299736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:39:51 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4aae0c0b-3914-45ce-8088-b4851866c20e tempest-VolumesNegativeTest-1818299736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:39:51 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4aae0c0b-3914-45ce-8088-b4851866c20e tempest-VolumesNegativeTest-1818299736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:39:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4aae0c0b-3914-45ce-8088-b4851866c20e tempest-VolumesNegativeTest-1818299736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:39:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4aae0c0b-3914-45ce-8088-b4851866c20e tempest-VolumesNegativeTest-1818299736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:39:51 devstack sudo[102407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:39:51 devstack sudo[102407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:39:52 devstack sudo[102407]: pam_unix(sudo:session): session closed for user root Jul 11 04:39:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4aae0c0b-3914-45ce-8088-b4851866c20e tempest-VolumesNegativeTest-1818299736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.701s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:39:52 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-4aae0c0b-3914-45ce-8088-b4851866c20e tempest-VolumesNegativeTest-1818299736 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:39:52 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-4aae0c0b-3914-45ce-8088-b4851866c20e tempest-VolumesNegativeTest-1818299736 None] Deleted volume successfully. Jul 11 04:39:52 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4aae0c0b-3914-45ce-8088-b4851866c20e tempest-VolumesNegativeTest-1818299736 None] Lock "cinder-44ec46d6-a51a-498d-9533-fa1cedbebdfd-delete_volume" released by "delete_volume" :: held 2.565s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:39:59 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:39:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:39:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:39:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:39:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:39:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:39:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:39:59 devstack sudo[102445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:39:59 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:39:59 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-61beedad-1dea-4919-a4e5-dd94cb490c12 tempest-TestStampPattern-25865344 None] Acquiring lock "cinder-4f953588-501b-44cf-bd36-e83a5a74bfbe-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:39:59 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-61beedad-1dea-4919-a4e5-dd94cb490c12 tempest-TestStampPattern-25865344 None] Lock "cinder-4f953588-501b-44cf-bd36-e83a5a74bfbe-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:39:59 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-61beedad-1dea-4919-a4e5-dd94cb490c12 tempest-TestStampPattern-25865344 None] Acquiring lock "cinder-quobyte-4f953588-501b-44cf-bd36-e83a5a74bfbe" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:39:59 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-61beedad-1dea-4919-a4e5-dd94cb490c12 tempest-TestStampPattern-25865344 None] Lock "cinder-quobyte-4f953588-501b-44cf-bd36-e83a5a74bfbe" acquired by "delete_volume" :: waited 0.028s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:40:00 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc047ed0-e21c-415f-9e0a-7c82f17f07f4]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:40:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-61beedad-1dea-4919-a4e5-dd94cb490c12 tempest-TestStampPattern-25865344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4f953588-501b-44cf-bd36-e83a5a74bfbe {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:00 devstack sudo[102463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4f953588-501b-44cf-bd36-e83a5a74bfbe Jul 11 04:40:00 devstack sudo[102463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:00 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 1.132s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:00 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:40:00 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager._thread_info {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:40:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread count: 28 {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:40:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread info: [<_MainThread(MainThread, started 124675027595392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:40:01 devstack sudo[102463]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-61beedad-1dea-4919-a4e5-dd94cb490c12 tempest-TestStampPattern-25865344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4f953588-501b-44cf-bd36-e83a5a74bfbe" returned: 0 in 0.991s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-61beedad-1dea-4919-a4e5-dd94cb490c12 tempest-TestStampPattern-25865344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4f953588-501b-44cf-bd36-e83a5a74bfbe {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:01 devstack sudo[102484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4f953588-501b-44cf-bd36-e83a5a74bfbe Jul 11 04:40:01 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:01 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-61beedad-1dea-4919-a4e5-dd94cb490c12 tempest-TestStampPattern-25865344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4f953588-501b-44cf-bd36-e83a5a74bfbe" returned: 0 in 0.733s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:01 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-61beedad-1dea-4919-a4e5-dd94cb490c12 tempest-TestStampPattern-25865344 None] Lock "cinder-quobyte-4f953588-501b-44cf-bd36-e83a5a74bfbe" released by "delete_volume" :: held 1.793s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:40:01 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-61beedad-1dea-4919-a4e5-dd94cb490c12 tempest-TestStampPattern-25865344 None] Created reservations ['8f540779-41b6-4d45-81a6-d4bb0f51c6ca', 'c7b81cfd-4b98-4da5-ba21-7edf17b93fd8', 'a7ee1f8e-47a4-4e51-a188-eaedfc49a9e7', '2ee66f97-c11b-494a-aecf-8a08f2681e44'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:40:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-61beedad-1dea-4919-a4e5-dd94cb490c12 tempest-TestStampPattern-25865344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:40:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-61beedad-1dea-4919-a4e5-dd94cb490c12 tempest-TestStampPattern-25865344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:40:01 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-61beedad-1dea-4919-a4e5-dd94cb490c12 tempest-TestStampPattern-25865344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:40:01 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-61beedad-1dea-4919-a4e5-dd94cb490c12 tempest-TestStampPattern-25865344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:40:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-61beedad-1dea-4919-a4e5-dd94cb490c12 tempest-TestStampPattern-25865344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:40:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-61beedad-1dea-4919-a4e5-dd94cb490c12 tempest-TestStampPattern-25865344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:01 devstack sudo[102489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:40:01 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:02 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1f196d2e-873f-452d-b96f-17ad0586b33e tempest-TestStampPattern-25865344 None] Acquiring lock "cinder-5abeb1fa-bed6-4e15-814f-dd8b56d2c774-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:40:02 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1f196d2e-873f-452d-b96f-17ad0586b33e tempest-TestStampPattern-25865344 None] Lock "cinder-5abeb1fa-bed6-4e15-814f-dd8b56d2c774-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:40:02 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1f196d2e-873f-452d-b96f-17ad0586b33e tempest-TestStampPattern-25865344 None] Acquiring lock "cinder-quobyte-45f7be47-35fe-47b5-9b29-102708f56eb0" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:40:02 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1f196d2e-873f-452d-b96f-17ad0586b33e tempest-TestStampPattern-25865344 None] Lock "cinder-quobyte-45f7be47-35fe-47b5-9b29-102708f56eb0" acquired by "delete_snapshot" :: waited 0.055s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:40:02 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1f196d2e-873f-452d-b96f-17ad0586b33e tempest-TestStampPattern-25865344 None] Acquiring lock "cinder-quobyte-5abeb1fa-bed6-4e15-814f-dd8b56d2c774" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:40:02 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1f196d2e-873f-452d-b96f-17ad0586b33e tempest-TestStampPattern-25865344 None] Lock "cinder-quobyte-5abeb1fa-bed6-4e15-814f-dd8b56d2c774" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:40:02 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-1f196d2e-873f-452d-b96f-17ad0586b33e tempest-TestStampPattern-25865344 None] Deleting offline snapshot 5abeb1fa-bed6-4e15-814f-dd8b56d2c774 of volume 45f7be47-35fe-47b5-9b29-102708f56eb0 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:40:02 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-1f196d2e-873f-452d-b96f-17ad0586b33e tempest-TestStampPattern-25865344 None] snapshot_file for this snap is: volume-45f7be47-35fe-47b5-9b29-102708f56eb0.5abeb1fa-bed6-4e15-814f-dd8b56d2c774 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:40:03 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb38efa2-b793-4d22-8168-c398636a6986]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:40:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1f196d2e-873f-452d-b96f-17ad0586b33e tempest-TestStampPattern-25865344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0.5abeb1fa-bed6-4e15-814f-dd8b56d2c774 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:03 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-61beedad-1dea-4919-a4e5-dd94cb490c12 tempest-TestStampPattern-25865344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 1.231s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:03 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-61beedad-1dea-4919-a4e5-dd94cb490c12 tempest-TestStampPattern-25865344 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:40:03 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-61beedad-1dea-4919-a4e5-dd94cb490c12 tempest-TestStampPattern-25865344 None] Deleted volume successfully. Jul 11 04:40:03 devstack sudo[102530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0.5abeb1fa-bed6-4e15-814f-dd8b56d2c774 Jul 11 04:40:03 devstack sudo[102530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:03 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-61beedad-1dea-4919-a4e5-dd94cb490c12 tempest-TestStampPattern-25865344 None] Lock "cinder-4f953588-501b-44cf-bd36-e83a5a74bfbe-delete_volume" released by "delete_volume" :: held 3.324s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:40:04 devstack sudo[102530]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1f196d2e-873f-452d-b96f-17ad0586b33e tempest-TestStampPattern-25865344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0.5abeb1fa-bed6-4e15-814f-dd8b56d2c774" returned: 0 in 1.080s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:04 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-1f196d2e-873f-452d-b96f-17ad0586b33e tempest-TestStampPattern-25865344 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45f7be47-35fe-47b5-9b29-102708f56eb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:40:04 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d621e8-f49c-4bad-906f-cf650fa0d24b]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:40:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1f196d2e-873f-452d-b96f-17ad0586b33e tempest-TestStampPattern-25865344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:04 devstack sudo[102567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0 Jul 11 04:40:04 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:05 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1f196d2e-873f-452d-b96f-17ad0586b33e tempest-TestStampPattern-25865344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0" returned: 0 in 1.036s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1f196d2e-873f-452d-b96f-17ad0586b33e tempest-TestStampPattern-25865344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0.5abeb1fa-bed6-4e15-814f-dd8b56d2c774 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:05 devstack sudo[102574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0.5abeb1fa-bed6-4e15-814f-dd8b56d2c774 Jul 11 04:40:05 devstack sudo[102574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:06 devstack sudo[102574]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1f196d2e-873f-452d-b96f-17ad0586b33e tempest-TestStampPattern-25865344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0.5abeb1fa-bed6-4e15-814f-dd8b56d2c774" returned: 0 in 1.401s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1f196d2e-873f-452d-b96f-17ad0586b33e tempest-TestStampPattern-25865344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0.5abeb1fa-bed6-4e15-814f-dd8b56d2c774 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:06 devstack sudo[102616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0.5abeb1fa-bed6-4e15-814f-dd8b56d2c774 Jul 11 04:40:06 devstack sudo[102616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:07 devstack sudo[102616]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1f196d2e-873f-452d-b96f-17ad0586b33e tempest-TestStampPattern-25865344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0.5abeb1fa-bed6-4e15-814f-dd8b56d2c774" returned: 0 in 0.751s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:07 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1f196d2e-873f-452d-b96f-17ad0586b33e tempest-TestStampPattern-25865344 None] Lock "cinder-quobyte-5abeb1fa-bed6-4e15-814f-dd8b56d2c774" released by "_delete_snapshot" :: held 4.427s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:40:07 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1f196d2e-873f-452d-b96f-17ad0586b33e tempest-TestStampPattern-25865344 None] Lock "cinder-quobyte-45f7be47-35fe-47b5-9b29-102708f56eb0" released by "delete_snapshot" :: held 4.478s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:40:07 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-1f196d2e-873f-452d-b96f-17ad0586b33e tempest-TestStampPattern-25865344 None] Created reservations ['9f063fc8-0206-4a27-b834-b3f1e4251adb', '32c69fe6-cbff-4cff-a235-176b7ced729d', 'bb65b199-7df8-43bf-aa35-40e8abcf1b1f', 'aa9755b0-1d30-4720-a4c0-6f626686a75b'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:40:07 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-1f196d2e-873f-452d-b96f-17ad0586b33e tempest-TestStampPattern-25865344 None] Delete snapshot completed successfully. Jul 11 04:40:07 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1f196d2e-873f-452d-b96f-17ad0586b33e tempest-TestStampPattern-25865344 None] Lock "cinder-5abeb1fa-bed6-4e15-814f-dd8b56d2c774-delete_snapshot" released by "delete_snapshot" :: held 4.814s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:40:10 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-b74eebce-868b-499a-8dae-a583c43f5d54 tempest-TestMinimumBasicScenario-1346514318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:40:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b74eebce-868b-499a-8dae-a583c43f5d54 tempest-TestMinimumBasicScenario-1346514318 None] Flow 'volume_create_manager' (2d7f9895-ee0a-4ef9-a9c9-97c90e9a93f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:40:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b74eebce-868b-499a-8dae-a583c43f5d54 tempest-TestMinimumBasicScenario-1346514318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df532b1a-f263-4a84-85f8-cac8681d38b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:40:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b74eebce-868b-499a-8dae-a583c43f5d54 tempest-TestMinimumBasicScenario-1346514318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df532b1a-f263-4a84-85f8-cac8681d38b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1994942331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d77e62d-c5f1-4ed0-86db-665d0b01bcca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e2a52c09a424ec08085ada545aff9af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:40:10Z,use_quota=True,user_id='7d312383424f4007b9fb9a3660427c1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:40:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b74eebce-868b-499a-8dae-a583c43f5d54 tempest-TestMinimumBasicScenario-1346514318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45317224-9bfb-478a-b4cb-0a7c62c35681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:40:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b74eebce-868b-499a-8dae-a583c43f5d54 tempest-TestMinimumBasicScenario-1346514318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45317224-9bfb-478a-b4cb-0a7c62c35681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:40:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b74eebce-868b-499a-8dae-a583c43f5d54 tempest-TestMinimumBasicScenario-1346514318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d964744-6c62-4a11-95b8-193ad7fd7477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:40:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b74eebce-868b-499a-8dae-a583c43f5d54 tempest-TestMinimumBasicScenario-1346514318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d964744-6c62-4a11-95b8-193ad7fd7477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d77e62d-c5f1-4ed0-86db-665d0b01bcca', 'volume_name': 'volume-0d77e62d-c5f1-4ed0-86db-665d0b01bcca', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:40:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b74eebce-868b-499a-8dae-a583c43f5d54 tempest-TestMinimumBasicScenario-1346514318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02bb1602-4dc2-47aa-b56d-f3d2b30c430a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:40:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b74eebce-868b-499a-8dae-a583c43f5d54 tempest-TestMinimumBasicScenario-1346514318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02bb1602-4dc2-47aa-b56d-f3d2b30c430a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:40:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b74eebce-868b-499a-8dae-a583c43f5d54 tempest-TestMinimumBasicScenario-1346514318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8be1a669-bfa5-4c9f-b8e6-6f7c5957ceef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:40:10 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-b74eebce-868b-499a-8dae-a583c43f5d54 tempest-TestMinimumBasicScenario-1346514318 None] Volume 0d77e62d-c5f1-4ed0-86db-665d0b01bcca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d77e62d-c5f1-4ed0-86db-665d0b01bcca', 'volume_size': 1} Jul 11 04:40:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b74eebce-868b-499a-8dae-a583c43f5d54 tempest-TestMinimumBasicScenario-1346514318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:40:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b74eebce-868b-499a-8dae-a583c43f5d54 tempest-TestMinimumBasicScenario-1346514318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:40:10 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b74eebce-868b-499a-8dae-a583c43f5d54 tempest-TestMinimumBasicScenario-1346514318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1994942331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d77e62d-c5f1-4ed0-86db-665d0b01bcca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e2a52c09a424ec08085ada545aff9af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:40:10Z,use_quota=True,user_id='7d312383424f4007b9fb9a3660427c1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:40:10 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-b74eebce-868b-499a-8dae-a583c43f5d54 tempest-TestMinimumBasicScenario-1346514318 None] Creating volume 0d77e62d-c5f1-4ed0-86db-665d0b01bcca {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:40:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b74eebce-868b-499a-8dae-a583c43f5d54 tempest-TestMinimumBasicScenario-1346514318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:40:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b74eebce-868b-499a-8dae-a583c43f5d54 tempest-TestMinimumBasicScenario-1346514318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:40:10 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b74eebce-868b-499a-8dae-a583c43f5d54 tempest-TestMinimumBasicScenario-1346514318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:40:10 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b74eebce-868b-499a-8dae-a583c43f5d54 tempest-TestMinimumBasicScenario-1346514318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:40:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b74eebce-868b-499a-8dae-a583c43f5d54 tempest-TestMinimumBasicScenario-1346514318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:40:10 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b74eebce-868b-499a-8dae-a583c43f5d54 tempest-TestMinimumBasicScenario-1346514318 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:40:10 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-b74eebce-868b-499a-8dae-a583c43f5d54 tempest-TestMinimumBasicScenario-1346514318 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:40:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b74eebce-868b-499a-8dae-a583c43f5d54 tempest-TestMinimumBasicScenario-1346514318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0d77e62d-c5f1-4ed0-86db-665d0b01bcca 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:10 devstack sudo[102642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0d77e62d-c5f1-4ed0-86db-665d0b01bcca 1073741824 Jul 11 04:40:10 devstack sudo[102642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:11 devstack sudo[102642]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b74eebce-868b-499a-8dae-a583c43f5d54 tempest-TestMinimumBasicScenario-1346514318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0d77e62d-c5f1-4ed0-86db-665d0b01bcca 1073741824" returned: 0 in 1.156s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b74eebce-868b-499a-8dae-a583c43f5d54 tempest-TestMinimumBasicScenario-1346514318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0d77e62d-c5f1-4ed0-86db-665d0b01bcca {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:11 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0d77e62d-c5f1-4ed0-86db-665d0b01bcca Jul 11 04:40:11 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:12 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b74eebce-868b-499a-8dae-a583c43f5d54 tempest-TestMinimumBasicScenario-1346514318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0d77e62d-c5f1-4ed0-86db-665d0b01bcca" returned: 0 in 1.039s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:12 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b74eebce-868b-499a-8dae-a583c43f5d54 tempest-TestMinimumBasicScenario-1346514318 None] <== create_volume: return (2267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:40:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b74eebce-868b-499a-8dae-a583c43f5d54 tempest-TestMinimumBasicScenario-1346514318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.273s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:40:12 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b74eebce-868b-499a-8dae-a583c43f5d54 tempest-TestMinimumBasicScenario-1346514318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8be1a669-bfa5-4c9f-b8e6-6f7c5957ceef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d77e62d-c5f1-4ed0-86db-665d0b01bcca', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:40:12 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b74eebce-868b-499a-8dae-a583c43f5d54 tempest-TestMinimumBasicScenario-1346514318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caaeaf70-2ae1-4570-836f-252186534da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:40:12 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-b74eebce-868b-499a-8dae-a583c43f5d54 tempest-TestMinimumBasicScenario-1346514318 None] Volume volume-0d77e62d-c5f1-4ed0-86db-665d0b01bcca (0d77e62d-c5f1-4ed0-86db-665d0b01bcca): created successfully Jul 11 04:40:12 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b74eebce-868b-499a-8dae-a583c43f5d54 tempest-TestMinimumBasicScenario-1346514318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caaeaf70-2ae1-4570-836f-252186534da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:40:12 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b74eebce-868b-499a-8dae-a583c43f5d54 tempest-TestMinimumBasicScenario-1346514318 None] Flow 'volume_create_manager' (2d7f9895-ee0a-4ef9-a9c9-97c90e9a93f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:40:12 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-b74eebce-868b-499a-8dae-a583c43f5d54 tempest-TestMinimumBasicScenario-1346514318 None] Created volume successfully. Jul 11 04:40:16 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-8778d8b0-6a02-449d-803f-ee6f62f3070d tempest-TestStampPattern-25865344 None] Acquiring lock "cinder-45f7be47-35fe-47b5-9b29-102708f56eb0-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:40:16 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-8778d8b0-6a02-449d-803f-ee6f62f3070d tempest-TestStampPattern-25865344 None] Lock "cinder-45f7be47-35fe-47b5-9b29-102708f56eb0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:40:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-a45a5572-8c12-418a-a203-6ea05e9c4e27 req-59de4fc9-3d2f-4ada-92a4-76fb62a93524 tempest-TestMinimumBasicScenario-1346514318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:40:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-a45a5572-8c12-418a-a203-6ea05e9c4e27 req-59de4fc9-3d2f-4ada-92a4-76fb62a93524 tempest-TestMinimumBasicScenario-1346514318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:40:17 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce793f1-e6d0-4f46-aa0c-5f115fe2bf12]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:40:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-a45a5572-8c12-418a-a203-6ea05e9c4e27 req-59de4fc9-3d2f-4ada-92a4-76fb62a93524 tempest-TestMinimumBasicScenario-1346514318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0d77e62d-c5f1-4ed0-86db-665d0b01bcca {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-8778d8b0-6a02-449d-803f-ee6f62f3070d tempest-TestStampPattern-25865344 None] Acquiring lock "cinder-quobyte-45f7be47-35fe-47b5-9b29-102708f56eb0" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:40:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-8778d8b0-6a02-449d-803f-ee6f62f3070d tempest-TestStampPattern-25865344 None] Lock "cinder-quobyte-45f7be47-35fe-47b5-9b29-102708f56eb0" acquired by "delete_volume" :: waited 0.020s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:40:17 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03d3022-8775-46f4-9a8a-7bb220e86b63]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:40:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8778d8b0-6a02-449d-803f-ee6f62f3070d tempest-TestStampPattern-25865344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:17 devstack sudo[102686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0d77e62d-c5f1-4ed0-86db-665d0b01bcca Jul 11 04:40:17 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:17 devstack sudo[102687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0 Jul 11 04:40:17 devstack sudo[102687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:18 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-a45a5572-8c12-418a-a203-6ea05e9c4e27 req-59de4fc9-3d2f-4ada-92a4-76fb62a93524 tempest-TestMinimumBasicScenario-1346514318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0d77e62d-c5f1-4ed0-86db-665d0b01bcca" returned: 0 in 1.029s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-a45a5572-8c12-418a-a203-6ea05e9c4e27 req-59de4fc9-3d2f-4ada-92a4-76fb62a93524 tempest-TestMinimumBasicScenario-1346514318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.070s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:40:18 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-a45a5572-8c12-418a-a203-6ea05e9c4e27 req-59de4fc9-3d2f-4ada-92a4-76fb62a93524 tempest-TestMinimumBasicScenario-1346514318 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95', 'name': 'volume-0d77e62d-c5f1-4ed0-86db-665d0b01bcca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed0c0565-5b90-4da2-a017-91db4ef2e173', 'enforce_multipath': True} {{(pid=86964) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 04:40:18 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-a45a5572-8c12-418a-a203-6ea05e9c4e27 req-59de4fc9-3d2f-4ada-92a4-76fb62a93524 tempest-TestMinimumBasicScenario-1346514318 None] attachment_update completed successfully. Jul 11 04:40:18 devstack sudo[102687]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8778d8b0-6a02-449d-803f-ee6f62f3070d tempest-TestStampPattern-25865344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0" returned: 0 in 1.056s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8778d8b0-6a02-449d-803f-ee6f62f3070d tempest-TestStampPattern-25865344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:18 devstack sudo[102727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0 Jul 11 04:40:18 devstack sudo[102727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:18 devstack sudo[102727]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8778d8b0-6a02-449d-803f-ee6f62f3070d tempest-TestStampPattern-25865344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45f7be47-35fe-47b5-9b29-102708f56eb0" returned: 0 in 0.663s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:18 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-8778d8b0-6a02-449d-803f-ee6f62f3070d tempest-TestStampPattern-25865344 None] Lock "cinder-quobyte-45f7be47-35fe-47b5-9b29-102708f56eb0" released by "delete_volume" :: held 1.826s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:40:18 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-8778d8b0-6a02-449d-803f-ee6f62f3070d tempest-TestStampPattern-25865344 None] Created reservations ['55a28ba9-ade0-41af-bece-c7dc7fe290ad', '4b8eb9ea-6eb2-4ac2-aa22-75e85c33a085', '1562a373-2fe5-45aa-8310-fd7b7f44b4a6', '3008c674-660b-411d-8dd5-7e571e58b5ca'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:40:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-8778d8b0-6a02-449d-803f-ee6f62f3070d tempest-TestStampPattern-25865344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:40:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-8778d8b0-6a02-449d-803f-ee6f62f3070d tempest-TestStampPattern-25865344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:40:19 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-8778d8b0-6a02-449d-803f-ee6f62f3070d tempest-TestStampPattern-25865344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:40:19 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-8778d8b0-6a02-449d-803f-ee6f62f3070d tempest-TestStampPattern-25865344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:40:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-8778d8b0-6a02-449d-803f-ee6f62f3070d tempest-TestStampPattern-25865344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:40:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8778d8b0-6a02-449d-803f-ee6f62f3070d tempest-TestStampPattern-25865344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:19 devstack sudo[102798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:40:19 devstack sudo[102798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:19 devstack sudo[102798]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8778d8b0-6a02-449d-803f-ee6f62f3070d tempest-TestStampPattern-25865344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.964s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:19 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-8778d8b0-6a02-449d-803f-ee6f62f3070d tempest-TestStampPattern-25865344 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:40:20 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-8778d8b0-6a02-449d-803f-ee6f62f3070d tempest-TestStampPattern-25865344 None] Deleted volume successfully. Jul 11 04:40:20 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-8778d8b0-6a02-449d-803f-ee6f62f3070d tempest-TestStampPattern-25865344 None] Lock "cinder-45f7be47-35fe-47b5-9b29-102708f56eb0-delete_volume" released by "delete_volume" :: held 3.089s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:40:24 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:40:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Flow 'volume_create_manager' (d250c213-6b0b-4bfa-9b1c-d9827ad050df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:40:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff15c5c4-e9d6-4554-8bb1-07e76acca91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:40:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff15c5c4-e9d6-4554-8bb1-07e76acca91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:40:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1875000723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4cec864-6160-42ef-a08c-d9eb3c601c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4d5c1f08da14b999972659a4434b8e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:40:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:40:24Z,use_quota=True,user_id='da98595a03214783a492f1d2374c89f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:40:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e73c0a5-6227-4994-8285-2c24cf26336f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:40:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e73c0a5-6227-4994-8285-2c24cf26336f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:40:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69338f27-be15-4cdc-9749-37431ec32ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:40:24 devstack cinder-volume[86964]: DEBUG cinder.image.glance [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Creating Keystone auth plugin from conf {{(pid=86964) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 04:40:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69338f27-be15-4cdc-9749-37431ec32ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd4cec864-6160-42ef-a08c-d9eb3c601c02', 'volume_name': 'volume-d4cec864-6160-42ef-a08c-d9eb3c601c02', 'volume_size': 1, 'image_id': 'a34636df-e58a-4a3a-9b16-7e804af976d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a34636df-e58a-4a3a-9b16-7e804af976d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ffa684dc47340c1a363723e49759fc3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a34636df-e58a-4a3a-9b16-7e804af976d8', 'created_at': datetime.datetime(2026, 7, 11, 2, 18, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 18, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a34636df-e58a-4a3a-9b16-7e804af976d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:40:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16644da7-5ce2-41f6-8366-ec8f928eb695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:40:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16644da7-5ce2-41f6-8366-ec8f928eb695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:40:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dce7399-b782-4c56-a152-35613a7b5255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:40:24 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Volume d4cec864-6160-42ef-a08c-d9eb3c601c02: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d4cec864-6160-42ef-a08c-d9eb3c601c02', 'volume_size': 1, 'image_id': 'a34636df-e58a-4a3a-9b16-7e804af976d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a34636df-e58a-4a3a-9b16-7e804af976d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ffa684dc47340c1a363723e49759fc3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a34636df-e58a-4a3a-9b16-7e804af976d8', 'created_at': datetime.datetime(2026, 7, 11, 2, 18, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 18, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a34636df-e58a-4a3a-9b16-7e804af976d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 11 04:40:24 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Trying to clone d4cec864-6160-42ef-a08c-d9eb3c601c02 from image a34636df-e58a-4a3a-9b16-7e804af976d8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a34636df-e58a-4a3a-9b16-7e804af976d8', 'metadata': {}}]). {{(pid=86964) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 04:40:25 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_m8w2qghadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86964) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 11 04:40:25 devstack cinder-volume[86964]: INFO cinder.image.image_utils [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Image download 20.69 MB at 20.69 MB/s Jul 11 04:40:25 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dca6033-9203-4776-84c2-33a8fdb756e9]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:40:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_m8w2qghadevstack@QuobyteHD {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:25 devstack sudo[103129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_m8w2qghadevstack@QuobyteHD Jul 11 04:40:25 devstack sudo[103129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:26 devstack sudo[103129]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_m8w2qghadevstack@QuobyteHD" returned: 0 in 0.990s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:26 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Temporary image a34636df-e58a-4a3a-9b16-7e804af976d8 is fetched for user da98595a03214783a492f1d2374c89f3. {{(pid=86964) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 11 04:40:26 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf80e321-de7b-431e-9800-d25cef0f6de9]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:40:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_m8w2qghadevstack@QuobyteHD {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:26 devstack sudo[103138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_m8w2qghadevstack@QuobyteHD Jul 11 04:40:26 devstack sudo[103138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:27 devstack sudo[103138]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_m8w2qghadevstack@QuobyteHD" returned: 0 in 0.813s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:40:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:40:27 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:40:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1875000723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4cec864-6160-42ef-a08c-d9eb3c601c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4d5c1f08da14b999972659a4434b8e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:40:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:40:24Z,use_quota=True,user_id='da98595a03214783a492f1d2374c89f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:40:27 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Creating volume d4cec864-6160-42ef-a08c-d9eb3c601c02 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:40:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:40:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:40:27 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:40:27 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:40:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:40:27 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:40:27 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:40:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:27 devstack sudo[103144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02 1073741824 Jul 11 04:40:27 devstack sudo[103144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:28 devstack sudo[103144]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02 1073741824" returned: 0 in 1.093s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:28 devstack sudo[103151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02 Jul 11 04:40:28 devstack sudo[103151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:29 devstack sudo[103151]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02" returned: 0 in 0.787s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:29 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] <== create_volume: return (1953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:40:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.957s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:40:29 devstack cinder-volume[86964]: DEBUG cinder.volume.volume_utils [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Attempting download of a34636df-e58a-4a3a-9b16-7e804af976d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/a34636df-e58a-4a3a-9b16-7e804af976d8', 'metadata': {}}])) to volume d4cec864-6160-42ef-a08c-d9eb3c601c02. {{(pid=86964) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 04:40:29 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ffad13-9937-4e1d-af3e-35031eb1db6d]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:40:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a34636df-e58a-4a3a-9b16-7e804af976d8_nu0zrqtd {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:29 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a34636df-e58a-4a3a-9b16-7e804af976d8_nu0zrqtd Jul 11 04:40:29 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:30 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a34636df-e58a-4a3a-9b16-7e804af976d8_nu0zrqtd" returned: 0 in 0.899s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a34636df-e58a-4a3a-9b16-7e804af976d8_nu0zrqtd {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:30 devstack sudo[103159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a34636df-e58a-4a3a-9b16-7e804af976d8_nu0zrqtd Jul 11 04:40:30 devstack sudo[103159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:31 devstack sudo[103159]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a34636df-e58a-4a3a-9b16-7e804af976d8_nu0zrqtd" returned: 1 in 0.849s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a34636df-e58a-4a3a-9b16-7e804af976d8_nu0zrqtd' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:40:31 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e9c824-3ec2-4382-a517-d4d68132c777]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:40:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_m8w2qghadevstack@QuobyteHD {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:31 devstack sudo[103165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_m8w2qghadevstack@QuobyteHD Jul 11 04:40:31 devstack sudo[103165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:31 devstack sudo[103165]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_m8w2qghadevstack@QuobyteHD" returned: 0 in 0.757s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:31 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] a34636df-e58a-4a3a-9b16-7e804af976d8 was qcow2, converting to raw {{(pid=86964) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 11 04:40:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_m8w2qghadevstack@QuobyteHD /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:31 devstack sudo[103170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_m8w2qghadevstack@QuobyteHD /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02 Jul 11 04:40:31 devstack sudo[103170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:34 devstack sudo[103170]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_m8w2qghadevstack@QuobyteHD /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02" returned: 0 in 2.083s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:34 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a34636df-e58a-4a3a-9b16-7e804af976d8_m8w2qghadevstack@QuobyteHD, size 112.00 MB, duration 2.08 sec, destination /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02 {{(pid=86964) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 04:40:34 devstack cinder-volume[86964]: INFO cinder.image.image_utils [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Converted 112.00 MB image at 53.74 MB/s Jul 11 04:40:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:34 devstack sudo[103185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02 1G Jul 11 04:40:34 devstack sudo[103185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:34 devstack sudo[103185]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02 1G" returned: 0 in 0.742s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:34 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d96806-a012-44f6-ad9c-098f077854ab]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:40:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:34 devstack sudo[103190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02 Jul 11 04:40:34 devstack sudo[103190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:35 devstack sudo[103190]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02" returned: 0 in 0.839s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:35 devstack sudo[103194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02 Jul 11 04:40:35 devstack sudo[103194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:36 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=35,cinder:UPDATE=33,cinder:INSERT=10,cinder:DELETE=3 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:40:36 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=41,cinder:UPDATE=44,cinder:INSERT=9,cinder:DELETE=1 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:40:36 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:40:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Flow 'volume_create_manager' (f0e3bd70-f264-40f2-a57c-f4b0df7f292f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:40:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a00aff5b-4fc9-4b84-9b28-112b907fcc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:40:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a00aff5b-4fc9-4b84-9b28-112b907fcc2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=276019ae-9425-44cb-b1e4-3ddd538aeeb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4b6ef540be44a5a18de5c0005336ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:40:36Z,use_quota=True,user_id='ca8a25c64670443ca4a814198b5394e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98336944-fbe5-41e4-9948-ce870cab17e3),volume_type_id=98336944-fbe5-41e4-9948-ce870cab17e3)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:40:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88efb728-9082-43b2-9953-e22dbe147483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:40:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88efb728-9082-43b2-9953-e22dbe147483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:40:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d58e8a1c-a732-4558-accb-f531c6c80fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:40:36 devstack cinder-volume[86964]: DEBUG cinder.image.glance [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Creating Keystone auth plugin from conf {{(pid=86964) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 04:40:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d58e8a1c-a732-4558-accb-f531c6c80fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '276019ae-9425-44cb-b1e4-3ddd538aeeb2', 'volume_name': 'volume-276019ae-9425-44cb-b1e4-3ddd538aeeb2', 'volume_size': 1, 'image_id': 'cadc39c2-ae26-407f-b551-7b50a3e20c04', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cadc39c2-ae26-407f-b551-7b50a3e20c04', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '00926016b395e26798700f92e9bb5806', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2c4b6ef540be44a5a18de5c0005336ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e88d8c7fd6a1dd5c0866bb9a07031609a90b3e78630bb44b7801db6691def1d1e904d9dbab729e1be1fe1edbe31756c7319047daaff5f04c9b72321493648f99', 'id': 'cadc39c2-ae26-407f-b551-7b50a3e20c04', 'created_at': datetime.datetime(2026, 7, 11, 2, 40, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 40, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cadc39c2-ae26-407f-b551-7b50a3e20c04/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:40:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f9f3974-ff68-4ff4-9a2c-3437b1cd5d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:40:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f9f3974-ff68-4ff4-9a2c-3437b1cd5d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:40:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7a7f39f-c352-49a2-b750-680435300a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:40:36 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Volume 276019ae-9425-44cb-b1e4-3ddd538aeeb2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-276019ae-9425-44cb-b1e4-3ddd538aeeb2', 'volume_size': 1, 'image_id': 'cadc39c2-ae26-407f-b551-7b50a3e20c04', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cadc39c2-ae26-407f-b551-7b50a3e20c04', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '00926016b395e26798700f92e9bb5806', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2c4b6ef540be44a5a18de5c0005336ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e88d8c7fd6a1dd5c0866bb9a07031609a90b3e78630bb44b7801db6691def1d1e904d9dbab729e1be1fe1edbe31756c7319047daaff5f04c9b72321493648f99', 'id': 'cadc39c2-ae26-407f-b551-7b50a3e20c04', 'created_at': datetime.datetime(2026, 7, 11, 2, 40, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 40, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cadc39c2-ae26-407f-b551-7b50a3e20c04/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 11 04:40:36 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Trying to clone 276019ae-9425-44cb-b1e4-3ddd538aeeb2 from image cadc39c2-ae26-407f-b551-7b50a3e20c04 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cadc39c2-ae26-407f-b551-7b50a3e20c04', 'metadata': {}}]). {{(pid=86964) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 04:40:36 devstack sudo[103194]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02" returned: 1 in 0.810s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:40:36 devstack cinder-volume[86964]: DEBUG cinder.volume.volume_utils [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Downloaded image a34636df-e58a-4a3a-9b16-7e804af976d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/a34636df-e58a-4a3a-9b16-7e804af976d8', 'metadata': {}}])) to volume d4cec864-6160-42ef-a08c-d9eb3c601c02 successfully. {{(pid=86964) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 04:40:36 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Temporary image a34636df-e58a-4a3a-9b16-7e804af976d8 for user da98595a03214783a492f1d2374c89f3 is deleted. {{(pid=86964) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 11 04:40:36 devstack cinder-volume[86964]: DEBUG cinder.volume.volume_utils [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Marking volume d4cec864-6160-42ef-a08c-d9eb3c601c02 as bootable. {{(pid=86964) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 04:40:36 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Copying metadata from image a34636df-e58a-4a3a-9b16-7e804af976d8 to d4cec864-6160-42ef-a08c-d9eb3c601c02. {{(pid=86964) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 04:40:36 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Creating volume glance metadata for volume d4cec864-6160-42ef-a08c-d9eb3c601c02 backed by image a34636df-e58a-4a3a-9b16-7e804af976d8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a34636df-e58a-4a3a-9b16-7e804af976d8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86964) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 04:40:36 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cadc39c2-ae26-407f-b551-7b50a3e20c04_4e7tgz0udevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86964) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 11 04:40:36 devstack cinder-volume[86964]: INFO cinder.image.image_utils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Image download 0.00 MB at 0.00 MB/s Jul 11 04:40:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dce7399-b782-4c56-a152-35613a7b5255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4cec864-6160-42ef-a08c-d9eb3c601c02', 'volume_size': 1, 'image_id': 'a34636df-e58a-4a3a-9b16-7e804af976d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a34636df-e58a-4a3a-9b16-7e804af976d8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ffa684dc47340c1a363723e49759fc3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a34636df-e58a-4a3a-9b16-7e804af976d8', 'created_at': datetime.datetime(2026, 7, 11, 2, 18, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 18, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a34636df-e58a-4a3a-9b16-7e804af976d8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:40:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e66468fe-8e65-4e03-a79d-2f962f61c89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:40:36 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Volume volume-d4cec864-6160-42ef-a08c-d9eb3c601c02 (d4cec864-6160-42ef-a08c-d9eb3c601c02): created successfully Jul 11 04:40:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e66468fe-8e65-4e03-a79d-2f962f61c89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:40:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Flow 'volume_create_manager' (d250c213-6b0b-4bfa-9b1c-d9827ad050df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:40:36 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d272f2-2bdb-4c99-b8b1-5c80e267884f]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:40:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cadc39c2-ae26-407f-b551-7b50a3e20c04_4e7tgz0udevstack@QuobyteHD {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:36 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-397a8df1-8e6a-450f-ad75-f492369faf5b tempest-TestShelveInstance-285084155 None] Created volume successfully. Jul 11 04:40:36 devstack sudo[103202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cadc39c2-ae26-407f-b551-7b50a3e20c04_4e7tgz0udevstack@QuobyteHD Jul 11 04:40:36 devstack sudo[103202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:37 devstack sudo[103202]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cadc39c2-ae26-407f-b551-7b50a3e20c04_4e7tgz0udevstack@QuobyteHD" returned: 0 in 0.745s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cadc39c2-ae26-407f-b551-7b50a3e20c04_4e7tgz0udevstack@QuobyteHD {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:37 devstack sudo[103206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cadc39c2-ae26-407f-b551-7b50a3e20c04_4e7tgz0udevstack@QuobyteHD Jul 11 04:40:37 devstack sudo[103206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:38 devstack sudo[103206]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cadc39c2-ae26-407f-b551-7b50a3e20c04_4e7tgz0udevstack@QuobyteHD" returned: 1 in 0.826s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cadc39c2-ae26-407f-b551-7b50a3e20c04_4e7tgz0udevstack@QuobyteHD' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:40:38 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Temporary image cadc39c2-ae26-407f-b551-7b50a3e20c04 is fetched for user ca8a25c64670443ca4a814198b5394e0. {{(pid=86964) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 11 04:40:38 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ae6722-4833-490d-b26b-76ccc29c4e66]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:40:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cadc39c2-ae26-407f-b551-7b50a3e20c04_4e7tgz0udevstack@QuobyteHD {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:38 devstack sudo[103214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cadc39c2-ae26-407f-b551-7b50a3e20c04_4e7tgz0udevstack@QuobyteHD Jul 11 04:40:38 devstack sudo[103214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:39 devstack sudo[103214]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cadc39c2-ae26-407f-b551-7b50a3e20c04_4e7tgz0udevstack@QuobyteHD" returned: 0 in 0.801s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cadc39c2-ae26-407f-b551-7b50a3e20c04_4e7tgz0udevstack@QuobyteHD {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:39 devstack sudo[103242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cadc39c2-ae26-407f-b551-7b50a3e20c04_4e7tgz0udevstack@QuobyteHD Jul 11 04:40:39 devstack sudo[103242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:39 devstack sudo[103242]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cadc39c2-ae26-407f-b551-7b50a3e20c04_4e7tgz0udevstack@QuobyteHD" returned: 1 in 0.711s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cadc39c2-ae26-407f-b551-7b50a3e20c04_4e7tgz0udevstack@QuobyteHD' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:40:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:40:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:40:39 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=276019ae-9425-44cb-b1e4-3ddd538aeeb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4b6ef540be44a5a18de5c0005336ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:40:36Z,use_quota=True,user_id='ca8a25c64670443ca4a814198b5394e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98336944-fbe5-41e4-9948-ce870cab17e3),volume_type_id=98336944-fbe5-41e4-9948-ce870cab17e3)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:40:39 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Creating volume 276019ae-9425-44cb-b1e4-3ddd538aeeb2 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:40:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:40:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:40:39 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:40:39 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:40:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:40:39 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:40:39 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:40:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-276019ae-9425-44cb-b1e4-3ddd538aeeb2 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:39 devstack sudo[103247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-276019ae-9425-44cb-b1e4-3ddd538aeeb2 1073741824 Jul 11 04:40:39 devstack sudo[103247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:40 devstack sudo[103247]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-276019ae-9425-44cb-b1e4-3ddd538aeeb2 1073741824" returned: 0 in 0.845s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-276019ae-9425-44cb-b1e4-3ddd538aeeb2 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:40 devstack sudo[103252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-276019ae-9425-44cb-b1e4-3ddd538aeeb2 Jul 11 04:40:40 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:41 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-276019ae-9425-44cb-b1e4-3ddd538aeeb2" returned: 0 in 0.634s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:41 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:40:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:40:41 devstack cinder-volume[86964]: DEBUG cinder.volume.volume_utils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Attempting download of cadc39c2-ae26-407f-b551-7b50a3e20c04 ((None, [{'url': 'file:///opt/stack/data/glance/images/cadc39c2-ae26-407f-b551-7b50a3e20c04', 'metadata': {}}])) to volume 276019ae-9425-44cb-b1e4-3ddd538aeeb2. {{(pid=86964) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 04:40:41 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f59a1ed-9f18-4430-9809-4e9c1afda73e]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:40:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cadc39c2-ae26-407f-b551-7b50a3e20c04_cu86u10w {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:41 devstack sudo[103256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cadc39c2-ae26-407f-b551-7b50a3e20c04_cu86u10w Jul 11 04:40:41 devstack sudo[103256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:42 devstack sudo[103256]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cadc39c2-ae26-407f-b551-7b50a3e20c04_cu86u10w" returned: 0 in 0.737s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cadc39c2-ae26-407f-b551-7b50a3e20c04_cu86u10w {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:42 devstack sudo[103274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cadc39c2-ae26-407f-b551-7b50a3e20c04_cu86u10w Jul 11 04:40:42 devstack sudo[103274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:42 devstack sudo[103274]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cadc39c2-ae26-407f-b551-7b50a3e20c04_cu86u10w" returned: 1 in 0.814s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cadc39c2-ae26-407f-b551-7b50a3e20c04_cu86u10w' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:40:42 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c6f908-5292-4631-9fab-617d0ad1f32e]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:40:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cadc39c2-ae26-407f-b551-7b50a3e20c04_4e7tgz0udevstack@QuobyteHD {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:43 devstack sudo[103289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cadc39c2-ae26-407f-b551-7b50a3e20c04_4e7tgz0udevstack@QuobyteHD Jul 11 04:40:43 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:44 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cadc39c2-ae26-407f-b551-7b50a3e20c04_4e7tgz0udevstack@QuobyteHD" returned: 0 in 1.143s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cadc39c2-ae26-407f-b551-7b50a3e20c04_4e7tgz0udevstack@QuobyteHD {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:44 devstack sudo[103296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cadc39c2-ae26-407f-b551-7b50a3e20c04_4e7tgz0udevstack@QuobyteHD Jul 11 04:40:44 devstack sudo[103296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-7a92cb9d-ce42-4dfe-8011-da376c12869a req-17f25398-5f28-4d45-bdcc-cabc14e90985 tempest-TestShelveInstance-285084155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:40:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-7a92cb9d-ce42-4dfe-8011-da376c12869a req-17f25398-5f28-4d45-bdcc-cabc14e90985 tempest-TestShelveInstance-285084155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:40:44 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[d044fb0a-b880-4960-bc48-c0a12ee302b5]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:40:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-7a92cb9d-ce42-4dfe-8011-da376c12869a req-17f25398-5f28-4d45-bdcc-cabc14e90985 tempest-TestShelveInstance-285084155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:44 devstack sudo[103306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02 Jul 11 04:40:44 devstack sudo[103306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:44 devstack sudo[103296]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cadc39c2-ae26-407f-b551-7b50a3e20c04_4e7tgz0udevstack@QuobyteHD" returned: 1 in 0.873s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cadc39c2-ae26-407f-b551-7b50a3e20c04_4e7tgz0udevstack@QuobyteHD' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:40:44 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] cadc39c2-ae26-407f-b551-7b50a3e20c04 was raw, converting to raw {{(pid=86964) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 11 04:40:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cadc39c2-ae26-407f-b551-7b50a3e20c04_4e7tgz0udevstack@QuobyteHD /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-276019ae-9425-44cb-b1e4-3ddd538aeeb2 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:45 devstack sudo[103311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cadc39c2-ae26-407f-b551-7b50a3e20c04_4e7tgz0udevstack@QuobyteHD /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-276019ae-9425-44cb-b1e4-3ddd538aeeb2 Jul 11 04:40:45 devstack sudo[103311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:45 devstack sudo[103306]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-7a92cb9d-ce42-4dfe-8011-da376c12869a req-17f25398-5f28-4d45-bdcc-cabc14e90985 tempest-TestShelveInstance-285084155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02" returned: 0 in 1.059s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-7a92cb9d-ce42-4dfe-8011-da376c12869a req-17f25398-5f28-4d45-bdcc-cabc14e90985 tempest-TestShelveInstance-285084155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:45 devstack sudo[103316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02 Jul 11 04:40:45 devstack sudo[103316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:46 devstack sudo[103311]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cadc39c2-ae26-407f-b551-7b50a3e20c04_4e7tgz0udevstack@QuobyteHD /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-276019ae-9425-44cb-b1e4-3ddd538aeeb2" returned: 0 in 1.074s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:46 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cadc39c2-ae26-407f-b551-7b50a3e20c04_4e7tgz0udevstack@QuobyteHD, size 0.00 MB, duration 1.08 sec, destination /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-276019ae-9425-44cb-b1e4-3ddd538aeeb2 {{(pid=86964) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 04:40:46 devstack cinder-volume[86964]: INFO cinder.image.image_utils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Converted 0.00 MB image at 0.00 MB/s Jul 11 04:40:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-276019ae-9425-44cb-b1e4-3ddd538aeeb2 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:46 devstack sudo[103322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-276019ae-9425-44cb-b1e4-3ddd538aeeb2 1G Jul 11 04:40:46 devstack sudo[103322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:46 devstack sudo[103316]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-7a92cb9d-ce42-4dfe-8011-da376c12869a req-17f25398-5f28-4d45-bdcc-cabc14e90985 tempest-TestShelveInstance-285084155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02" returned: 1 in 0.889s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-7a92cb9d-ce42-4dfe-8011-da376c12869a req-17f25398-5f28-4d45-bdcc-cabc14e90985 tempest-TestShelveInstance-285084155 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:40:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-7a92cb9d-ce42-4dfe-8011-da376c12869a req-17f25398-5f28-4d45-bdcc-cabc14e90985 tempest-TestShelveInstance-285084155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.016s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:40:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-7a92cb9d-ce42-4dfe-8011-da376c12869a req-17f25398-5f28-4d45-bdcc-cabc14e90985 tempest-TestShelveInstance-285084155 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95', 'name': 'volume-d4cec864-6160-42ef-a08c-d9eb3c601c02', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1fe1b256-d33b-4d60-8bd1-c76752e0fb24', 'enforce_multipath': True} {{(pid=86964) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 04:40:46 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-7a92cb9d-ce42-4dfe-8011-da376c12869a req-17f25398-5f28-4d45-bdcc-cabc14e90985 tempest-TestShelveInstance-285084155 None] attachment_update completed successfully. Jul 11 04:40:46 devstack sudo[103322]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-276019ae-9425-44cb-b1e4-3ddd538aeeb2 1G" returned: 0 in 0.795s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:46 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e5bb32-82cd-428d-9cea-e2dd2d61229b]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:40:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-276019ae-9425-44cb-b1e4-3ddd538aeeb2 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:47 devstack sudo[103330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-276019ae-9425-44cb-b1e4-3ddd538aeeb2 Jul 11 04:40:47 devstack sudo[103330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:47 devstack sudo[103330]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-276019ae-9425-44cb-b1e4-3ddd538aeeb2" returned: 0 in 0.807s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-276019ae-9425-44cb-b1e4-3ddd538aeeb2 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:47 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-276019ae-9425-44cb-b1e4-3ddd538aeeb2 Jul 11 04:40:47 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:48 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-276019ae-9425-44cb-b1e4-3ddd538aeeb2" returned: 1 in 0.778s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-276019ae-9425-44cb-b1e4-3ddd538aeeb2' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:40:48 devstack cinder-volume[86964]: DEBUG cinder.volume.volume_utils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Downloaded image cadc39c2-ae26-407f-b551-7b50a3e20c04 ((None, [{'url': 'file:///opt/stack/data/glance/images/cadc39c2-ae26-407f-b551-7b50a3e20c04', 'metadata': {}}])) to volume 276019ae-9425-44cb-b1e4-3ddd538aeeb2 successfully. {{(pid=86964) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 04:40:48 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Temporary image cadc39c2-ae26-407f-b551-7b50a3e20c04 for user ca8a25c64670443ca4a814198b5394e0 is deleted. {{(pid=86964) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 11 04:40:48 devstack cinder-volume[86964]: DEBUG cinder.volume.volume_utils [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Marking volume 276019ae-9425-44cb-b1e4-3ddd538aeeb2 as bootable. {{(pid=86964) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 04:40:48 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Copying metadata from image cadc39c2-ae26-407f-b551-7b50a3e20c04 to 276019ae-9425-44cb-b1e4-3ddd538aeeb2. {{(pid=86964) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 04:40:48 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Creating volume glance metadata for volume 276019ae-9425-44cb-b1e4-3ddd538aeeb2 backed by image cadc39c2-ae26-407f-b551-7b50a3e20c04 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'cadc39c2-ae26-407f-b551-7b50a3e20c04', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '00926016b395e26798700f92e9bb5806', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86964) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 04:40:48 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7a7f39f-c352-49a2-b750-680435300a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-276019ae-9425-44cb-b1e4-3ddd538aeeb2', 'volume_size': 1, 'image_id': 'cadc39c2-ae26-407f-b551-7b50a3e20c04', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cadc39c2-ae26-407f-b551-7b50a3e20c04', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '00926016b395e26798700f92e9bb5806', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2c4b6ef540be44a5a18de5c0005336ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e88d8c7fd6a1dd5c0866bb9a07031609a90b3e78630bb44b7801db6691def1d1e904d9dbab729e1be1fe1edbe31756c7319047daaff5f04c9b72321493648f99', 'id': 'cadc39c2-ae26-407f-b551-7b50a3e20c04', 'created_at': datetime.datetime(2026, 7, 11, 2, 40, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 40, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cadc39c2-ae26-407f-b551-7b50a3e20c04/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:40:48 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d798085-67ab-4f30-b4dd-592e8184b118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:40:48 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Volume volume-276019ae-9425-44cb-b1e4-3ddd538aeeb2 (276019ae-9425-44cb-b1e4-3ddd538aeeb2): created successfully Jul 11 04:40:48 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d798085-67ab-4f30-b4dd-592e8184b118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:40:48 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Flow 'volume_create_manager' (f0e3bd70-f264-40f2-a57c-f4b0df7f292f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:40:48 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-26cd4136-ea3f-4597-9f34-97fa454636b8 tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Created volume successfully. Jul 11 04:40:49 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c4890085-e57c-4766-9374-0e7448479efa tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Acquiring lock "cinder-276019ae-9425-44cb-b1e4-3ddd538aeeb2-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:40:49 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c4890085-e57c-4766-9374-0e7448479efa tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Lock "cinder-276019ae-9425-44cb-b1e4-3ddd538aeeb2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:40:49 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c4890085-e57c-4766-9374-0e7448479efa tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Acquiring lock "cinder-quobyte-276019ae-9425-44cb-b1e4-3ddd538aeeb2" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:40:49 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c4890085-e57c-4766-9374-0e7448479efa tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Lock "cinder-quobyte-276019ae-9425-44cb-b1e4-3ddd538aeeb2" acquired by "delete_volume" :: waited 0.029s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:40:49 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a24d6c-a1e1-4042-a4f1-879763c98844]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:40:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c4890085-e57c-4766-9374-0e7448479efa tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-276019ae-9425-44cb-b1e4-3ddd538aeeb2 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:49 devstack sudo[103339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-276019ae-9425-44cb-b1e4-3ddd538aeeb2 Jul 11 04:40:49 devstack sudo[103339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:50 devstack sudo[103339]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c4890085-e57c-4766-9374-0e7448479efa tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-276019ae-9425-44cb-b1e4-3ddd538aeeb2" returned: 0 in 1.184s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c4890085-e57c-4766-9374-0e7448479efa tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-276019ae-9425-44cb-b1e4-3ddd538aeeb2 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:50 devstack sudo[103381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-276019ae-9425-44cb-b1e4-3ddd538aeeb2 Jul 11 04:40:50 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:51 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c4890085-e57c-4766-9374-0e7448479efa tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-276019ae-9425-44cb-b1e4-3ddd538aeeb2" returned: 1 in 0.896s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c4890085-e57c-4766-9374-0e7448479efa tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-276019ae-9425-44cb-b1e4-3ddd538aeeb2' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:40:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c4890085-e57c-4766-9374-0e7448479efa tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-276019ae-9425-44cb-b1e4-3ddd538aeeb2 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:51 devstack sudo[103395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-276019ae-9425-44cb-b1e4-3ddd538aeeb2 Jul 11 04:40:51 devstack sudo[103395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:52 devstack sudo[103395]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c4890085-e57c-4766-9374-0e7448479efa tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-276019ae-9425-44cb-b1e4-3ddd538aeeb2" returned: 0 in 0.704s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:52 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c4890085-e57c-4766-9374-0e7448479efa tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Lock "cinder-quobyte-276019ae-9425-44cb-b1e4-3ddd538aeeb2" released by "delete_volume" :: held 2.867s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:40:52 devstack cinder-volume[86964]: WARNING cinder.quota [None req-c4890085-e57c-4766-9374-0e7448479efa tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:40:52 devstack cinder-volume[86964]: WARNING cinder.quota [None req-c4890085-e57c-4766-9374-0e7448479efa tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:40:52 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-c4890085-e57c-4766-9374-0e7448479efa tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Created reservations ['a70018da-e239-43ad-9ed0-b07e6b310b75', '67a3e6d8-ac59-46d3-aeda-9d853cf95f90', 'eb88ed55-8f72-4411-94c7-2dad7ec52d87', 'fb1fc327-b370-47a6-bc7e-f222c0744f68'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:40:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c4890085-e57c-4766-9374-0e7448479efa tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:40:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c4890085-e57c-4766-9374-0e7448479efa tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:40:52 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c4890085-e57c-4766-9374-0e7448479efa tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:40:52 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c4890085-e57c-4766-9374-0e7448479efa tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:40:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c4890085-e57c-4766-9374-0e7448479efa tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:40:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c4890085-e57c-4766-9374-0e7448479efa tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:52 devstack sudo[103415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:40:52 devstack sudo[103415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:53 devstack sudo[103415]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c4890085-e57c-4766-9374-0e7448479efa tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.836s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:53 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-c4890085-e57c-4766-9374-0e7448479efa tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:40:53 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-c4890085-e57c-4766-9374-0e7448479efa tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Deleted volume successfully. Jul 11 04:40:53 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c4890085-e57c-4766-9374-0e7448479efa tempest-VolumeAndVolumeTypeFromImageTest-1240974063 None] Lock "cinder-276019ae-9425-44cb-b1e4-3ddd538aeeb2-delete_volume" released by "delete_volume" :: held 4.024s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:40:58 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-0196e98c-c9b7-4488-8427-828396406e83 tempest-VolumeDependencyTests-311348281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:40:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0196e98c-c9b7-4488-8427-828396406e83 tempest-VolumeDependencyTests-311348281 None] Flow 'volume_create_manager' (253a38c3-eb93-44d8-a948-2656359e9af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:40:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0196e98c-c9b7-4488-8427-828396406e83 tempest-VolumeDependencyTests-311348281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ac4fbc5-fbf7-4043-a2c0-908120958e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:40:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0196e98c-c9b7-4488-8427-828396406e83 tempest-VolumeDependencyTests-311348281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ac4fbc5-fbf7-4043-a2c0-908120958e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-746803139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7deba331-edbf-4048-a066-a35ed51e21fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd1b15fc1d548488737e7a010f81167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:40:59Z,use_quota=True,user_id='65404d0038be46cd8cd7154f11e3c402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:40:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0196e98c-c9b7-4488-8427-828396406e83 tempest-VolumeDependencyTests-311348281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d297350f-1059-42d8-a0f7-fcc1d0e24d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:40:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0196e98c-c9b7-4488-8427-828396406e83 tempest-VolumeDependencyTests-311348281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d297350f-1059-42d8-a0f7-fcc1d0e24d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:40:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0196e98c-c9b7-4488-8427-828396406e83 tempest-VolumeDependencyTests-311348281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f8fbb5d-e0e0-4b74-aeb2-fd8bb321bf2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:40:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0196e98c-c9b7-4488-8427-828396406e83 tempest-VolumeDependencyTests-311348281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f8fbb5d-e0e0-4b74-aeb2-fd8bb321bf2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7deba331-edbf-4048-a066-a35ed51e21fd', 'volume_name': 'volume-7deba331-edbf-4048-a066-a35ed51e21fd', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:40:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0196e98c-c9b7-4488-8427-828396406e83 tempest-VolumeDependencyTests-311348281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (425f2ad7-2513-4453-ad0b-ef39252f5ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:40:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0196e98c-c9b7-4488-8427-828396406e83 tempest-VolumeDependencyTests-311348281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (425f2ad7-2513-4453-ad0b-ef39252f5ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:40:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0196e98c-c9b7-4488-8427-828396406e83 tempest-VolumeDependencyTests-311348281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28c5611a-9979-4e52-a762-d6e7ce21a393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:40:58 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-0196e98c-c9b7-4488-8427-828396406e83 tempest-VolumeDependencyTests-311348281 None] Volume 7deba331-edbf-4048-a066-a35ed51e21fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7deba331-edbf-4048-a066-a35ed51e21fd', 'volume_size': 1} Jul 11 04:40:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-0196e98c-c9b7-4488-8427-828396406e83 tempest-VolumeDependencyTests-311348281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:40:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-0196e98c-c9b7-4488-8427-828396406e83 tempest-VolumeDependencyTests-311348281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:40:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-0196e98c-c9b7-4488-8427-828396406e83 tempest-VolumeDependencyTests-311348281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-746803139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7deba331-edbf-4048-a066-a35ed51e21fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd1b15fc1d548488737e7a010f81167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:40:59Z,use_quota=True,user_id='65404d0038be46cd8cd7154f11e3c402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:40:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-0196e98c-c9b7-4488-8427-828396406e83 tempest-VolumeDependencyTests-311348281 None] Creating volume 7deba331-edbf-4048-a066-a35ed51e21fd {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:40:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-0196e98c-c9b7-4488-8427-828396406e83 tempest-VolumeDependencyTests-311348281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:40:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-0196e98c-c9b7-4488-8427-828396406e83 tempest-VolumeDependencyTests-311348281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:40:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-0196e98c-c9b7-4488-8427-828396406e83 tempest-VolumeDependencyTests-311348281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:40:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-0196e98c-c9b7-4488-8427-828396406e83 tempest-VolumeDependencyTests-311348281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:40:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-0196e98c-c9b7-4488-8427-828396406e83 tempest-VolumeDependencyTests-311348281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:40:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-0196e98c-c9b7-4488-8427-828396406e83 tempest-VolumeDependencyTests-311348281 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:40:58 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-0196e98c-c9b7-4488-8427-828396406e83 tempest-VolumeDependencyTests-311348281 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:40:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-0196e98c-c9b7-4488-8427-828396406e83 tempest-VolumeDependencyTests-311348281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:58 devstack sudo[103428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd 1073741824 Jul 11 04:40:58 devstack sudo[103428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:59 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:40:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:40:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:40:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:40:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:40:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:40:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:59 devstack sudo[103431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:40:59 devstack sudo[103431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:40:59 devstack sudo[103431]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.645s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:59 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:40:59 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager._thread_info {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:40:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread count: 28 {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:40:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread info: [<_MainThread(MainThread, started 124675027595392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:40:59 devstack sudo[103428]: pam_unix(sudo:session): session closed for user root Jul 11 04:40:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-0196e98c-c9b7-4488-8427-828396406e83 tempest-VolumeDependencyTests-311348281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd 1073741824" returned: 0 in 0.934s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:40:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-0196e98c-c9b7-4488-8427-828396406e83 tempest-VolumeDependencyTests-311348281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:40:59 devstack sudo[103438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd Jul 11 04:40:59 devstack sudo[103438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:00 devstack sudo[103438]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-0196e98c-c9b7-4488-8427-828396406e83 tempest-VolumeDependencyTests-311348281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd" returned: 0 in 0.635s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:00 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-0196e98c-c9b7-4488-8427-828396406e83 tempest-VolumeDependencyTests-311348281 None] <== create_volume: return (1617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:41:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-0196e98c-c9b7-4488-8427-828396406e83 tempest-VolumeDependencyTests-311348281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:41:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0196e98c-c9b7-4488-8427-828396406e83 tempest-VolumeDependencyTests-311348281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28c5611a-9979-4e52-a762-d6e7ce21a393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7deba331-edbf-4048-a066-a35ed51e21fd', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:41:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0196e98c-c9b7-4488-8427-828396406e83 tempest-VolumeDependencyTests-311348281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (019a8e5d-1947-47ee-a8bf-93dae537ee93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:41:00 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-0196e98c-c9b7-4488-8427-828396406e83 tempest-VolumeDependencyTests-311348281 None] Volume volume-7deba331-edbf-4048-a066-a35ed51e21fd (7deba331-edbf-4048-a066-a35ed51e21fd): created successfully Jul 11 04:41:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0196e98c-c9b7-4488-8427-828396406e83 tempest-VolumeDependencyTests-311348281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (019a8e5d-1947-47ee-a8bf-93dae537ee93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:41:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0196e98c-c9b7-4488-8427-828396406e83 tempest-VolumeDependencyTests-311348281 None] Flow 'volume_create_manager' (253a38c3-eb93-44d8-a948-2656359e9af2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:41:00 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-0196e98c-c9b7-4488-8427-828396406e83 tempest-VolumeDependencyTests-311348281 None] Created volume successfully. Jul 11 04:41:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3c73088b-f0f5-48e9-8157-3d6a8ac24f1f tempest-VolumeDependencyTests-311348281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:41:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3c73088b-f0f5-48e9-8157-3d6a8ac24f1f tempest-VolumeDependencyTests-311348281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:41:01 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-3c73088b-f0f5-48e9-8157-3d6a8ac24f1f tempest-VolumeDependencyTests-311348281 None] Creating offline snapshot 5840fd7c-62b7-4806-b0e0-9916c2493335 of volume 7deba331-edbf-4048-a066-a35ed51e21fd {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:41:01 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b6b819-a313-42e8-bbb8-f8523096acad]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:41:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3c73088b-f0f5-48e9-8157-3d6a8ac24f1f tempest-VolumeDependencyTests-311348281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:01 devstack sudo[103441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd Jul 11 04:41:01 devstack sudo[103441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:01 devstack sudo[103441]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3c73088b-f0f5-48e9-8157-3d6a8ac24f1f tempest-VolumeDependencyTests-311348281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd" returned: 0 in 0.746s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3c73088b-f0f5-48e9-8157-3d6a8ac24f1f tempest-VolumeDependencyTests-311348281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd.5840fd7c-62b7-4806-b0e0-9916c2493335 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:01 devstack sudo[103446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd.5840fd7c-62b7-4806-b0e0-9916c2493335 1G Jul 11 04:41:01 devstack sudo[103446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:02 devstack sudo[103446]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3c73088b-f0f5-48e9-8157-3d6a8ac24f1f tempest-VolumeDependencyTests-311348281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd.5840fd7c-62b7-4806-b0e0-9916c2493335 1G" returned: 0 in 0.755s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3c73088b-f0f5-48e9-8157-3d6a8ac24f1f tempest-VolumeDependencyTests-311348281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7deba331-edbf-4048-a066-a35ed51e21fd -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd.5840fd7c-62b7-4806-b0e0-9916c2493335 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:02 devstack sudo[103451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7deba331-edbf-4048-a066-a35ed51e21fd -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd.5840fd7c-62b7-4806-b0e0-9916c2493335 Jul 11 04:41:02 devstack sudo[103451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:03 devstack sudo[103451]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3c73088b-f0f5-48e9-8157-3d6a8ac24f1f tempest-VolumeDependencyTests-311348281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7deba331-edbf-4048-a066-a35ed51e21fd -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd.5840fd7c-62b7-4806-b0e0-9916c2493335" returned: 0 in 0.737s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:03 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-3c73088b-f0f5-48e9-8157-3d6a8ac24f1f tempest-VolumeDependencyTests-311348281 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd.5840fd7c-62b7-4806-b0e0-9916c2493335 is being set with open permissions: ugo+rw Jul 11 04:41:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3c73088b-f0f5-48e9-8157-3d6a8ac24f1f tempest-VolumeDependencyTests-311348281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd.5840fd7c-62b7-4806-b0e0-9916c2493335 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:03 devstack sudo[103456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd.5840fd7c-62b7-4806-b0e0-9916c2493335 Jul 11 04:41:03 devstack sudo[103456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:04 devstack sudo[103456]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3c73088b-f0f5-48e9-8157-3d6a8ac24f1f tempest-VolumeDependencyTests-311348281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd.5840fd7c-62b7-4806-b0e0-9916c2493335" returned: 0 in 0.670s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3c73088b-f0f5-48e9-8157-3d6a8ac24f1f tempest-VolumeDependencyTests-311348281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:04 devstack sudo[103459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd.info Jul 11 04:41:04 devstack sudo[103459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:04 devstack sudo[103459]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3c73088b-f0f5-48e9-8157-3d6a8ac24f1f tempest-VolumeDependencyTests-311348281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd.info" returned: 0 in 0.693s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:04 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-3c73088b-f0f5-48e9-8157-3d6a8ac24f1f tempest-VolumeDependencyTests-311348281 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd.info is being set with open permissions: ugo+rw Jul 11 04:41:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3c73088b-f0f5-48e9-8157-3d6a8ac24f1f tempest-VolumeDependencyTests-311348281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:04 devstack sudo[103462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd.info Jul 11 04:41:04 devstack sudo[103462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:05 devstack sudo[103462]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3c73088b-f0f5-48e9-8157-3d6a8ac24f1f tempest-VolumeDependencyTests-311348281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd.info" returned: 0 in 0.648s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3c73088b-f0f5-48e9-8157-3d6a8ac24f1f tempest-VolumeDependencyTests-311348281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.342s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:41:05 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-3c73088b-f0f5-48e9-8157-3d6a8ac24f1f tempest-VolumeDependencyTests-311348281 None] Create snapshot completed successfully Jul 11 04:41:07 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:41:07 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Flow 'volume_create_manager' (eb34e396-27ab-4f37-a9fe-81f62bd3a15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:41:07 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (014f0591-1b2f-4442-a95b-3d92ab22b03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:41:07 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (014f0591-1b2f-4442-a95b-3d92ab22b03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-310050300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60daff88-d9b4-4e3a-b4e7-c93775154555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd1b15fc1d548488737e7a010f81167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5840fd7c-62b7-4806-b0e0-9916c2493335,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:41:07Z,use_quota=True,user_id='65404d0038be46cd8cd7154f11e3c402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:41:07 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (401979ea-1e91-444d-94f5-1b3ec2673c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:41:07 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (401979ea-1e91-444d-94f5-1b3ec2673c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:41:07 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bac3b1b-d571-4209-8f18-11407f8e558d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:41:07 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bac3b1b-d571-4209-8f18-11407f8e558d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '60daff88-d9b4-4e3a-b4e7-c93775154555', 'volume_name': 'volume-60daff88-d9b4-4e3a-b4e7-c93775154555', 'volume_size': 1, 'snapshot_id': '5840fd7c-62b7-4806-b0e0-9916c2493335'}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:41:07 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1a4eded-dbaf-4468-aeb3-0d0b84d0155b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:41:07 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1a4eded-dbaf-4468-aeb3-0d0b84d0155b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:41:07 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (642c2f00-fd2c-4a84-a804-6148b05bb66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:41:07 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Volume 60daff88-d9b4-4e3a-b4e7-c93775154555: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-60daff88-d9b4-4e3a-b4e7-c93775154555', 'volume_size': 1, 'snapshot_id': '5840fd7c-62b7-4806-b0e0-9916c2493335'} Jul 11 04:41:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:41:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:41:07 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Acquiring lock "cinder-quobyte-5840fd7c-62b7-4806-b0e0-9916c2493335-60daff88-d9b4-4e3a-b4e7-c93775154555" by "_create_volume_from_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:41:07 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Lock "cinder-quobyte-5840fd7c-62b7-4806-b0e0-9916c2493335-60daff88-d9b4-4e3a-b4e7-c93775154555" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:41:07 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Creating volume 60daff88-d9b4-4e3a-b4e7-c93775154555 from snapshot 5840fd7c-62b7-4806-b0e0-9916c2493335 {{(pid=86964) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 04:41:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:41:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:41:07 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:41:07 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:41:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:41:07 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:41:07 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Acquiring lock "cinder-quobyte-60daff88-d9b4-4e3a-b4e7-c93775154555" by "_copy_volume_from_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:41:07 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Lock "cinder-quobyte-60daff88-d9b4-4e3a-b4e7-c93775154555" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:41:07 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] snapshot: 5840fd7c-62b7-4806-b0e0-9916c2493335, volume: 60daff88-d9b4-4e3a-b4e7-c93775154555, {{(pid=86964) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 04:41:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:41:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:41:07 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:41:07 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:41:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:41:07 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[d275535d-d8a2-4723-aa08-058c621a46af]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:41:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd.5840fd7c-62b7-4806-b0e0-9916c2493335 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:07 devstack sudo[103507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd.5840fd7c-62b7-4806-b0e0-9916c2493335 Jul 11 04:41:07 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:08 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd.5840fd7c-62b7-4806-b0e0-9916c2493335" returned: 0 in 1.134s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:08 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7deba331-edbf-4048-a066-a35ed51e21fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:41:08 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd {{(pid=86964) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 04:41:08 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Creating direct copy from snapshot {{(pid=86964) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 04:41:08 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78c73cf-edf3-4ddd-a767-b83e8d3821ac]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:41:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:08 devstack sudo[103584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd Jul 11 04:41:08 devstack sudo[103584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:09 devstack sudo[103584]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd" returned: 0 in 0.944s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:09 devstack cinder-volume[86964]: DEBUG cinder.utils [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Path /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60daff88-d9b4-4e3a-b4e7-c93775154555 not found in is_blk_device check {{(pid=86964) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 04:41:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60daff88-d9b4-4e3a-b4e7-c93775154555 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:09 devstack sudo[103591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60daff88-d9b4-4e3a-b4e7-c93775154555 Jul 11 04:41:09 devstack sudo[103591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:10 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-c6c44975-0a21-4282-8dcb-8f71aca2ff4e req-691d9018-ec83-4b73-891f-e17600f572ae tempest-TestMinimumBasicScenario-1346514318 None] Terminate volume connection completed successfully. Jul 11 04:41:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-c6c44975-0a21-4282-8dcb-8f71aca2ff4e req-691d9018-ec83-4b73-891f-e17600f572ae tempest-TestMinimumBasicScenario-1346514318 None] Deleting attachment ed0c0565-5b90-4da2-a017-91db4ef2e173. {{(pid=86964) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 04:41:12 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-395ff78c-c9e5-48a9-8ee3-750ab55ddb0e tempest-TestMinimumBasicScenario-1346514318 None] Acquiring lock "cinder-0d77e62d-c5f1-4ed0-86db-665d0b01bcca-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:41:12 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-395ff78c-c9e5-48a9-8ee3-750ab55ddb0e tempest-TestMinimumBasicScenario-1346514318 None] Lock "cinder-0d77e62d-c5f1-4ed0-86db-665d0b01bcca-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:41:12 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-395ff78c-c9e5-48a9-8ee3-750ab55ddb0e tempest-TestMinimumBasicScenario-1346514318 None] Acquiring lock "cinder-quobyte-0d77e62d-c5f1-4ed0-86db-665d0b01bcca" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:41:13 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-395ff78c-c9e5-48a9-8ee3-750ab55ddb0e tempest-TestMinimumBasicScenario-1346514318 None] Lock "cinder-quobyte-0d77e62d-c5f1-4ed0-86db-665d0b01bcca" acquired by "delete_volume" :: waited 0.039s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:41:13 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2bebec-c8a3-47d9-9f8e-5ec133cb1c44]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:41:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-395ff78c-c9e5-48a9-8ee3-750ab55ddb0e tempest-TestMinimumBasicScenario-1346514318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0d77e62d-c5f1-4ed0-86db-665d0b01bcca {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:13 devstack sudo[103615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0d77e62d-c5f1-4ed0-86db-665d0b01bcca Jul 11 04:41:13 devstack sudo[103615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:14 devstack sudo[103615]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-395ff78c-c9e5-48a9-8ee3-750ab55ddb0e tempest-TestMinimumBasicScenario-1346514318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0d77e62d-c5f1-4ed0-86db-665d0b01bcca" returned: 0 in 1.350s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-395ff78c-c9e5-48a9-8ee3-750ab55ddb0e tempest-TestMinimumBasicScenario-1346514318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0d77e62d-c5f1-4ed0-86db-665d0b01bcca {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:14 devstack sudo[103620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0d77e62d-c5f1-4ed0-86db-665d0b01bcca Jul 11 04:41:14 devstack sudo[103620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:15 devstack sudo[103591]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60daff88-d9b4-4e3a-b4e7-c93775154555" returned: 0 in 5.799s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:15 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1f2620-f796-4ac3-9583-a4ab8aa49f11]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:41:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:15 devstack sudo[103622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd Jul 11 04:41:15 devstack sudo[103622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:15 devstack sudo[103620]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-395ff78c-c9e5-48a9-8ee3-750ab55ddb0e tempest-TestMinimumBasicScenario-1346514318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-0d77e62d-c5f1-4ed0-86db-665d0b01bcca" returned: 0 in 1.161s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:15 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-395ff78c-c9e5-48a9-8ee3-750ab55ddb0e tempest-TestMinimumBasicScenario-1346514318 None] Lock "cinder-quobyte-0d77e62d-c5f1-4ed0-86db-665d0b01bcca" released by "delete_volume" :: held 2.629s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:41:15 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-395ff78c-c9e5-48a9-8ee3-750ab55ddb0e tempest-TestMinimumBasicScenario-1346514318 None] Created reservations ['9ed7c456-d339-421e-a020-4750f048fd3b', 'f1f2a94d-de57-4a3c-96be-fb66a1f8609a', '4a420caf-f51e-4dcb-8fa9-40a552322156', '99fb3982-776a-47dc-b775-c0608f42b87d'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:41:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-395ff78c-c9e5-48a9-8ee3-750ab55ddb0e tempest-TestMinimumBasicScenario-1346514318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:41:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-395ff78c-c9e5-48a9-8ee3-750ab55ddb0e tempest-TestMinimumBasicScenario-1346514318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:41:15 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-395ff78c-c9e5-48a9-8ee3-750ab55ddb0e tempest-TestMinimumBasicScenario-1346514318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:41:15 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-395ff78c-c9e5-48a9-8ee3-750ab55ddb0e tempest-TestMinimumBasicScenario-1346514318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:41:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-395ff78c-c9e5-48a9-8ee3-750ab55ddb0e tempest-TestMinimumBasicScenario-1346514318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:41:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-395ff78c-c9e5-48a9-8ee3-750ab55ddb0e tempest-TestMinimumBasicScenario-1346514318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:15 devstack sudo[103626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:41:15 devstack sudo[103626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:16 devstack sudo[103622]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd" returned: 0 in 1.318s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:16 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Image conversion details: src /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd, size 1024.00 MB, duration 5.80 sec, destination /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60daff88-d9b4-4e3a-b4e7-c93775154555 {{(pid=86964) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 04:41:16 devstack cinder-volume[86964]: INFO cinder.image.image_utils [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Converted 1024.00 MB image at 176.53 MB/s Jul 11 04:41:16 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60daff88-d9b4-4e3a-b4e7-c93775154555 is being set with open permissions: ugo+rw Jul 11 04:41:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60daff88-d9b4-4e3a-b4e7-c93775154555 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:16 devstack sudo[103632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60daff88-d9b4-4e3a-b4e7-c93775154555 Jul 11 04:41:16 devstack sudo[103632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:16 devstack sudo[103626]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-395ff78c-c9e5-48a9-8ee3-750ab55ddb0e tempest-TestMinimumBasicScenario-1346514318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.958s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:16 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-395ff78c-c9e5-48a9-8ee3-750ab55ddb0e tempest-TestMinimumBasicScenario-1346514318 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:41:16 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-395ff78c-c9e5-48a9-8ee3-750ab55ddb0e tempest-TestMinimumBasicScenario-1346514318 None] Deleted volume successfully. Jul 11 04:41:16 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-395ff78c-c9e5-48a9-8ee3-750ab55ddb0e tempest-TestMinimumBasicScenario-1346514318 None] Lock "cinder-0d77e62d-c5f1-4ed0-86db-665d0b01bcca-delete_volume" released by "delete_volume" :: held 3.974s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:41:17 devstack sudo[103632]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60daff88-d9b4-4e3a-b4e7-c93775154555" returned: 0 in 0.777s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Lock "cinder-quobyte-60daff88-d9b4-4e3a-b4e7-c93775154555" released by "_copy_volume_from_snapshot" :: held 10.092s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:41:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Lock "cinder-quobyte-5840fd7c-62b7-4806-b0e0-9916c2493335-60daff88-d9b4-4e3a-b4e7-c93775154555" released by "_create_volume_from_snapshot" :: held 10.127s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:41:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.144s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:41:17 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (642c2f00-fd2c-4a84-a804-6148b05bb66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60daff88-d9b4-4e3a-b4e7-c93775154555', 'volume_size': 1, 'snapshot_id': '5840fd7c-62b7-4806-b0e0-9916c2493335'}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:41:17 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6514be1-6146-4e34-a047-7eebbfafc652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:41:17 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Volume volume-60daff88-d9b4-4e3a-b4e7-c93775154555 (60daff88-d9b4-4e3a-b4e7-c93775154555): created successfully Jul 11 04:41:17 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6514be1-6146-4e34-a047-7eebbfafc652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:41:17 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Flow 'volume_create_manager' (eb34e396-27ab-4f37-a9fe-81f62bd3a15c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:41:17 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-64e86dd7-9cbe-4fe6-bf2c-c659a042b10b tempest-VolumeDependencyTests-311348281 None] Created volume successfully. Jul 11 04:41:18 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-509fafd9-f52e-4921-bb62-9bea9758a507 tempest-VolumeDependencyTests-311348281 None] Acquiring lock "cinder-5840fd7c-62b7-4806-b0e0-9916c2493335-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:41:18 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-509fafd9-f52e-4921-bb62-9bea9758a507 tempest-VolumeDependencyTests-311348281 None] Lock "cinder-5840fd7c-62b7-4806-b0e0-9916c2493335-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:41:18 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-509fafd9-f52e-4921-bb62-9bea9758a507 tempest-VolumeDependencyTests-311348281 None] Acquiring lock "cinder-quobyte-7deba331-edbf-4048-a066-a35ed51e21fd" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:41:18 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-509fafd9-f52e-4921-bb62-9bea9758a507 tempest-VolumeDependencyTests-311348281 None] Lock "cinder-quobyte-7deba331-edbf-4048-a066-a35ed51e21fd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:41:18 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-509fafd9-f52e-4921-bb62-9bea9758a507 tempest-VolumeDependencyTests-311348281 None] Acquiring lock "cinder-quobyte-5840fd7c-62b7-4806-b0e0-9916c2493335" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:41:18 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-509fafd9-f52e-4921-bb62-9bea9758a507 tempest-VolumeDependencyTests-311348281 None] Lock "cinder-quobyte-5840fd7c-62b7-4806-b0e0-9916c2493335" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:41:18 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-509fafd9-f52e-4921-bb62-9bea9758a507 tempest-VolumeDependencyTests-311348281 None] Deleting offline snapshot 5840fd7c-62b7-4806-b0e0-9916c2493335 of volume 7deba331-edbf-4048-a066-a35ed51e21fd {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:41:18 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-509fafd9-f52e-4921-bb62-9bea9758a507 tempest-VolumeDependencyTests-311348281 None] snapshot_file for this snap is: volume-7deba331-edbf-4048-a066-a35ed51e21fd.5840fd7c-62b7-4806-b0e0-9916c2493335 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:41:18 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[b930b0a5-ce01-4706-a231-55820c02fc28]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:41:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-509fafd9-f52e-4921-bb62-9bea9758a507 tempest-VolumeDependencyTests-311348281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd.5840fd7c-62b7-4806-b0e0-9916c2493335 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:18 devstack sudo[103642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd.5840fd7c-62b7-4806-b0e0-9916c2493335 Jul 11 04:41:18 devstack sudo[103642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:19 devstack sudo[103642]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-509fafd9-f52e-4921-bb62-9bea9758a507 tempest-VolumeDependencyTests-311348281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd.5840fd7c-62b7-4806-b0e0-9916c2493335" returned: 0 in 0.893s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:19 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-509fafd9-f52e-4921-bb62-9bea9758a507 tempest-VolumeDependencyTests-311348281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7deba331-edbf-4048-a066-a35ed51e21fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:41:19 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e26daa-c884-4cd7-99dc-0802850c87c3]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:41:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-509fafd9-f52e-4921-bb62-9bea9758a507 tempest-VolumeDependencyTests-311348281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:19 devstack sudo[103669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd Jul 11 04:41:19 devstack sudo[103669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:20 devstack sudo[103669]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-509fafd9-f52e-4921-bb62-9bea9758a507 tempest-VolumeDependencyTests-311348281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd" returned: 0 in 0.875s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-509fafd9-f52e-4921-bb62-9bea9758a507 tempest-VolumeDependencyTests-311348281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd.5840fd7c-62b7-4806-b0e0-9916c2493335 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:20 devstack sudo[103681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd.5840fd7c-62b7-4806-b0e0-9916c2493335 Jul 11 04:41:20 devstack sudo[103681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:20 devstack sudo[103681]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-509fafd9-f52e-4921-bb62-9bea9758a507 tempest-VolumeDependencyTests-311348281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd.5840fd7c-62b7-4806-b0e0-9916c2493335" returned: 0 in 0.741s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-509fafd9-f52e-4921-bb62-9bea9758a507 tempest-VolumeDependencyTests-311348281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd.5840fd7c-62b7-4806-b0e0-9916c2493335 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:20 devstack sudo[103687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd.5840fd7c-62b7-4806-b0e0-9916c2493335 Jul 11 04:41:20 devstack sudo[103687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:21 devstack sudo[103687]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-509fafd9-f52e-4921-bb62-9bea9758a507 tempest-VolumeDependencyTests-311348281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd.5840fd7c-62b7-4806-b0e0-9916c2493335" returned: 0 in 0.697s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:21 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-509fafd9-f52e-4921-bb62-9bea9758a507 tempest-VolumeDependencyTests-311348281 None] Lock "cinder-quobyte-5840fd7c-62b7-4806-b0e0-9916c2493335" released by "_delete_snapshot" :: held 3.317s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:41:21 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-509fafd9-f52e-4921-bb62-9bea9758a507 tempest-VolumeDependencyTests-311348281 None] Lock "cinder-quobyte-7deba331-edbf-4048-a066-a35ed51e21fd" released by "delete_snapshot" :: held 3.339s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:41:21 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-509fafd9-f52e-4921-bb62-9bea9758a507 tempest-VolumeDependencyTests-311348281 None] Created reservations ['3d139a94-621c-43c0-8b9f-9bfe4f3aaf49', '4132fa37-47c8-4e9e-8672-16003653c0df', '205b0ef4-c37e-4c77-bb62-7f54242ceab8', '51a6e537-5f04-4fd0-afcf-2aa210009ec9'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:41:21 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-509fafd9-f52e-4921-bb62-9bea9758a507 tempest-VolumeDependencyTests-311348281 None] Delete snapshot completed successfully. Jul 11 04:41:21 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-509fafd9-f52e-4921-bb62-9bea9758a507 tempest-VolumeDependencyTests-311348281 None] Lock "cinder-5840fd7c-62b7-4806-b0e0-9916c2493335-delete_snapshot" released by "delete_snapshot" :: held 3.472s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:41:22 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-254834a1-6634-482c-9f9f-7d91f9f2113c tempest-VolumeDependencyTests-311348281 None] Acquiring lock "cinder-7deba331-edbf-4048-a066-a35ed51e21fd-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:41:22 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-254834a1-6634-482c-9f9f-7d91f9f2113c tempest-VolumeDependencyTests-311348281 None] Lock "cinder-7deba331-edbf-4048-a066-a35ed51e21fd-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:41:22 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-254834a1-6634-482c-9f9f-7d91f9f2113c tempest-VolumeDependencyTests-311348281 None] Acquiring lock "cinder-quobyte-7deba331-edbf-4048-a066-a35ed51e21fd" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:41:22 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-254834a1-6634-482c-9f9f-7d91f9f2113c tempest-VolumeDependencyTests-311348281 None] Lock "cinder-quobyte-7deba331-edbf-4048-a066-a35ed51e21fd" acquired by "delete_volume" :: waited 0.015s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:41:22 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[06faa1ab-18a7-4721-9d6b-67eb0cac85b9]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:41:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-254834a1-6634-482c-9f9f-7d91f9f2113c tempest-VolumeDependencyTests-311348281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:22 devstack sudo[103693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd Jul 11 04:41:22 devstack sudo[103693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:23 devstack sudo[103693]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-254834a1-6634-482c-9f9f-7d91f9f2113c tempest-VolumeDependencyTests-311348281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd" returned: 0 in 0.788s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-254834a1-6634-482c-9f9f-7d91f9f2113c tempest-VolumeDependencyTests-311348281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:23 devstack sudo[103699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd Jul 11 04:41:23 devstack sudo[103699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:24 devstack sudo[103699]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-254834a1-6634-482c-9f9f-7d91f9f2113c tempest-VolumeDependencyTests-311348281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7deba331-edbf-4048-a066-a35ed51e21fd" returned: 0 in 0.769s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:24 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-254834a1-6634-482c-9f9f-7d91f9f2113c tempest-VolumeDependencyTests-311348281 None] Lock "cinder-quobyte-7deba331-edbf-4048-a066-a35ed51e21fd" released by "delete_volume" :: held 1.627s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:41:24 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-254834a1-6634-482c-9f9f-7d91f9f2113c tempest-VolumeDependencyTests-311348281 None] Created reservations ['c462fe5e-c36d-43c9-8b50-5c070e97c4c2', '2d54fd84-761e-45f1-b093-b365667b391c', '44f4bda0-0680-4f0e-819a-f764f8345c95', 'a73e6211-af67-4908-947b-9db544b712aa'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:41:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-254834a1-6634-482c-9f9f-7d91f9f2113c tempest-VolumeDependencyTests-311348281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:41:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-254834a1-6634-482c-9f9f-7d91f9f2113c tempest-VolumeDependencyTests-311348281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:41:24 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-254834a1-6634-482c-9f9f-7d91f9f2113c tempest-VolumeDependencyTests-311348281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:41:24 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-254834a1-6634-482c-9f9f-7d91f9f2113c tempest-VolumeDependencyTests-311348281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:41:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-254834a1-6634-482c-9f9f-7d91f9f2113c tempest-VolumeDependencyTests-311348281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:41:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-254834a1-6634-482c-9f9f-7d91f9f2113c tempest-VolumeDependencyTests-311348281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:24 devstack sudo[103705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:41:24 devstack sudo[103705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:24 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a86e7b8a-cc40-459d-87ff-8cb693510717 tempest-VolumeDependencyTests-311348281 None] Acquiring lock "cinder-60daff88-d9b4-4e3a-b4e7-c93775154555-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:41:24 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a86e7b8a-cc40-459d-87ff-8cb693510717 tempest-VolumeDependencyTests-311348281 None] Lock "cinder-60daff88-d9b4-4e3a-b4e7-c93775154555-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:41:24 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a86e7b8a-cc40-459d-87ff-8cb693510717 tempest-VolumeDependencyTests-311348281 None] Acquiring lock "cinder-quobyte-60daff88-d9b4-4e3a-b4e7-c93775154555" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:41:24 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a86e7b8a-cc40-459d-87ff-8cb693510717 tempest-VolumeDependencyTests-311348281 None] Lock "cinder-quobyte-60daff88-d9b4-4e3a-b4e7-c93775154555" acquired by "delete_volume" :: waited 0.025s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:41:24 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f74aee1-2c24-4024-a35a-c0076da29253]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:41:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a86e7b8a-cc40-459d-87ff-8cb693510717 tempest-VolumeDependencyTests-311348281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60daff88-d9b4-4e3a-b4e7-c93775154555 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:24 devstack sudo[103725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60daff88-d9b4-4e3a-b4e7-c93775154555 Jul 11 04:41:24 devstack sudo[103725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:25 devstack sudo[103705]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-254834a1-6634-482c-9f9f-7d91f9f2113c tempest-VolumeDependencyTests-311348281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.890s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:25 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-254834a1-6634-482c-9f9f-7d91f9f2113c tempest-VolumeDependencyTests-311348281 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:41:25 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-254834a1-6634-482c-9f9f-7d91f9f2113c tempest-VolumeDependencyTests-311348281 None] Deleted volume successfully. Jul 11 04:41:25 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-254834a1-6634-482c-9f9f-7d91f9f2113c tempest-VolumeDependencyTests-311348281 None] Lock "cinder-7deba331-edbf-4048-a066-a35ed51e21fd-delete_volume" released by "delete_volume" :: held 2.736s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:41:25 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-17984170-d379-452a-924c-67cee33ae6d3 req-19760497-86e8-4fe1-9389-d9c708434972 tempest-TestShelveInstance-285084155 None] Terminate volume connection completed successfully. Jul 11 04:41:25 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-17984170-d379-452a-924c-67cee33ae6d3 req-19760497-86e8-4fe1-9389-d9c708434972 tempest-TestShelveInstance-285084155 None] Deleting attachment 1fe1b256-d33b-4d60-8bd1-c76752e0fb24. {{(pid=86964) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 04:41:25 devstack sudo[103725]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a86e7b8a-cc40-459d-87ff-8cb693510717 tempest-VolumeDependencyTests-311348281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60daff88-d9b4-4e3a-b4e7-c93775154555" returned: 0 in 0.870s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a86e7b8a-cc40-459d-87ff-8cb693510717 tempest-VolumeDependencyTests-311348281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60daff88-d9b4-4e3a-b4e7-c93775154555 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:25 devstack sudo[103731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60daff88-d9b4-4e3a-b4e7-c93775154555 Jul 11 04:41:25 devstack sudo[103731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:26 devstack sudo[103731]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a86e7b8a-cc40-459d-87ff-8cb693510717 tempest-VolumeDependencyTests-311348281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-60daff88-d9b4-4e3a-b4e7-c93775154555" returned: 0 in 0.848s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:26 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a86e7b8a-cc40-459d-87ff-8cb693510717 tempest-VolumeDependencyTests-311348281 None] Lock "cinder-quobyte-60daff88-d9b4-4e3a-b4e7-c93775154555" released by "delete_volume" :: held 1.767s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:41:26 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-a86e7b8a-cc40-459d-87ff-8cb693510717 tempest-VolumeDependencyTests-311348281 None] Created reservations ['300d85df-6c31-441d-9582-ba7bb8bbad8e', '1ec23d9d-e307-4f04-98b4-ae02f19b7480', 'd41a80e1-418a-46a6-b689-d473e7dd39c9', '6a276267-9155-4d96-b195-64fbb068be8f'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:41:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a86e7b8a-cc40-459d-87ff-8cb693510717 tempest-VolumeDependencyTests-311348281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:41:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a86e7b8a-cc40-459d-87ff-8cb693510717 tempest-VolumeDependencyTests-311348281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:41:26 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-a86e7b8a-cc40-459d-87ff-8cb693510717 tempest-VolumeDependencyTests-311348281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:41:26 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-a86e7b8a-cc40-459d-87ff-8cb693510717 tempest-VolumeDependencyTests-311348281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:41:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a86e7b8a-cc40-459d-87ff-8cb693510717 tempest-VolumeDependencyTests-311348281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:41:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a86e7b8a-cc40-459d-87ff-8cb693510717 tempest-VolumeDependencyTests-311348281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:26 devstack sudo[103736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:41:26 devstack sudo[103736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:27 devstack sudo[103736]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a86e7b8a-cc40-459d-87ff-8cb693510717 tempest-VolumeDependencyTests-311348281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.965s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:27 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-a86e7b8a-cc40-459d-87ff-8cb693510717 tempest-VolumeDependencyTests-311348281 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:41:27 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-a86e7b8a-cc40-459d-87ff-8cb693510717 tempest-VolumeDependencyTests-311348281 None] Deleted volume successfully. Jul 11 04:41:27 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a86e7b8a-cc40-459d-87ff-8cb693510717 tempest-VolumeDependencyTests-311348281 None] Lock "cinder-60daff88-d9b4-4e3a-b4e7-c93775154555-delete_volume" released by "delete_volume" :: held 3.035s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:41:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-090eed56-9d66-4675-8ab6-2f23f5f259a3 req-d8fff4d0-b00e-49c2-9dfc-ac7df487ba83 tempest-TestShelveInstance-285084155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:41:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-090eed56-9d66-4675-8ab6-2f23f5f259a3 req-d8fff4d0-b00e-49c2-9dfc-ac7df487ba83 tempest-TestShelveInstance-285084155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:41:31 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[847e0d21-f02e-4218-a50e-85a37c1d48fc]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:41:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-090eed56-9d66-4675-8ab6-2f23f5f259a3 req-d8fff4d0-b00e-49c2-9dfc-ac7df487ba83 tempest-TestShelveInstance-285084155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:31 devstack sudo[103752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02 Jul 11 04:41:31 devstack sudo[103752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:32 devstack sudo[103752]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-090eed56-9d66-4675-8ab6-2f23f5f259a3 req-d8fff4d0-b00e-49c2-9dfc-ac7df487ba83 tempest-TestShelveInstance-285084155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02" returned: 0 in 0.974s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-090eed56-9d66-4675-8ab6-2f23f5f259a3 req-d8fff4d0-b00e-49c2-9dfc-ac7df487ba83 tempest-TestShelveInstance-285084155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:32 devstack sudo[103756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02 Jul 11 04:41:32 devstack sudo[103756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:33 devstack sudo[103756]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:33 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:41:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Flow 'volume_create_manager' (64c3de8d-e049-41e8-8f9f-cbf5a18ba8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:41:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (510c67ce-aa76-4f0d-9176-fb0541749d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:41:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-090eed56-9d66-4675-8ab6-2f23f5f259a3 req-d8fff4d0-b00e-49c2-9dfc-ac7df487ba83 tempest-TestShelveInstance-285084155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02" returned: 1 in 1.134s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-090eed56-9d66-4675-8ab6-2f23f5f259a3 req-d8fff4d0-b00e-49c2-9dfc-ac7df487ba83 tempest-TestShelveInstance-285084155 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:41:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-090eed56-9d66-4675-8ab6-2f23f5f259a3 req-d8fff4d0-b00e-49c2-9dfc-ac7df487ba83 tempest-TestShelveInstance-285084155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.155s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:41:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (510c67ce-aa76-4f0d-9176-fb0541749d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:41:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee3c786a-aea6-46a8-ad6c-f25ba20f3d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c793f20158ad4d9db61697f63f432a0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:41:33Z,use_quota=True,user_id='2de5c51da4874d3ca3eb763764682296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:41:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5153c2a5-4780-4a95-aa73-6a8117b8410e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:41:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5153c2a5-4780-4a95-aa73-6a8117b8410e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:41:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fddbfc8-0e18-4101-9118-5da78a500acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:41:33 devstack cinder-volume[86964]: DEBUG cinder.image.glance [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Creating Keystone auth plugin from conf {{(pid=86964) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 04:41:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-090eed56-9d66-4675-8ab6-2f23f5f259a3 req-d8fff4d0-b00e-49c2-9dfc-ac7df487ba83 tempest-TestShelveInstance-285084155 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95', 'name': 'volume-d4cec864-6160-42ef-a08c-d9eb3c601c02', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '395f0b1a-162c-4136-b23f-2c690460fe5a', 'enforce_multipath': True} {{(pid=86964) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 04:41:33 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-090eed56-9d66-4675-8ab6-2f23f5f259a3 req-d8fff4d0-b00e-49c2-9dfc-ac7df487ba83 tempest-TestShelveInstance-285084155 None] attachment_update completed successfully. Jul 11 04:41:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fddbfc8-0e18-4101-9118-5da78a500acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ee3c786a-aea6-46a8-ad6c-f25ba20f3d83', 'volume_name': 'volume-ee3c786a-aea6-46a8-ad6c-f25ba20f3d83', 'volume_size': 1, 'image_id': 'f511094c-606f-48b1-932b-a5e086efb9c4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f511094c-606f-48b1-932b-a5e086efb9c4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '48caf0b2187076b2253d41fdd585c0ab', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c793f20158ad4d9db61697f63f432a0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2e64874504484d43b2c2275635b78b78b8ccdaaaef914730a748d51a1c2daa445dd9b2089850bd0a763c1a7fbdec7abd1bb604ed4ee28d6a9a521ce53fb56d93', 'id': 'f511094c-606f-48b1-932b-a5e086efb9c4', 'created_at': datetime.datetime(2026, 7, 11, 2, 41, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 41, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f511094c-606f-48b1-932b-a5e086efb9c4/file', 'properties': {}}, 'image_service': }' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:41:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c83571c-a8e1-469d-851f-5a9104bf7cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:41:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c83571c-a8e1-469d-851f-5a9104bf7cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:41:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (549aca0a-a439-4474-a86e-e15dfa833dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:41:33 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Volume ee3c786a-aea6-46a8-ad6c-f25ba20f3d83: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ee3c786a-aea6-46a8-ad6c-f25ba20f3d83', 'volume_size': 1, 'image_id': 'f511094c-606f-48b1-932b-a5e086efb9c4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f511094c-606f-48b1-932b-a5e086efb9c4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '48caf0b2187076b2253d41fdd585c0ab', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c793f20158ad4d9db61697f63f432a0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2e64874504484d43b2c2275635b78b78b8ccdaaaef914730a748d51a1c2daa445dd9b2089850bd0a763c1a7fbdec7abd1bb604ed4ee28d6a9a521ce53fb56d93', 'id': 'f511094c-606f-48b1-932b-a5e086efb9c4', 'created_at': datetime.datetime(2026, 7, 11, 2, 41, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 41, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f511094c-606f-48b1-932b-a5e086efb9c4/file', 'properties': {}}, 'image_service': } Jul 11 04:41:33 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Trying to clone ee3c786a-aea6-46a8-ad6c-f25ba20f3d83 from image f511094c-606f-48b1-932b-a5e086efb9c4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f511094c-606f-48b1-932b-a5e086efb9c4', 'metadata': {}}]). {{(pid=86964) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 04:41:34 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f511094c-606f-48b1-932b-a5e086efb9c4_qnyohjqfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86964) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 11 04:41:34 devstack cinder-volume[86964]: INFO cinder.image.image_utils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Image download 0.00 MB at 0.00 MB/s Jul 11 04:41:34 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e53d706-a58c-4cb0-be55-3f6e2ed55485]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:41:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f511094c-606f-48b1-932b-a5e086efb9c4_qnyohjqfdevstack@QuobyteHD {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:34 devstack sudo[103763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f511094c-606f-48b1-932b-a5e086efb9c4_qnyohjqfdevstack@QuobyteHD Jul 11 04:41:34 devstack sudo[103763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:34 devstack sudo[103763]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f511094c-606f-48b1-932b-a5e086efb9c4_qnyohjqfdevstack@QuobyteHD" returned: 0 in 0.804s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f511094c-606f-48b1-932b-a5e086efb9c4_qnyohjqfdevstack@QuobyteHD {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:35 devstack sudo[103767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f511094c-606f-48b1-932b-a5e086efb9c4_qnyohjqfdevstack@QuobyteHD Jul 11 04:41:35 devstack sudo[103767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:35 devstack sudo[103767]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f511094c-606f-48b1-932b-a5e086efb9c4_qnyohjqfdevstack@QuobyteHD" returned: 1 in 0.761s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f511094c-606f-48b1-932b-a5e086efb9c4_qnyohjqfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:41:35 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Temporary image f511094c-606f-48b1-932b-a5e086efb9c4 is fetched for user 2de5c51da4874d3ca3eb763764682296. {{(pid=86964) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 11 04:41:35 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7ac63f-4f66-498b-917b-ab55e7ac5501]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:41:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f511094c-606f-48b1-932b-a5e086efb9c4_qnyohjqfdevstack@QuobyteHD {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:35 devstack sudo[103773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f511094c-606f-48b1-932b-a5e086efb9c4_qnyohjqfdevstack@QuobyteHD Jul 11 04:41:35 devstack sudo[103773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:36 devstack sudo[103773]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f511094c-606f-48b1-932b-a5e086efb9c4_qnyohjqfdevstack@QuobyteHD" returned: 0 in 0.771s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f511094c-606f-48b1-932b-a5e086efb9c4_qnyohjqfdevstack@QuobyteHD {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:36 devstack sudo[103779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f511094c-606f-48b1-932b-a5e086efb9c4_qnyohjqfdevstack@QuobyteHD Jul 11 04:41:36 devstack sudo[103779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:37 devstack sudo[103779]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f511094c-606f-48b1-932b-a5e086efb9c4_qnyohjqfdevstack@QuobyteHD" returned: 1 in 0.799s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f511094c-606f-48b1-932b-a5e086efb9c4_qnyohjqfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:41:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:41:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:41:37 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:41:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee3c786a-aea6-46a8-ad6c-f25ba20f3d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c793f20158ad4d9db61697f63f432a0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:41:33Z,use_quota=True,user_id='2de5c51da4874d3ca3eb763764682296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:41:37 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Creating volume ee3c786a-aea6-46a8-ad6c-f25ba20f3d83 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:41:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:41:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:41:37 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:41:37 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:41:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:41:37 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:41:37 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:41:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ee3c786a-aea6-46a8-ad6c-f25ba20f3d83 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:37 devstack sudo[103784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ee3c786a-aea6-46a8-ad6c-f25ba20f3d83 1073741824 Jul 11 04:41:37 devstack sudo[103784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:38 devstack sudo[103784]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ee3c786a-aea6-46a8-ad6c-f25ba20f3d83 1073741824" returned: 0 in 0.861s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:38 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=58,cinder:INSERT=22,cinder:UPDATE=57,cinder:DELETE=5 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:41:38 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=69,cinder:UPDATE=52,cinder:INSERT=24,cinder:DELETE=4 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:41:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ee3c786a-aea6-46a8-ad6c-f25ba20f3d83 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:38 devstack sudo[103790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ee3c786a-aea6-46a8-ad6c-f25ba20f3d83 Jul 11 04:41:38 devstack sudo[103790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:39 devstack sudo[103790]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ee3c786a-aea6-46a8-ad6c-f25ba20f3d83" returned: 0 in 0.721s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:39 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:41:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:41:39 devstack cinder-volume[86964]: DEBUG cinder.volume.volume_utils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Attempting download of f511094c-606f-48b1-932b-a5e086efb9c4 ((None, [{'url': 'file:///opt/stack/data/glance/images/f511094c-606f-48b1-932b-a5e086efb9c4', 'metadata': {}}])) to volume ee3c786a-aea6-46a8-ad6c-f25ba20f3d83. {{(pid=86964) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 04:41:39 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0718b4-6ee1-4618-8018-0be2fb9e9e77]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:41:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f511094c-606f-48b1-932b-a5e086efb9c4_kc8cxmxm {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:39 devstack sudo[103793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f511094c-606f-48b1-932b-a5e086efb9c4_kc8cxmxm Jul 11 04:41:39 devstack sudo[103793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:39 devstack sudo[103793]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f511094c-606f-48b1-932b-a5e086efb9c4_kc8cxmxm" returned: 0 in 0.859s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f511094c-606f-48b1-932b-a5e086efb9c4_kc8cxmxm {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:40 devstack sudo[103798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f511094c-606f-48b1-932b-a5e086efb9c4_kc8cxmxm Jul 11 04:41:40 devstack sudo[103798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:40 devstack sudo[103798]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f511094c-606f-48b1-932b-a5e086efb9c4_kc8cxmxm" returned: 1 in 0.896s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f511094c-606f-48b1-932b-a5e086efb9c4_kc8cxmxm' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:41:40 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ca165d-5516-4ac4-a8f7-ae56f317697d]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:41:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f511094c-606f-48b1-932b-a5e086efb9c4_qnyohjqfdevstack@QuobyteHD {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:40 devstack sudo[103802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f511094c-606f-48b1-932b-a5e086efb9c4_qnyohjqfdevstack@QuobyteHD Jul 11 04:41:40 devstack sudo[103802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:41 devstack sudo[103802]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f511094c-606f-48b1-932b-a5e086efb9c4_qnyohjqfdevstack@QuobyteHD" returned: 0 in 0.846s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f511094c-606f-48b1-932b-a5e086efb9c4_qnyohjqfdevstack@QuobyteHD {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:41 devstack sudo[103874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f511094c-606f-48b1-932b-a5e086efb9c4_qnyohjqfdevstack@QuobyteHD Jul 11 04:41:41 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:42 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f511094c-606f-48b1-932b-a5e086efb9c4_qnyohjqfdevstack@QuobyteHD" returned: 1 in 0.867s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f511094c-606f-48b1-932b-a5e086efb9c4_qnyohjqfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:41:42 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] f511094c-606f-48b1-932b-a5e086efb9c4 was raw, converting to raw {{(pid=86964) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 11 04:41:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f511094c-606f-48b1-932b-a5e086efb9c4_qnyohjqfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ee3c786a-aea6-46a8-ad6c-f25ba20f3d83 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:42 devstack sudo[103879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f511094c-606f-48b1-932b-a5e086efb9c4_qnyohjqfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ee3c786a-aea6-46a8-ad6c-f25ba20f3d83 Jul 11 04:41:42 devstack sudo[103879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:43 devstack sudo[103879]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f511094c-606f-48b1-932b-a5e086efb9c4_qnyohjqfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ee3c786a-aea6-46a8-ad6c-f25ba20f3d83" returned: 0 in 1.027s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:43 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f511094c-606f-48b1-932b-a5e086efb9c4_qnyohjqfdevstack@QuobyteHD, size 0.00 MB, duration 1.03 sec, destination /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ee3c786a-aea6-46a8-ad6c-f25ba20f3d83 {{(pid=86964) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 04:41:43 devstack cinder-volume[86964]: INFO cinder.image.image_utils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Converted 0.00 MB image at 0.00 MB/s Jul 11 04:41:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ee3c786a-aea6-46a8-ad6c-f25ba20f3d83 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:43 devstack sudo[103923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ee3c786a-aea6-46a8-ad6c-f25ba20f3d83 1G Jul 11 04:41:43 devstack sudo[103923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:44 devstack sudo[103923]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ee3c786a-aea6-46a8-ad6c-f25ba20f3d83 1G" returned: 0 in 0.957s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:44 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[1188112d-12f1-42f1-b351-f261525c6912]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:41:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ee3c786a-aea6-46a8-ad6c-f25ba20f3d83 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:44 devstack sudo[103945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ee3c786a-aea6-46a8-ad6c-f25ba20f3d83 Jul 11 04:41:44 devstack sudo[103945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:45 devstack sudo[103945]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ee3c786a-aea6-46a8-ad6c-f25ba20f3d83" returned: 0 in 1.100s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ee3c786a-aea6-46a8-ad6c-f25ba20f3d83 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:45 devstack sudo[104272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ee3c786a-aea6-46a8-ad6c-f25ba20f3d83 Jul 11 04:41:45 devstack sudo[104272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:46 devstack sudo[104272]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ee3c786a-aea6-46a8-ad6c-f25ba20f3d83" returned: 1 in 1.178s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ee3c786a-aea6-46a8-ad6c-f25ba20f3d83' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:41:46 devstack cinder-volume[86964]: DEBUG cinder.volume.volume_utils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Downloaded image f511094c-606f-48b1-932b-a5e086efb9c4 ((None, [{'url': 'file:///opt/stack/data/glance/images/f511094c-606f-48b1-932b-a5e086efb9c4', 'metadata': {}}])) to volume ee3c786a-aea6-46a8-ad6c-f25ba20f3d83 successfully. {{(pid=86964) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 04:41:46 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Temporary image f511094c-606f-48b1-932b-a5e086efb9c4 for user 2de5c51da4874d3ca3eb763764682296 is deleted. {{(pid=86964) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 11 04:41:46 devstack cinder-volume[86964]: DEBUG cinder.volume.volume_utils [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Marking volume ee3c786a-aea6-46a8-ad6c-f25ba20f3d83 as bootable. {{(pid=86964) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 04:41:46 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Copying metadata from image f511094c-606f-48b1-932b-a5e086efb9c4 to ee3c786a-aea6-46a8-ad6c-f25ba20f3d83. {{(pid=86964) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 04:41:46 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Creating volume glance metadata for volume ee3c786a-aea6-46a8-ad6c-f25ba20f3d83 backed by image f511094c-606f-48b1-932b-a5e086efb9c4 with: {'image_id': 'f511094c-606f-48b1-932b-a5e086efb9c4', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '48caf0b2187076b2253d41fdd585c0ab', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86964) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 04:41:47 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (549aca0a-a439-4474-a86e-e15dfa833dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee3c786a-aea6-46a8-ad6c-f25ba20f3d83', 'volume_size': 1, 'image_id': 'f511094c-606f-48b1-932b-a5e086efb9c4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f511094c-606f-48b1-932b-a5e086efb9c4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '48caf0b2187076b2253d41fdd585c0ab', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c793f20158ad4d9db61697f63f432a0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2e64874504484d43b2c2275635b78b78b8ccdaaaef914730a748d51a1c2daa445dd9b2089850bd0a763c1a7fbdec7abd1bb604ed4ee28d6a9a521ce53fb56d93', 'id': 'f511094c-606f-48b1-932b-a5e086efb9c4', 'created_at': datetime.datetime(2026, 7, 11, 2, 41, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 41, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f511094c-606f-48b1-932b-a5e086efb9c4/file', 'properties': {}}, 'image_service': }' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:41:47 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c86ffe7-7e81-4941-8f0d-7ac594ce6ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:41:47 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Volume volume-ee3c786a-aea6-46a8-ad6c-f25ba20f3d83 (ee3c786a-aea6-46a8-ad6c-f25ba20f3d83): created successfully Jul 11 04:41:47 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c86ffe7-7e81-4941-8f0d-7ac594ce6ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:41:47 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Flow 'volume_create_manager' (64c3de8d-e049-41e8-8f9f-cbf5a18ba8a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:41:47 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-5d853260-a4af-4207-a4c9-39b134b84a8c tempest-VolumeImageDependencyTests-1885241687 None] Created volume successfully. Jul 11 04:41:47 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-df2f6c89-912b-4177-a45a-bcac9e19520c tempest-VolumeImageDependencyTests-1885241687 None] Acquiring lock "cinder-ee3c786a-aea6-46a8-ad6c-f25ba20f3d83-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:41:47 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-df2f6c89-912b-4177-a45a-bcac9e19520c tempest-VolumeImageDependencyTests-1885241687 None] Lock "cinder-ee3c786a-aea6-46a8-ad6c-f25ba20f3d83-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:41:47 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-df2f6c89-912b-4177-a45a-bcac9e19520c tempest-VolumeImageDependencyTests-1885241687 None] Acquiring lock "cinder-quobyte-ee3c786a-aea6-46a8-ad6c-f25ba20f3d83" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:41:47 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-df2f6c89-912b-4177-a45a-bcac9e19520c tempest-VolumeImageDependencyTests-1885241687 None] Lock "cinder-quobyte-ee3c786a-aea6-46a8-ad6c-f25ba20f3d83" acquired by "delete_volume" :: waited 0.017s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:41:47 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7d34ae-9a0d-422d-99e3-c662cc723f65]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:41:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-df2f6c89-912b-4177-a45a-bcac9e19520c tempest-VolumeImageDependencyTests-1885241687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ee3c786a-aea6-46a8-ad6c-f25ba20f3d83 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:48 devstack sudo[104281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ee3c786a-aea6-46a8-ad6c-f25ba20f3d83 Jul 11 04:41:48 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:48 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-df2f6c89-912b-4177-a45a-bcac9e19520c tempest-VolumeImageDependencyTests-1885241687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ee3c786a-aea6-46a8-ad6c-f25ba20f3d83" returned: 0 in 0.856s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-df2f6c89-912b-4177-a45a-bcac9e19520c tempest-VolumeImageDependencyTests-1885241687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ee3c786a-aea6-46a8-ad6c-f25ba20f3d83 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:48 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ee3c786a-aea6-46a8-ad6c-f25ba20f3d83 Jul 11 04:41:48 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:49 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-df2f6c89-912b-4177-a45a-bcac9e19520c tempest-VolumeImageDependencyTests-1885241687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ee3c786a-aea6-46a8-ad6c-f25ba20f3d83" returned: 1 in 0.833s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-df2f6c89-912b-4177-a45a-bcac9e19520c tempest-VolumeImageDependencyTests-1885241687 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ee3c786a-aea6-46a8-ad6c-f25ba20f3d83' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:41:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-df2f6c89-912b-4177-a45a-bcac9e19520c tempest-VolumeImageDependencyTests-1885241687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ee3c786a-aea6-46a8-ad6c-f25ba20f3d83 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:49 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ee3c786a-aea6-46a8-ad6c-f25ba20f3d83 Jul 11 04:41:49 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:50 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-df2f6c89-912b-4177-a45a-bcac9e19520c tempest-VolumeImageDependencyTests-1885241687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ee3c786a-aea6-46a8-ad6c-f25ba20f3d83" returned: 0 in 0.841s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-df2f6c89-912b-4177-a45a-bcac9e19520c tempest-VolumeImageDependencyTests-1885241687 None] Lock "cinder-quobyte-ee3c786a-aea6-46a8-ad6c-f25ba20f3d83" released by "delete_volume" :: held 2.600s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:41:50 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-df2f6c89-912b-4177-a45a-bcac9e19520c tempest-VolumeImageDependencyTests-1885241687 None] Created reservations ['044481ee-f226-4681-9b43-e6b7da209af3', '127b4db6-f04f-40ca-af0b-b8b91c72a4d1', '2fcef744-0fc7-4d8c-922e-79fae66684aa', 'f3cc2a31-3078-4d1e-9ffe-839a252746d3'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:41:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-df2f6c89-912b-4177-a45a-bcac9e19520c tempest-VolumeImageDependencyTests-1885241687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:41:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-df2f6c89-912b-4177-a45a-bcac9e19520c tempest-VolumeImageDependencyTests-1885241687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:41:50 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-df2f6c89-912b-4177-a45a-bcac9e19520c tempest-VolumeImageDependencyTests-1885241687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:41:50 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-df2f6c89-912b-4177-a45a-bcac9e19520c tempest-VolumeImageDependencyTests-1885241687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:41:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-df2f6c89-912b-4177-a45a-bcac9e19520c tempest-VolumeImageDependencyTests-1885241687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:41:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-df2f6c89-912b-4177-a45a-bcac9e19520c tempest-VolumeImageDependencyTests-1885241687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:50 devstack sudo[104293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:41:50 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:51 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-df2f6c89-912b-4177-a45a-bcac9e19520c tempest-VolumeImageDependencyTests-1885241687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 1.143s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:51 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-df2f6c89-912b-4177-a45a-bcac9e19520c tempest-VolumeImageDependencyTests-1885241687 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:41:51 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-df2f6c89-912b-4177-a45a-bcac9e19520c tempest-VolumeImageDependencyTests-1885241687 None] Deleted volume successfully. Jul 11 04:41:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-df2f6c89-912b-4177-a45a-bcac9e19520c tempest-VolumeImageDependencyTests-1885241687 None] Lock "cinder-ee3c786a-aea6-46a8-ad6c-f25ba20f3d83-delete_volume" released by "delete_volume" :: held 4.042s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:41:55 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-814656c9-2744-4609-885c-7481ca5b740e tempest-CinderUnicodeTest-1497280626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:41:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-814656c9-2744-4609-885c-7481ca5b740e tempest-CinderUnicodeTest-1497280626 None] Flow 'volume_create_manager' (c8d32808-1c77-4e4a-9fda-79bab57e4d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:41:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-814656c9-2744-4609-885c-7481ca5b740e tempest-CinderUnicodeTest-1497280626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (519f0153-dc3d-4744-b562-2ad26950eb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:41:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-814656c9-2744-4609-885c-7481ca5b740e tempest-CinderUnicodeTest-1497280626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (519f0153-dc3d-4744-b562-2ad26950eb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e400b1d-d2eb-4c75-873a-c28e774dc503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abf2a596add341c7a85a9ed0ee430320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:41:55Z,use_quota=True,user_id='e02783010fb0485681e2786cfbf22b9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:41:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-814656c9-2744-4609-885c-7481ca5b740e tempest-CinderUnicodeTest-1497280626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (117b90d1-76a9-4d9f-ab11-215316a6e6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:41:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-814656c9-2744-4609-885c-7481ca5b740e tempest-CinderUnicodeTest-1497280626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (117b90d1-76a9-4d9f-ab11-215316a6e6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:41:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-814656c9-2744-4609-885c-7481ca5b740e tempest-CinderUnicodeTest-1497280626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c7f66f3-c302-4971-9c11-f2471adb2af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:41:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-814656c9-2744-4609-885c-7481ca5b740e tempest-CinderUnicodeTest-1497280626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c7f66f3-c302-4971-9c11-f2471adb2af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e400b1d-d2eb-4c75-873a-c28e774dc503', 'volume_name': 'volume-3e400b1d-d2eb-4c75-873a-c28e774dc503', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:41:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-814656c9-2744-4609-885c-7481ca5b740e tempest-CinderUnicodeTest-1497280626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (895f2677-71ed-4623-a88f-32e5f53febc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:41:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-814656c9-2744-4609-885c-7481ca5b740e tempest-CinderUnicodeTest-1497280626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (895f2677-71ed-4623-a88f-32e5f53febc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:41:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-814656c9-2744-4609-885c-7481ca5b740e tempest-CinderUnicodeTest-1497280626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (821d4064-f535-425e-8154-b96c7f9bd5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:41:55 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-814656c9-2744-4609-885c-7481ca5b740e tempest-CinderUnicodeTest-1497280626 None] Volume 3e400b1d-d2eb-4c75-873a-c28e774dc503: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e400b1d-d2eb-4c75-873a-c28e774dc503', 'volume_size': 1} Jul 11 04:41:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-814656c9-2744-4609-885c-7481ca5b740e tempest-CinderUnicodeTest-1497280626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:41:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-814656c9-2744-4609-885c-7481ca5b740e tempest-CinderUnicodeTest-1497280626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:41:55 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-814656c9-2744-4609-885c-7481ca5b740e tempest-CinderUnicodeTest-1497280626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e400b1d-d2eb-4c75-873a-c28e774dc503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abf2a596add341c7a85a9ed0ee430320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:41:55Z,use_quota=True,user_id='e02783010fb0485681e2786cfbf22b9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:41:55 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-814656c9-2744-4609-885c-7481ca5b740e tempest-CinderUnicodeTest-1497280626 None] Creating volume 3e400b1d-d2eb-4c75-873a-c28e774dc503 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:41:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-814656c9-2744-4609-885c-7481ca5b740e tempest-CinderUnicodeTest-1497280626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:41:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-814656c9-2744-4609-885c-7481ca5b740e tempest-CinderUnicodeTest-1497280626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:41:55 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-814656c9-2744-4609-885c-7481ca5b740e tempest-CinderUnicodeTest-1497280626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:41:55 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-814656c9-2744-4609-885c-7481ca5b740e tempest-CinderUnicodeTest-1497280626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:41:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-814656c9-2744-4609-885c-7481ca5b740e tempest-CinderUnicodeTest-1497280626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:41:55 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-814656c9-2744-4609-885c-7481ca5b740e tempest-CinderUnicodeTest-1497280626 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:41:55 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-814656c9-2744-4609-885c-7481ca5b740e tempest-CinderUnicodeTest-1497280626 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:41:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-814656c9-2744-4609-885c-7481ca5b740e tempest-CinderUnicodeTest-1497280626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3e400b1d-d2eb-4c75-873a-c28e774dc503 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:55 devstack sudo[104296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3e400b1d-d2eb-4c75-873a-c28e774dc503 1073741824 Jul 11 04:41:55 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:56 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-814656c9-2744-4609-885c-7481ca5b740e tempest-CinderUnicodeTest-1497280626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3e400b1d-d2eb-4c75-873a-c28e774dc503 1073741824" returned: 0 in 0.995s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-814656c9-2744-4609-885c-7481ca5b740e tempest-CinderUnicodeTest-1497280626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3e400b1d-d2eb-4c75-873a-c28e774dc503 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:56 devstack sudo[104303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3e400b1d-d2eb-4c75-873a-c28e774dc503 Jul 11 04:41:56 devstack sudo[104303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:57 devstack sudo[104303]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-814656c9-2744-4609-885c-7481ca5b740e tempest-CinderUnicodeTest-1497280626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3e400b1d-d2eb-4c75-873a-c28e774dc503" returned: 0 in 0.710s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:57 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-814656c9-2744-4609-885c-7481ca5b740e tempest-CinderUnicodeTest-1497280626 None] <== create_volume: return (1759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:41:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-814656c9-2744-4609-885c-7481ca5b740e tempest-CinderUnicodeTest-1497280626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.762s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:41:57 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-814656c9-2744-4609-885c-7481ca5b740e tempest-CinderUnicodeTest-1497280626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (821d4064-f535-425e-8154-b96c7f9bd5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e400b1d-d2eb-4c75-873a-c28e774dc503', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:41:57 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-814656c9-2744-4609-885c-7481ca5b740e tempest-CinderUnicodeTest-1497280626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (240ae5d0-992d-470b-ae47-9071a0d3b158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:41:57 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-814656c9-2744-4609-885c-7481ca5b740e tempest-CinderUnicodeTest-1497280626 None] Volume volume-3e400b1d-d2eb-4c75-873a-c28e774dc503 (3e400b1d-d2eb-4c75-873a-c28e774dc503): created successfully Jul 11 04:41:57 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-814656c9-2744-4609-885c-7481ca5b740e tempest-CinderUnicodeTest-1497280626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (240ae5d0-992d-470b-ae47-9071a0d3b158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:41:57 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-814656c9-2744-4609-885c-7481ca5b740e tempest-CinderUnicodeTest-1497280626 None] Flow 'volume_create_manager' (c8d32808-1c77-4e4a-9fda-79bab57e4d6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:41:57 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-814656c9-2744-4609-885c-7481ca5b740e tempest-CinderUnicodeTest-1497280626 None] Created volume successfully. Jul 11 04:41:58 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-db90297b-b877-4c6b-b350-bf27c16b7e18 tempest-CinderUnicodeTest-1497280626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:41:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-db90297b-b877-4c6b-b350-bf27c16b7e18 tempest-CinderUnicodeTest-1497280626 None] Flow 'volume_create_manager' (db996e05-fec3-447d-a564-a75ff1582f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:41:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-db90297b-b877-4c6b-b350-bf27c16b7e18 tempest-CinderUnicodeTest-1497280626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e72e65a-7fd8-4e1d-8160-2a2275fc0380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:41:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-db90297b-b877-4c6b-b350-bf27c16b7e18 tempest-CinderUnicodeTest-1497280626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e72e65a-7fd8-4e1d-8160-2a2275fc0380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:41:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-836169919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=198ed219-4ca7-41fe-998d-9f31ecfad6a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abf2a596add341c7a85a9ed0ee430320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:41:58Z,use_quota=True,user_id='e02783010fb0485681e2786cfbf22b9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:41:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-db90297b-b877-4c6b-b350-bf27c16b7e18 tempest-CinderUnicodeTest-1497280626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f41dd4dc-3c82-43d9-8341-22655f247da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:41:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-db90297b-b877-4c6b-b350-bf27c16b7e18 tempest-CinderUnicodeTest-1497280626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f41dd4dc-3c82-43d9-8341-22655f247da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:41:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-db90297b-b877-4c6b-b350-bf27c16b7e18 tempest-CinderUnicodeTest-1497280626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c96ed40-1848-4881-9f6a-31927912d00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:41:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-db90297b-b877-4c6b-b350-bf27c16b7e18 tempest-CinderUnicodeTest-1497280626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c96ed40-1848-4881-9f6a-31927912d00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '198ed219-4ca7-41fe-998d-9f31ecfad6a2', 'volume_name': 'volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:41:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-db90297b-b877-4c6b-b350-bf27c16b7e18 tempest-CinderUnicodeTest-1497280626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5feaeebf-2c6b-42d0-af31-de9bff0c3b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:41:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-db90297b-b877-4c6b-b350-bf27c16b7e18 tempest-CinderUnicodeTest-1497280626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5feaeebf-2c6b-42d0-af31-de9bff0c3b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:41:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-db90297b-b877-4c6b-b350-bf27c16b7e18 tempest-CinderUnicodeTest-1497280626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96347322-9461-4549-80a5-e3f801278d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:41:58 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-db90297b-b877-4c6b-b350-bf27c16b7e18 tempest-CinderUnicodeTest-1497280626 None] Volume 198ed219-4ca7-41fe-998d-9f31ecfad6a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2', 'volume_size': 1} Jul 11 04:41:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-db90297b-b877-4c6b-b350-bf27c16b7e18 tempest-CinderUnicodeTest-1497280626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:41:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-db90297b-b877-4c6b-b350-bf27c16b7e18 tempest-CinderUnicodeTest-1497280626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:41:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-db90297b-b877-4c6b-b350-bf27c16b7e18 tempest-CinderUnicodeTest-1497280626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:41:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-836169919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=198ed219-4ca7-41fe-998d-9f31ecfad6a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abf2a596add341c7a85a9ed0ee430320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:41:58Z,use_quota=True,user_id='e02783010fb0485681e2786cfbf22b9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:41:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-db90297b-b877-4c6b-b350-bf27c16b7e18 tempest-CinderUnicodeTest-1497280626 None] Creating volume 198ed219-4ca7-41fe-998d-9f31ecfad6a2 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:41:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-db90297b-b877-4c6b-b350-bf27c16b7e18 tempest-CinderUnicodeTest-1497280626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:41:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-db90297b-b877-4c6b-b350-bf27c16b7e18 tempest-CinderUnicodeTest-1497280626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:41:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-db90297b-b877-4c6b-b350-bf27c16b7e18 tempest-CinderUnicodeTest-1497280626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:41:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-db90297b-b877-4c6b-b350-bf27c16b7e18 tempest-CinderUnicodeTest-1497280626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:41:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-db90297b-b877-4c6b-b350-bf27c16b7e18 tempest-CinderUnicodeTest-1497280626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:41:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-db90297b-b877-4c6b-b350-bf27c16b7e18 tempest-CinderUnicodeTest-1497280626 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:41:58 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-db90297b-b877-4c6b-b350-bf27c16b7e18 tempest-CinderUnicodeTest-1497280626 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:41:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-db90297b-b877-4c6b-b350-bf27c16b7e18 tempest-CinderUnicodeTest-1497280626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:58 devstack sudo[104307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2 1073741824 Jul 11 04:41:58 devstack sudo[104307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:59 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:41:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:41:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:41:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:41:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:41:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:41:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:59 devstack sudo[104307]: pam_unix(sudo:session): session closed for user root Jul 11 04:41:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-db90297b-b877-4c6b-b350-bf27c16b7e18 tempest-CinderUnicodeTest-1497280626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2 1073741824" returned: 0 in 0.980s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:41:59 devstack sudo[104312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:41:59 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:41:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-db90297b-b877-4c6b-b350-bf27c16b7e18 tempest-CinderUnicodeTest-1497280626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:41:59 devstack sudo[104314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2 Jul 11 04:41:59 devstack sudo[104314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:00 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.884s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:00 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:42:00 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager._thread_info {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:42:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread count: 28 {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:42:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread info: [<_MainThread(MainThread, started 124675027595392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:42:00 devstack sudo[104314]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-db90297b-b877-4c6b-b350-bf27c16b7e18 tempest-CinderUnicodeTest-1497280626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2" returned: 0 in 0.891s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:00 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-db90297b-b877-4c6b-b350-bf27c16b7e18 tempest-CinderUnicodeTest-1497280626 None] <== create_volume: return (1931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:42:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-db90297b-b877-4c6b-b350-bf27c16b7e18 tempest-CinderUnicodeTest-1497280626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.934s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:42:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-db90297b-b877-4c6b-b350-bf27c16b7e18 tempest-CinderUnicodeTest-1497280626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96347322-9461-4549-80a5-e3f801278d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-db90297b-b877-4c6b-b350-bf27c16b7e18 tempest-CinderUnicodeTest-1497280626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69459df2-fc9f-4d82-b359-1d192dfef516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:00 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-db90297b-b877-4c6b-b350-bf27c16b7e18 tempest-CinderUnicodeTest-1497280626 None] Volume volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2 (198ed219-4ca7-41fe-998d-9f31ecfad6a2): created successfully Jul 11 04:42:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-db90297b-b877-4c6b-b350-bf27c16b7e18 tempest-CinderUnicodeTest-1497280626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69459df2-fc9f-4d82-b359-1d192dfef516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-db90297b-b877-4c6b-b350-bf27c16b7e18 tempest-CinderUnicodeTest-1497280626 None] Flow 'volume_create_manager' (db996e05-fec3-447d-a564-a75ff1582f1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:42:00 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-db90297b-b877-4c6b-b350-bf27c16b7e18 tempest-CinderUnicodeTest-1497280626 None] Created volume successfully. Jul 11 04:42:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-78f7392c-c6b3-42f8-9a4d-df57facd9099 tempest-CinderUnicodeTest-1497280626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:42:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-78f7392c-c6b3-42f8-9a4d-df57facd9099 tempest-CinderUnicodeTest-1497280626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:42:01 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-78f7392c-c6b3-42f8-9a4d-df57facd9099 tempest-CinderUnicodeTest-1497280626 None] Creating offline snapshot 9f1ce6fe-d4bf-45b2-9e9c-c298e4c85a0a of volume 198ed219-4ca7-41fe-998d-9f31ecfad6a2 {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:42:01 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d64b8f-f56e-4dec-8562-b21c328f6531]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:42:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-78f7392c-c6b3-42f8-9a4d-df57facd9099 tempest-CinderUnicodeTest-1497280626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:01 devstack sudo[104327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2 Jul 11 04:42:01 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:02 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-78f7392c-c6b3-42f8-9a4d-df57facd9099 tempest-CinderUnicodeTest-1497280626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2" returned: 0 in 0.793s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-78f7392c-c6b3-42f8-9a4d-df57facd9099 tempest-CinderUnicodeTest-1497280626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2.9f1ce6fe-d4bf-45b2-9e9c-c298e4c85a0a 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:02 devstack sudo[104360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2.9f1ce6fe-d4bf-45b2-9e9c-c298e4c85a0a 1G Jul 11 04:42:02 devstack sudo[104360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:03 devstack sudo[104360]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-78f7392c-c6b3-42f8-9a4d-df57facd9099 tempest-CinderUnicodeTest-1497280626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2.9f1ce6fe-d4bf-45b2-9e9c-c298e4c85a0a 1G" returned: 0 in 0.825s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-78f7392c-c6b3-42f8-9a4d-df57facd9099 tempest-CinderUnicodeTest-1497280626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2.9f1ce6fe-d4bf-45b2-9e9c-c298e4c85a0a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:03 devstack sudo[104366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2.9f1ce6fe-d4bf-45b2-9e9c-c298e4c85a0a Jul 11 04:42:03 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:03 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-78f7392c-c6b3-42f8-9a4d-df57facd9099 tempest-CinderUnicodeTest-1497280626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2.9f1ce6fe-d4bf-45b2-9e9c-c298e4c85a0a" returned: 0 in 0.717s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:03 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-78f7392c-c6b3-42f8-9a4d-df57facd9099 tempest-CinderUnicodeTest-1497280626 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2.9f1ce6fe-d4bf-45b2-9e9c-c298e4c85a0a is being set with open permissions: ugo+rw Jul 11 04:42:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-78f7392c-c6b3-42f8-9a4d-df57facd9099 tempest-CinderUnicodeTest-1497280626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2.9f1ce6fe-d4bf-45b2-9e9c-c298e4c85a0a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:03 devstack sudo[104372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2.9f1ce6fe-d4bf-45b2-9e9c-c298e4c85a0a Jul 11 04:42:03 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:04 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-78f7392c-c6b3-42f8-9a4d-df57facd9099 tempest-CinderUnicodeTest-1497280626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2.9f1ce6fe-d4bf-45b2-9e9c-c298e4c85a0a" returned: 0 in 0.643s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-78f7392c-c6b3-42f8-9a4d-df57facd9099 tempest-CinderUnicodeTest-1497280626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:04 devstack sudo[104375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2.info Jul 11 04:42:04 devstack sudo[104375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:05 devstack sudo[104375]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-78f7392c-c6b3-42f8-9a4d-df57facd9099 tempest-CinderUnicodeTest-1497280626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2.info" returned: 0 in 0.663s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:05 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-78f7392c-c6b3-42f8-9a4d-df57facd9099 tempest-CinderUnicodeTest-1497280626 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2.info is being set with open permissions: ugo+rw Jul 11 04:42:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-78f7392c-c6b3-42f8-9a4d-df57facd9099 tempest-CinderUnicodeTest-1497280626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:05 devstack sudo[104378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2.info Jul 11 04:42:05 devstack sudo[104378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:05 devstack sudo[104378]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-78f7392c-c6b3-42f8-9a4d-df57facd9099 tempest-CinderUnicodeTest-1497280626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2.info" returned: 0 in 0.652s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-78f7392c-c6b3-42f8-9a4d-df57facd9099 tempest-CinderUnicodeTest-1497280626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.373s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:42:05 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-78f7392c-c6b3-42f8-9a4d-df57facd9099 tempest-CinderUnicodeTest-1497280626 None] Create snapshot completed successfully Jul 11 04:42:06 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-971669aa-b691-40c0-a8cc-6292836f5efc tempest-CinderUnicodeTest-1497280626 None] Acquiring lock "cinder-9f1ce6fe-d4bf-45b2-9e9c-c298e4c85a0a-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:42:06 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-971669aa-b691-40c0-a8cc-6292836f5efc tempest-CinderUnicodeTest-1497280626 None] Lock "cinder-9f1ce6fe-d4bf-45b2-9e9c-c298e4c85a0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:42:06 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-971669aa-b691-40c0-a8cc-6292836f5efc tempest-CinderUnicodeTest-1497280626 None] Acquiring lock "cinder-quobyte-198ed219-4ca7-41fe-998d-9f31ecfad6a2" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:42:06 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-971669aa-b691-40c0-a8cc-6292836f5efc tempest-CinderUnicodeTest-1497280626 None] Lock "cinder-quobyte-198ed219-4ca7-41fe-998d-9f31ecfad6a2" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:42:06 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-971669aa-b691-40c0-a8cc-6292836f5efc tempest-CinderUnicodeTest-1497280626 None] Acquiring lock "cinder-quobyte-9f1ce6fe-d4bf-45b2-9e9c-c298e4c85a0a" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:42:06 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-971669aa-b691-40c0-a8cc-6292836f5efc tempest-CinderUnicodeTest-1497280626 None] Lock "cinder-quobyte-9f1ce6fe-d4bf-45b2-9e9c-c298e4c85a0a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:42:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-971669aa-b691-40c0-a8cc-6292836f5efc tempest-CinderUnicodeTest-1497280626 None] Deleting offline snapshot 9f1ce6fe-d4bf-45b2-9e9c-c298e4c85a0a of volume 198ed219-4ca7-41fe-998d-9f31ecfad6a2 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:42:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-971669aa-b691-40c0-a8cc-6292836f5efc tempest-CinderUnicodeTest-1497280626 None] snapshot_file for this snap is: volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2.9f1ce6fe-d4bf-45b2-9e9c-c298e4c85a0a {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:42:06 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e89a855-cef9-4591-b69b-310cf63de4b6]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:42:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-971669aa-b691-40c0-a8cc-6292836f5efc tempest-CinderUnicodeTest-1497280626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2.9f1ce6fe-d4bf-45b2-9e9c-c298e4c85a0a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:06 devstack sudo[104382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2.9f1ce6fe-d4bf-45b2-9e9c-c298e4c85a0a Jul 11 04:42:06 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:07 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-971669aa-b691-40c0-a8cc-6292836f5efc tempest-CinderUnicodeTest-1497280626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2.9f1ce6fe-d4bf-45b2-9e9c-c298e4c85a0a" returned: 0 in 1.059s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:07 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-971669aa-b691-40c0-a8cc-6292836f5efc tempest-CinderUnicodeTest-1497280626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:42:07 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[e368489e-3d01-4830-a858-6134e66a38e8]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:42:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-971669aa-b691-40c0-a8cc-6292836f5efc tempest-CinderUnicodeTest-1497280626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:08 devstack sudo[104423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2 Jul 11 04:42:08 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:08 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-971669aa-b691-40c0-a8cc-6292836f5efc tempest-CinderUnicodeTest-1497280626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2" returned: 0 in 0.917s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-971669aa-b691-40c0-a8cc-6292836f5efc tempest-CinderUnicodeTest-1497280626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2.9f1ce6fe-d4bf-45b2-9e9c-c298e4c85a0a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:08 devstack sudo[104439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2.9f1ce6fe-d4bf-45b2-9e9c-c298e4c85a0a Jul 11 04:42:08 devstack sudo[104439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:09 devstack sudo[104439]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-971669aa-b691-40c0-a8cc-6292836f5efc tempest-CinderUnicodeTest-1497280626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2.9f1ce6fe-d4bf-45b2-9e9c-c298e4c85a0a" returned: 0 in 0.789s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-971669aa-b691-40c0-a8cc-6292836f5efc tempest-CinderUnicodeTest-1497280626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2.9f1ce6fe-d4bf-45b2-9e9c-c298e4c85a0a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:09 devstack sudo[104451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2.9f1ce6fe-d4bf-45b2-9e9c-c298e4c85a0a Jul 11 04:42:09 devstack sudo[104451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:10 devstack sudo[104451]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-971669aa-b691-40c0-a8cc-6292836f5efc tempest-CinderUnicodeTest-1497280626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2.9f1ce6fe-d4bf-45b2-9e9c-c298e4c85a0a" returned: 0 in 0.669s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:10 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-971669aa-b691-40c0-a8cc-6292836f5efc tempest-CinderUnicodeTest-1497280626 None] Lock "cinder-quobyte-9f1ce6fe-d4bf-45b2-9e9c-c298e4c85a0a" released by "_delete_snapshot" :: held 3.598s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:42:10 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-971669aa-b691-40c0-a8cc-6292836f5efc tempest-CinderUnicodeTest-1497280626 None] Lock "cinder-quobyte-198ed219-4ca7-41fe-998d-9f31ecfad6a2" released by "delete_snapshot" :: held 3.628s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:42:10 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-971669aa-b691-40c0-a8cc-6292836f5efc tempest-CinderUnicodeTest-1497280626 None] Created reservations ['ab9b6d67-2040-4698-a355-b00798b5d8d4', '64e3a6f9-c1a9-47cb-8e70-2523113e7a70', 'fcba246f-c518-4928-8a53-5c4b6e6c8841', '575c685b-ac48-47ed-9c04-92f4cc278dc1'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:42:10 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-971669aa-b691-40c0-a8cc-6292836f5efc tempest-CinderUnicodeTest-1497280626 None] Delete snapshot completed successfully. Jul 11 04:42:10 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-971669aa-b691-40c0-a8cc-6292836f5efc tempest-CinderUnicodeTest-1497280626 None] Lock "cinder-9f1ce6fe-d4bf-45b2-9e9c-c298e4c85a0a-delete_snapshot" released by "delete_snapshot" :: held 3.793s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:42:10 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-db2b114d-3798-45b3-986c-8ce09919b36a tempest-CinderUnicodeTest-1497280626 None] Acquiring lock "cinder-198ed219-4ca7-41fe-998d-9f31ecfad6a2-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:42:10 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-db2b114d-3798-45b3-986c-8ce09919b36a tempest-CinderUnicodeTest-1497280626 None] Lock "cinder-198ed219-4ca7-41fe-998d-9f31ecfad6a2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:42:11 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-db2b114d-3798-45b3-986c-8ce09919b36a tempest-CinderUnicodeTest-1497280626 None] Acquiring lock "cinder-quobyte-198ed219-4ca7-41fe-998d-9f31ecfad6a2" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:42:11 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-db2b114d-3798-45b3-986c-8ce09919b36a tempest-CinderUnicodeTest-1497280626 None] Lock "cinder-quobyte-198ed219-4ca7-41fe-998d-9f31ecfad6a2" acquired by "delete_volume" :: waited 0.027s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:42:11 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc62825-4db6-4f01-a19e-77d780cefcd5]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:42:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-db2b114d-3798-45b3-986c-8ce09919b36a tempest-CinderUnicodeTest-1497280626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:11 devstack sudo[104461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2 Jul 11 04:42:11 devstack sudo[104461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:12 devstack sudo[104461]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-db2b114d-3798-45b3-986c-8ce09919b36a tempest-CinderUnicodeTest-1497280626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2" returned: 0 in 0.941s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-db2b114d-3798-45b3-986c-8ce09919b36a tempest-CinderUnicodeTest-1497280626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:12 devstack sudo[104484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2 Jul 11 04:42:12 devstack sudo[104484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:12 devstack sudo[104484]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-db2b114d-3798-45b3-986c-8ce09919b36a tempest-CinderUnicodeTest-1497280626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-198ed219-4ca7-41fe-998d-9f31ecfad6a2" returned: 0 in 0.977s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:13 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-db2b114d-3798-45b3-986c-8ce09919b36a tempest-CinderUnicodeTest-1497280626 None] Lock "cinder-quobyte-198ed219-4ca7-41fe-998d-9f31ecfad6a2" released by "delete_volume" :: held 2.020s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:42:13 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-db2b114d-3798-45b3-986c-8ce09919b36a tempest-CinderUnicodeTest-1497280626 None] Created reservations ['4163473d-a46e-405b-a0f9-1c4ae5a23b41', '1af2c7b0-f954-4bee-b7cc-fd0ce8ea8af1', 'f44b9553-9519-41fc-b0f4-3bfc41443a54', '5494115f-e7f2-411e-bf31-dd26fde071b0'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:42:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-db2b114d-3798-45b3-986c-8ce09919b36a tempest-CinderUnicodeTest-1497280626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:42:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-db2b114d-3798-45b3-986c-8ce09919b36a tempest-CinderUnicodeTest-1497280626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:42:13 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-db2b114d-3798-45b3-986c-8ce09919b36a tempest-CinderUnicodeTest-1497280626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:42:13 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-db2b114d-3798-45b3-986c-8ce09919b36a tempest-CinderUnicodeTest-1497280626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:42:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-db2b114d-3798-45b3-986c-8ce09919b36a tempest-CinderUnicodeTest-1497280626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:42:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-db2b114d-3798-45b3-986c-8ce09919b36a tempest-CinderUnicodeTest-1497280626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:13 devstack sudo[104531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:42:13 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:13 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-db2b114d-3798-45b3-986c-8ce09919b36a tempest-CinderUnicodeTest-1497280626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.742s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:13 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-db2b114d-3798-45b3-986c-8ce09919b36a tempest-CinderUnicodeTest-1497280626 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:42:14 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-db2b114d-3798-45b3-986c-8ce09919b36a tempest-CinderUnicodeTest-1497280626 None] Deleted volume successfully. Jul 11 04:42:14 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-db2b114d-3798-45b3-986c-8ce09919b36a tempest-CinderUnicodeTest-1497280626 None] Lock "cinder-198ed219-4ca7-41fe-998d-9f31ecfad6a2-delete_volume" released by "delete_volume" :: held 3.069s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:42:14 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6bb48524-4c74-423c-a7fe-3edc9d1cc199 tempest-CinderUnicodeTest-1497280626 None] Acquiring lock "cinder-3e400b1d-d2eb-4c75-873a-c28e774dc503-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:42:14 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6bb48524-4c74-423c-a7fe-3edc9d1cc199 tempest-CinderUnicodeTest-1497280626 None] Lock "cinder-3e400b1d-d2eb-4c75-873a-c28e774dc503-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:42:14 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6bb48524-4c74-423c-a7fe-3edc9d1cc199 tempest-CinderUnicodeTest-1497280626 None] Acquiring lock "cinder-quobyte-3e400b1d-d2eb-4c75-873a-c28e774dc503" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:42:14 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6bb48524-4c74-423c-a7fe-3edc9d1cc199 tempest-CinderUnicodeTest-1497280626 None] Lock "cinder-quobyte-3e400b1d-d2eb-4c75-873a-c28e774dc503" acquired by "delete_volume" :: waited 0.018s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:42:14 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7006ed9-6220-46f9-b98e-c6588d7430d4]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:42:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6bb48524-4c74-423c-a7fe-3edc9d1cc199 tempest-CinderUnicodeTest-1497280626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3e400b1d-d2eb-4c75-873a-c28e774dc503 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:14 devstack sudo[104559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3e400b1d-d2eb-4c75-873a-c28e774dc503 Jul 11 04:42:14 devstack sudo[104559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:15 devstack sudo[104559]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:15 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-9cd42720-fcdf-4bd6-ac32-0e21f3216b25 req-b459b3eb-1809-4c0c-bea2-a88353d120e8 tempest-TestShelveInstance-285084155 None] Terminate volume connection completed successfully. Jul 11 04:42:15 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-9cd42720-fcdf-4bd6-ac32-0e21f3216b25 req-b459b3eb-1809-4c0c-bea2-a88353d120e8 tempest-TestShelveInstance-285084155 None] Deleting attachment 395f0b1a-162c-4136-b23f-2c690460fe5a. {{(pid=86964) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 04:42:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6bb48524-4c74-423c-a7fe-3edc9d1cc199 tempest-CinderUnicodeTest-1497280626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3e400b1d-d2eb-4c75-873a-c28e774dc503" returned: 0 in 0.841s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6bb48524-4c74-423c-a7fe-3edc9d1cc199 tempest-CinderUnicodeTest-1497280626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3e400b1d-d2eb-4c75-873a-c28e774dc503 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:15 devstack sudo[104566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3e400b1d-d2eb-4c75-873a-c28e774dc503 Jul 11 04:42:15 devstack sudo[104566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:15 devstack cinder-volume[86964]: DEBUG cinder.coordination [req-9cd42720-fcdf-4bd6-ac32-0e21f3216b25 req-32edaf2d-7ba0-4157-8ed8-2986ac4e4074 tempest-TestShelveInstance-285084155 None] Acquiring lock "cinder-d4cec864-6160-42ef-a08c-d9eb3c601c02-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:42:15 devstack cinder-volume[86964]: DEBUG cinder.coordination [req-9cd42720-fcdf-4bd6-ac32-0e21f3216b25 req-32edaf2d-7ba0-4157-8ed8-2986ac4e4074 tempest-TestShelveInstance-285084155 None] Lock "cinder-d4cec864-6160-42ef-a08c-d9eb3c601c02-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:42:16 devstack cinder-volume[86964]: DEBUG cinder.coordination [req-9cd42720-fcdf-4bd6-ac32-0e21f3216b25 req-32edaf2d-7ba0-4157-8ed8-2986ac4e4074 tempest-TestShelveInstance-285084155 None] Acquiring lock "cinder-quobyte-d4cec864-6160-42ef-a08c-d9eb3c601c02" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:42:16 devstack cinder-volume[86964]: DEBUG cinder.coordination [req-9cd42720-fcdf-4bd6-ac32-0e21f3216b25 req-32edaf2d-7ba0-4157-8ed8-2986ac4e4074 tempest-TestShelveInstance-285084155 None] Lock "cinder-quobyte-d4cec864-6160-42ef-a08c-d9eb3c601c02" acquired by "delete_volume" :: waited 0.022s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:42:16 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fcfea7-b191-4aad-822c-f89c91262ea3]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:42:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-9cd42720-fcdf-4bd6-ac32-0e21f3216b25 req-32edaf2d-7ba0-4157-8ed8-2986ac4e4074 tempest-TestShelveInstance-285084155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:16 devstack sudo[104566]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6bb48524-4c74-423c-a7fe-3edc9d1cc199 tempest-CinderUnicodeTest-1497280626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-3e400b1d-d2eb-4c75-873a-c28e774dc503" returned: 0 in 0.841s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:16 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6bb48524-4c74-423c-a7fe-3edc9d1cc199 tempest-CinderUnicodeTest-1497280626 None] Lock "cinder-quobyte-3e400b1d-d2eb-4c75-873a-c28e774dc503" released by "delete_volume" :: held 1.742s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:42:16 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-6bb48524-4c74-423c-a7fe-3edc9d1cc199 tempest-CinderUnicodeTest-1497280626 None] Created reservations ['28e2d879-a667-4c0a-9363-c2bd3248baf9', 'b3ac885d-9412-4f48-ab26-60e5f31f55f7', '8bc1e3de-274f-4750-ae8a-795232b3daad', '77639816-4099-4b12-8f25-e971317329aa'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:42:16 devstack sudo[104570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02 Jul 11 04:42:16 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6bb48524-4c74-423c-a7fe-3edc9d1cc199 tempest-CinderUnicodeTest-1497280626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:42:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6bb48524-4c74-423c-a7fe-3edc9d1cc199 tempest-CinderUnicodeTest-1497280626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:42:16 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6bb48524-4c74-423c-a7fe-3edc9d1cc199 tempest-CinderUnicodeTest-1497280626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:42:16 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6bb48524-4c74-423c-a7fe-3edc9d1cc199 tempest-CinderUnicodeTest-1497280626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:42:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6bb48524-4c74-423c-a7fe-3edc9d1cc199 tempest-CinderUnicodeTest-1497280626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:42:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6bb48524-4c74-423c-a7fe-3edc9d1cc199 tempest-CinderUnicodeTest-1497280626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:16 devstack sudo[104572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:42:16 devstack sudo[104572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:17 devstack sudo[104572]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6bb48524-4c74-423c-a7fe-3edc9d1cc199 tempest-CinderUnicodeTest-1497280626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.862s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:17 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-6bb48524-4c74-423c-a7fe-3edc9d1cc199 tempest-CinderUnicodeTest-1497280626 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:42:17 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-6bb48524-4c74-423c-a7fe-3edc9d1cc199 tempest-CinderUnicodeTest-1497280626 None] Deleted volume successfully. Jul 11 04:42:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6bb48524-4c74-423c-a7fe-3edc9d1cc199 tempest-CinderUnicodeTest-1497280626 None] Lock "cinder-3e400b1d-d2eb-4c75-873a-c28e774dc503-delete_volume" released by "delete_volume" :: held 2.889s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:42:17 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-9cd42720-fcdf-4bd6-ac32-0e21f3216b25 req-32edaf2d-7ba0-4157-8ed8-2986ac4e4074 tempest-TestShelveInstance-285084155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02" returned: 0 in 1.440s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-9cd42720-fcdf-4bd6-ac32-0e21f3216b25 req-32edaf2d-7ba0-4157-8ed8-2986ac4e4074 tempest-TestShelveInstance-285084155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:17 devstack sudo[104578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02 Jul 11 04:42:17 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:18 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-9cd42720-fcdf-4bd6-ac32-0e21f3216b25 req-32edaf2d-7ba0-4157-8ed8-2986ac4e4074 tempest-TestShelveInstance-285084155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02" returned: 1 in 1.172s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-9cd42720-fcdf-4bd6-ac32-0e21f3216b25 req-32edaf2d-7ba0-4157-8ed8-2986ac4e4074 tempest-TestShelveInstance-285084155 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:42:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-9cd42720-fcdf-4bd6-ac32-0e21f3216b25 req-32edaf2d-7ba0-4157-8ed8-2986ac4e4074 tempest-TestShelveInstance-285084155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:18 devstack sudo[104584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02 Jul 11 04:42:18 devstack sudo[104584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:19 devstack sudo[104584]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-9cd42720-fcdf-4bd6-ac32-0e21f3216b25 req-32edaf2d-7ba0-4157-8ed8-2986ac4e4074 tempest-TestShelveInstance-285084155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d4cec864-6160-42ef-a08c-d9eb3c601c02" returned: 0 in 0.744s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:19 devstack cinder-volume[86964]: DEBUG cinder.coordination [req-9cd42720-fcdf-4bd6-ac32-0e21f3216b25 req-32edaf2d-7ba0-4157-8ed8-2986ac4e4074 tempest-TestShelveInstance-285084155 None] Lock "cinder-quobyte-d4cec864-6160-42ef-a08c-d9eb3c601c02" released by "delete_volume" :: held 3.429s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:42:19 devstack cinder-volume[86964]: DEBUG cinder.quota [req-9cd42720-fcdf-4bd6-ac32-0e21f3216b25 req-32edaf2d-7ba0-4157-8ed8-2986ac4e4074 tempest-TestShelveInstance-285084155 None] Created reservations ['be2f26d5-ade5-42e0-a36e-4604d7096029', '4843245b-be39-4a8e-9999-5b0937aa5ee7', '6fb62cd7-a4db-49c4-bd10-218d4ce4be7e', 'fce7aa21-c0f9-4086-8938-edd3bbdce85d'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:42:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-9cd42720-fcdf-4bd6-ac32-0e21f3216b25 req-32edaf2d-7ba0-4157-8ed8-2986ac4e4074 tempest-TestShelveInstance-285084155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:42:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-9cd42720-fcdf-4bd6-ac32-0e21f3216b25 req-32edaf2d-7ba0-4157-8ed8-2986ac4e4074 tempest-TestShelveInstance-285084155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:42:19 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [req-9cd42720-fcdf-4bd6-ac32-0e21f3216b25 req-32edaf2d-7ba0-4157-8ed8-2986ac4e4074 tempest-TestShelveInstance-285084155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:42:19 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [req-9cd42720-fcdf-4bd6-ac32-0e21f3216b25 req-32edaf2d-7ba0-4157-8ed8-2986ac4e4074 tempest-TestShelveInstance-285084155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:42:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-9cd42720-fcdf-4bd6-ac32-0e21f3216b25 req-32edaf2d-7ba0-4157-8ed8-2986ac4e4074 tempest-TestShelveInstance-285084155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:42:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-9cd42720-fcdf-4bd6-ac32-0e21f3216b25 req-32edaf2d-7ba0-4157-8ed8-2986ac4e4074 tempest-TestShelveInstance-285084155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:19 devstack sudo[104594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:42:19 devstack sudo[104594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:20 devstack sudo[104594]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-9cd42720-fcdf-4bd6-ac32-0e21f3216b25 req-32edaf2d-7ba0-4157-8ed8-2986ac4e4074 tempest-TestShelveInstance-285084155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.791s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:20 devstack cinder-volume[86964]: DEBUG cinder.manager [req-9cd42720-fcdf-4bd6-ac32-0e21f3216b25 req-32edaf2d-7ba0-4157-8ed8-2986ac4e4074 tempest-TestShelveInstance-285084155 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:42:20 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-9cd42720-fcdf-4bd6-ac32-0e21f3216b25 req-32edaf2d-7ba0-4157-8ed8-2986ac4e4074 tempest-TestShelveInstance-285084155 None] Deleted volume successfully. Jul 11 04:42:20 devstack cinder-volume[86964]: DEBUG cinder.coordination [req-9cd42720-fcdf-4bd6-ac32-0e21f3216b25 req-32edaf2d-7ba0-4157-8ed8-2986ac4e4074 tempest-TestShelveInstance-285084155 None] Lock "cinder-d4cec864-6160-42ef-a08c-d9eb3c601c02-delete_volume" released by "delete_volume" :: held 4.614s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:42:29 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:UPDATE=41,cinder:INSERT=16,cinder:SELECT=34,cinder:DELETE=5 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:42:30 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=44,cinder:INSERT=16,cinder:UPDATE=56,cinder:DELETE=3 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:42:30 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-09ee6800-a4c1-4033-acd1-4e4c74ba8855 tempest-CreateVolumesFromSnapshotTest-88895777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:42:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-09ee6800-a4c1-4033-acd1-4e4c74ba8855 tempest-CreateVolumesFromSnapshotTest-88895777 None] Flow 'volume_create_manager' (ad0b5d5f-47d7-4254-8edd-3a943e98dc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:42:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-09ee6800-a4c1-4033-acd1-4e4c74ba8855 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb7d19d8-bb35-444a-9604-67908fe32155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-09ee6800-a4c1-4033-acd1-4e4c74ba8855 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb7d19d8-bb35-444a-9604-67908fe32155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1025937388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=791bb6df-02f2-4b13-ab04-79134ca57beb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f48bce7084344cb49d9ddce7413f2cc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:42:31Z,use_quota=True,user_id='a0ca758da4eb4ebeb6732ce02af538d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-09ee6800-a4c1-4033-acd1-4e4c74ba8855 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a990307-ca83-4025-a611-aec8aa39111d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-09ee6800-a4c1-4033-acd1-4e4c74ba8855 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a990307-ca83-4025-a611-aec8aa39111d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-09ee6800-a4c1-4033-acd1-4e4c74ba8855 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be607c0b-793a-4de5-b261-96e3c7910f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-09ee6800-a4c1-4033-acd1-4e4c74ba8855 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be607c0b-793a-4de5-b261-96e3c7910f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '791bb6df-02f2-4b13-ab04-79134ca57beb', 'volume_name': 'volume-791bb6df-02f2-4b13-ab04-79134ca57beb', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-09ee6800-a4c1-4033-acd1-4e4c74ba8855 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a45dc2cd-ef55-4f17-9a79-db716542e0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-09ee6800-a4c1-4033-acd1-4e4c74ba8855 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a45dc2cd-ef55-4f17-9a79-db716542e0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-09ee6800-a4c1-4033-acd1-4e4c74ba8855 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7092d0ad-70dd-475e-b6f0-807d5ddf792d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:30 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-09ee6800-a4c1-4033-acd1-4e4c74ba8855 tempest-CreateVolumesFromSnapshotTest-88895777 None] Volume 791bb6df-02f2-4b13-ab04-79134ca57beb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-791bb6df-02f2-4b13-ab04-79134ca57beb', 'volume_size': 1} Jul 11 04:42:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-09ee6800-a4c1-4033-acd1-4e4c74ba8855 tempest-CreateVolumesFromSnapshotTest-88895777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:42:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-09ee6800-a4c1-4033-acd1-4e4c74ba8855 tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:42:30 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-09ee6800-a4c1-4033-acd1-4e4c74ba8855 tempest-CreateVolumesFromSnapshotTest-88895777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1025937388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=791bb6df-02f2-4b13-ab04-79134ca57beb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f48bce7084344cb49d9ddce7413f2cc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:42:31Z,use_quota=True,user_id='a0ca758da4eb4ebeb6732ce02af538d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:42:30 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-09ee6800-a4c1-4033-acd1-4e4c74ba8855 tempest-CreateVolumesFromSnapshotTest-88895777 None] Creating volume 791bb6df-02f2-4b13-ab04-79134ca57beb {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:42:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-09ee6800-a4c1-4033-acd1-4e4c74ba8855 tempest-CreateVolumesFromSnapshotTest-88895777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:42:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-09ee6800-a4c1-4033-acd1-4e4c74ba8855 tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:42:30 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-09ee6800-a4c1-4033-acd1-4e4c74ba8855 tempest-CreateVolumesFromSnapshotTest-88895777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:42:30 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-09ee6800-a4c1-4033-acd1-4e4c74ba8855 tempest-CreateVolumesFromSnapshotTest-88895777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:42:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-09ee6800-a4c1-4033-acd1-4e4c74ba8855 tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:42:30 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-09ee6800-a4c1-4033-acd1-4e4c74ba8855 tempest-CreateVolumesFromSnapshotTest-88895777 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:42:30 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-09ee6800-a4c1-4033-acd1-4e4c74ba8855 tempest-CreateVolumesFromSnapshotTest-88895777 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:42:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-09ee6800-a4c1-4033-acd1-4e4c74ba8855 tempest-CreateVolumesFromSnapshotTest-88895777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:31 devstack sudo[104622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb 1073741824 Jul 11 04:42:31 devstack sudo[104622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:31 devstack sudo[104622]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-09ee6800-a4c1-4033-acd1-4e4c74ba8855 tempest-CreateVolumesFromSnapshotTest-88895777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb 1073741824" returned: 0 in 0.810s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-09ee6800-a4c1-4033-acd1-4e4c74ba8855 tempest-CreateVolumesFromSnapshotTest-88895777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:31 devstack sudo[104628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb Jul 11 04:42:31 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:32 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-09ee6800-a4c1-4033-acd1-4e4c74ba8855 tempest-CreateVolumesFromSnapshotTest-88895777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb" returned: 0 in 0.636s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:32 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-09ee6800-a4c1-4033-acd1-4e4c74ba8855 tempest-CreateVolumesFromSnapshotTest-88895777 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:42:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-09ee6800-a4c1-4033-acd1-4e4c74ba8855 tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:42:32 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-09ee6800-a4c1-4033-acd1-4e4c74ba8855 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7092d0ad-70dd-475e-b6f0-807d5ddf792d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-791bb6df-02f2-4b13-ab04-79134ca57beb', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:32 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-09ee6800-a4c1-4033-acd1-4e4c74ba8855 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af1e7cb2-e22d-4a02-800c-4f81f211c215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:32 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-09ee6800-a4c1-4033-acd1-4e4c74ba8855 tempest-CreateVolumesFromSnapshotTest-88895777 None] Volume volume-791bb6df-02f2-4b13-ab04-79134ca57beb (791bb6df-02f2-4b13-ab04-79134ca57beb): created successfully Jul 11 04:42:32 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-09ee6800-a4c1-4033-acd1-4e4c74ba8855 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af1e7cb2-e22d-4a02-800c-4f81f211c215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:32 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-09ee6800-a4c1-4033-acd1-4e4c74ba8855 tempest-CreateVolumesFromSnapshotTest-88895777 None] Flow 'volume_create_manager' (ad0b5d5f-47d7-4254-8edd-3a943e98dc8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:42:32 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-09ee6800-a4c1-4033-acd1-4e4c74ba8855 tempest-CreateVolumesFromSnapshotTest-88895777 None] Created volume successfully. Jul 11 04:42:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a156b2e9-159d-42d4-a991-e8967e3ac89f tempest-CreateVolumesFromSnapshotTest-88895777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:42:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a156b2e9-159d-42d4-a991-e8967e3ac89f tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:42:33 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-a156b2e9-159d-42d4-a991-e8967e3ac89f tempest-CreateVolumesFromSnapshotTest-88895777 None] Creating offline snapshot e84a2124-2cf3-46ba-a8fb-bc4d0e4209d4 of volume 791bb6df-02f2-4b13-ab04-79134ca57beb {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:42:33 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[275651dc-b167-4ea6-b045-b5b8e71b1267]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:42:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a156b2e9-159d-42d4-a991-e8967e3ac89f tempest-CreateVolumesFromSnapshotTest-88895777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:33 devstack sudo[104631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb Jul 11 04:42:33 devstack sudo[104631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:33 devstack sudo[104631]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a156b2e9-159d-42d4-a991-e8967e3ac89f tempest-CreateVolumesFromSnapshotTest-88895777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb" returned: 0 in 0.736s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a156b2e9-159d-42d4-a991-e8967e3ac89f tempest-CreateVolumesFromSnapshotTest-88895777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb.e84a2124-2cf3-46ba-a8fb-bc4d0e4209d4 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:33 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb.e84a2124-2cf3-46ba-a8fb-bc4d0e4209d4 1G Jul 11 04:42:33 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:34 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a156b2e9-159d-42d4-a991-e8967e3ac89f tempest-CreateVolumesFromSnapshotTest-88895777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb.e84a2124-2cf3-46ba-a8fb-bc4d0e4209d4 1G" returned: 0 in 0.834s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a156b2e9-159d-42d4-a991-e8967e3ac89f tempest-CreateVolumesFromSnapshotTest-88895777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-791bb6df-02f2-4b13-ab04-79134ca57beb -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb.e84a2124-2cf3-46ba-a8fb-bc4d0e4209d4 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:34 devstack sudo[104642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-791bb6df-02f2-4b13-ab04-79134ca57beb -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb.e84a2124-2cf3-46ba-a8fb-bc4d0e4209d4 Jul 11 04:42:34 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:35 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a156b2e9-159d-42d4-a991-e8967e3ac89f tempest-CreateVolumesFromSnapshotTest-88895777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-791bb6df-02f2-4b13-ab04-79134ca57beb -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb.e84a2124-2cf3-46ba-a8fb-bc4d0e4209d4" returned: 0 in 0.693s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:35 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-a156b2e9-159d-42d4-a991-e8967e3ac89f tempest-CreateVolumesFromSnapshotTest-88895777 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb.e84a2124-2cf3-46ba-a8fb-bc4d0e4209d4 is being set with open permissions: ugo+rw Jul 11 04:42:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a156b2e9-159d-42d4-a991-e8967e3ac89f tempest-CreateVolumesFromSnapshotTest-88895777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb.e84a2124-2cf3-46ba-a8fb-bc4d0e4209d4 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:35 devstack sudo[104647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb.e84a2124-2cf3-46ba-a8fb-bc4d0e4209d4 Jul 11 04:42:35 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:36 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a156b2e9-159d-42d4-a991-e8967e3ac89f tempest-CreateVolumesFromSnapshotTest-88895777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb.e84a2124-2cf3-46ba-a8fb-bc4d0e4209d4" returned: 0 in 0.634s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a156b2e9-159d-42d4-a991-e8967e3ac89f tempest-CreateVolumesFromSnapshotTest-88895777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:36 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb.info Jul 11 04:42:36 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:36 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a156b2e9-159d-42d4-a991-e8967e3ac89f tempest-CreateVolumesFromSnapshotTest-88895777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb.info" returned: 0 in 0.655s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:36 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-a156b2e9-159d-42d4-a991-e8967e3ac89f tempest-CreateVolumesFromSnapshotTest-88895777 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb.info is being set with open permissions: ugo+rw Jul 11 04:42:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a156b2e9-159d-42d4-a991-e8967e3ac89f tempest-CreateVolumesFromSnapshotTest-88895777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:36 devstack sudo[104656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb.info Jul 11 04:42:36 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:37 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a156b2e9-159d-42d4-a991-e8967e3ac89f tempest-CreateVolumesFromSnapshotTest-88895777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb.info" returned: 0 in 0.630s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a156b2e9-159d-42d4-a991-e8967e3ac89f tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.269s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:42:37 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-a156b2e9-159d-42d4-a991-e8967e3ac89f tempest-CreateVolumesFromSnapshotTest-88895777 None] Create snapshot completed successfully Jul 11 04:42:38 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-73d6b67c-13d0-4b60-980b-c059bca786c0 tempest-CreateVolumesFromSnapshotTest-88895777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:42:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-73d6b67c-13d0-4b60-980b-c059bca786c0 tempest-CreateVolumesFromSnapshotTest-88895777 None] Flow 'volume_create_manager' (db571171-6177-41cc-8638-04e00a20bfdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:42:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-73d6b67c-13d0-4b60-980b-c059bca786c0 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a497edd-7b19-4938-9802-2c310af9127c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-73d6b67c-13d0-4b60-980b-c059bca786c0 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a497edd-7b19-4938-9802-2c310af9127c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-482226544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c41ea1a5-8e88-496f-ab42-942a2e08c935,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f48bce7084344cb49d9ddce7413f2cc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:42:39Z,use_quota=True,user_id='a0ca758da4eb4ebeb6732ce02af538d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-73d6b67c-13d0-4b60-980b-c059bca786c0 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f944c5f7-60fb-4d04-a58f-5fe217f1a9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-73d6b67c-13d0-4b60-980b-c059bca786c0 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f944c5f7-60fb-4d04-a58f-5fe217f1a9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-73d6b67c-13d0-4b60-980b-c059bca786c0 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcbcdb79-2fa4-4ece-aebd-ec9a25fb4db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-73d6b67c-13d0-4b60-980b-c059bca786c0 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcbcdb79-2fa4-4ece-aebd-ec9a25fb4db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c41ea1a5-8e88-496f-ab42-942a2e08c935', 'volume_name': 'volume-c41ea1a5-8e88-496f-ab42-942a2e08c935', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-73d6b67c-13d0-4b60-980b-c059bca786c0 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27991277-0edd-4b3f-975b-f45ab775613d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-73d6b67c-13d0-4b60-980b-c059bca786c0 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27991277-0edd-4b3f-975b-f45ab775613d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:38 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-73d6b67c-13d0-4b60-980b-c059bca786c0 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3abf7fb-b702-4c43-b847-e70e636073ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:38 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-73d6b67c-13d0-4b60-980b-c059bca786c0 tempest-CreateVolumesFromSnapshotTest-88895777 None] Volume c41ea1a5-8e88-496f-ab42-942a2e08c935: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c41ea1a5-8e88-496f-ab42-942a2e08c935', 'volume_size': 1} Jul 11 04:42:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-73d6b67c-13d0-4b60-980b-c059bca786c0 tempest-CreateVolumesFromSnapshotTest-88895777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:42:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-73d6b67c-13d0-4b60-980b-c059bca786c0 tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:42:38 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-73d6b67c-13d0-4b60-980b-c059bca786c0 tempest-CreateVolumesFromSnapshotTest-88895777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-482226544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c41ea1a5-8e88-496f-ab42-942a2e08c935,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f48bce7084344cb49d9ddce7413f2cc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:42:39Z,use_quota=True,user_id='a0ca758da4eb4ebeb6732ce02af538d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:42:38 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-73d6b67c-13d0-4b60-980b-c059bca786c0 tempest-CreateVolumesFromSnapshotTest-88895777 None] Creating volume c41ea1a5-8e88-496f-ab42-942a2e08c935 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:42:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-73d6b67c-13d0-4b60-980b-c059bca786c0 tempest-CreateVolumesFromSnapshotTest-88895777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:42:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-73d6b67c-13d0-4b60-980b-c059bca786c0 tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:42:38 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-73d6b67c-13d0-4b60-980b-c059bca786c0 tempest-CreateVolumesFromSnapshotTest-88895777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:42:38 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-73d6b67c-13d0-4b60-980b-c059bca786c0 tempest-CreateVolumesFromSnapshotTest-88895777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:42:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-73d6b67c-13d0-4b60-980b-c059bca786c0 tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:42:38 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-73d6b67c-13d0-4b60-980b-c059bca786c0 tempest-CreateVolumesFromSnapshotTest-88895777 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:42:38 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-73d6b67c-13d0-4b60-980b-c059bca786c0 tempest-CreateVolumesFromSnapshotTest-88895777 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:42:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-73d6b67c-13d0-4b60-980b-c059bca786c0 tempest-CreateVolumesFromSnapshotTest-88895777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c41ea1a5-8e88-496f-ab42-942a2e08c935 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:38 devstack sudo[104661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c41ea1a5-8e88-496f-ab42-942a2e08c935 1073741824 Jul 11 04:42:38 devstack sudo[104661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:39 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9664724-3771-441e-bbba-2fdbd076d01e tempest-CreateVolumesFromSnapshotTest-88895777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:42:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e9664724-3771-441e-bbba-2fdbd076d01e tempest-CreateVolumesFromSnapshotTest-88895777 None] Flow 'volume_create_manager' (35dfce27-4214-4ea5-ade3-aa85e8bb5258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:42:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e9664724-3771-441e-bbba-2fdbd076d01e tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (711b3f97-0279-4787-8c32-7211b6383b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e9664724-3771-441e-bbba-2fdbd076d01e tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (711b3f97-0279-4787-8c32-7211b6383b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-903103481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad734fb4-3734-495b-a8db-13973128b2c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f48bce7084344cb49d9ddce7413f2cc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:42:39Z,use_quota=True,user_id='a0ca758da4eb4ebeb6732ce02af538d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e9664724-3771-441e-bbba-2fdbd076d01e tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d68a2074-aff4-4596-91a1-a37f6deffa5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e9664724-3771-441e-bbba-2fdbd076d01e tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d68a2074-aff4-4596-91a1-a37f6deffa5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e9664724-3771-441e-bbba-2fdbd076d01e tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fe1882b-28c6-4eae-812c-5ff180468186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e9664724-3771-441e-bbba-2fdbd076d01e tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fe1882b-28c6-4eae-812c-5ff180468186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad734fb4-3734-495b-a8db-13973128b2c9', 'volume_name': 'volume-ad734fb4-3734-495b-a8db-13973128b2c9', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e9664724-3771-441e-bbba-2fdbd076d01e tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d851aa77-773e-4d19-bf89-bdc33bb0a853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e9664724-3771-441e-bbba-2fdbd076d01e tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d851aa77-773e-4d19-bf89-bdc33bb0a853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e9664724-3771-441e-bbba-2fdbd076d01e tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91ef09ce-af5e-4523-9cd0-66e759e95fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:39 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-e9664724-3771-441e-bbba-2fdbd076d01e tempest-CreateVolumesFromSnapshotTest-88895777 None] Volume ad734fb4-3734-495b-a8db-13973128b2c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad734fb4-3734-495b-a8db-13973128b2c9', 'volume_size': 1} Jul 11 04:42:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e9664724-3771-441e-bbba-2fdbd076d01e tempest-CreateVolumesFromSnapshotTest-88895777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:42:39 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-527f304c-4bd0-4f82-9aa6-72dbe63946c1 tempest-CreateVolumesFromSnapshotTest-88895777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:42:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-527f304c-4bd0-4f82-9aa6-72dbe63946c1 tempest-CreateVolumesFromSnapshotTest-88895777 None] Flow 'volume_create_manager' (d8449a3b-483e-4330-ba1f-c566d09a0a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:42:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-527f304c-4bd0-4f82-9aa6-72dbe63946c1 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89da5e36-55dd-46ba-a0c9-68012a3f0315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-527f304c-4bd0-4f82-9aa6-72dbe63946c1 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89da5e36-55dd-46ba-a0c9-68012a3f0315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-288811588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8411b15c-4d1a-4220-9b03-a8e3fee390ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f48bce7084344cb49d9ddce7413f2cc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:42:40Z,use_quota=True,user_id='a0ca758da4eb4ebeb6732ce02af538d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-527f304c-4bd0-4f82-9aa6-72dbe63946c1 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (800af22b-e7be-4496-a978-d0c514b80e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-527f304c-4bd0-4f82-9aa6-72dbe63946c1 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (800af22b-e7be-4496-a978-d0c514b80e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-527f304c-4bd0-4f82-9aa6-72dbe63946c1 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45264cde-6337-46e6-8dff-c13efe849ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-527f304c-4bd0-4f82-9aa6-72dbe63946c1 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45264cde-6337-46e6-8dff-c13efe849ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8411b15c-4d1a-4220-9b03-a8e3fee390ac', 'volume_name': 'volume-8411b15c-4d1a-4220-9b03-a8e3fee390ac', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-527f304c-4bd0-4f82-9aa6-72dbe63946c1 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d26afbd3-b136-4033-aeab-4ba63606ca69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-527f304c-4bd0-4f82-9aa6-72dbe63946c1 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d26afbd3-b136-4033-aeab-4ba63606ca69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-527f304c-4bd0-4f82-9aa6-72dbe63946c1 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deadeaa2-ac9e-4333-a1a9-7db9b49fc370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:39 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-527f304c-4bd0-4f82-9aa6-72dbe63946c1 tempest-CreateVolumesFromSnapshotTest-88895777 None] Volume 8411b15c-4d1a-4220-9b03-a8e3fee390ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8411b15c-4d1a-4220-9b03-a8e3fee390ac', 'volume_size': 1} Jul 11 04:42:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-527f304c-4bd0-4f82-9aa6-72dbe63946c1 tempest-CreateVolumesFromSnapshotTest-88895777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:42:39 devstack sudo[104661]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-73d6b67c-13d0-4b60-980b-c059bca786c0 tempest-CreateVolumesFromSnapshotTest-88895777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c41ea1a5-8e88-496f-ab42-942a2e08c935 1073741824" returned: 0 in 1.050s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-73d6b67c-13d0-4b60-980b-c059bca786c0 tempest-CreateVolumesFromSnapshotTest-88895777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c41ea1a5-8e88-496f-ab42-942a2e08c935 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:40 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c41ea1a5-8e88-496f-ab42-942a2e08c935 Jul 11 04:42:40 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-01f32e27-58d0-49a3-8048-a8583359352f tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-01f32e27-58d0-49a3-8048-a8583359352f tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Flow 'volume_create_manager' (7b7dabbb-9276-43f1-9c13-33a688a84bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-01f32e27-58d0-49a3-8048-a8583359352f tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc9a051b-e27a-4425-91b9-2e1ed27982da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-01f32e27-58d0-49a3-8048-a8583359352f tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc9a051b-e27a-4425-91b9-2e1ed27982da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1575761135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28b8e06f-ebef-4229-9ddf-b126afd2c401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6bacb4bb734570b4d285c448d1e2e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:42:40Z,use_quota=True,user_id='b9dda606a25641ffba4f598737c40541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-01f32e27-58d0-49a3-8048-a8583359352f tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (195ff4c7-e247-41d5-90a2-c92f67375fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-01f32e27-58d0-49a3-8048-a8583359352f tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (195ff4c7-e247-41d5-90a2-c92f67375fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-01f32e27-58d0-49a3-8048-a8583359352f tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7676528e-4879-4de5-828d-368350c9422e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-01f32e27-58d0-49a3-8048-a8583359352f tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7676528e-4879-4de5-828d-368350c9422e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28b8e06f-ebef-4229-9ddf-b126afd2c401', 'volume_name': 'volume-28b8e06f-ebef-4229-9ddf-b126afd2c401', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-01f32e27-58d0-49a3-8048-a8583359352f tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e24d392-e2c7-4674-b95d-e090f5f0a031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-01f32e27-58d0-49a3-8048-a8583359352f tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e24d392-e2c7-4674-b95d-e090f5f0a031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-01f32e27-58d0-49a3-8048-a8583359352f tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1072af43-198b-4e8d-bd7d-970c945e2829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:40 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-01f32e27-58d0-49a3-8048-a8583359352f tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Volume 28b8e06f-ebef-4229-9ddf-b126afd2c401: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28b8e06f-ebef-4229-9ddf-b126afd2c401', 'volume_size': 1} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-01f32e27-58d0-49a3-8048-a8583359352f tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2ea35c0-71fd-4edb-a010-ea7f5f23ea24 tempest-CreateVolumesFromSnapshotTest-88895777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a2ea35c0-71fd-4edb-a010-ea7f5f23ea24 tempest-CreateVolumesFromSnapshotTest-88895777 None] Flow 'volume_create_manager' (6b1b6a1f-cc18-48a2-b3bb-23c17314cd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a2ea35c0-71fd-4edb-a010-ea7f5f23ea24 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fde09834-4f07-40f7-b919-75a5adbd168b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a2ea35c0-71fd-4edb-a010-ea7f5f23ea24 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fde09834-4f07-40f7-b919-75a5adbd168b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1861903354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a694a9b0-02f0-4d57-baed-d7bd22c76b07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f48bce7084344cb49d9ddce7413f2cc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:42:40Z,use_quota=True,user_id='a0ca758da4eb4ebeb6732ce02af538d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a2ea35c0-71fd-4edb-a010-ea7f5f23ea24 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe0c2bc9-9322-474b-83b1-cfee8dd7b22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a2ea35c0-71fd-4edb-a010-ea7f5f23ea24 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe0c2bc9-9322-474b-83b1-cfee8dd7b22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a2ea35c0-71fd-4edb-a010-ea7f5f23ea24 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22defea9-7703-4c39-b89e-c76d98615e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a2ea35c0-71fd-4edb-a010-ea7f5f23ea24 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22defea9-7703-4c39-b89e-c76d98615e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a694a9b0-02f0-4d57-baed-d7bd22c76b07', 'volume_name': 'volume-a694a9b0-02f0-4d57-baed-d7bd22c76b07', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a2ea35c0-71fd-4edb-a010-ea7f5f23ea24 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7814155d-1f8b-4e15-bf09-a0480bea7f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a2ea35c0-71fd-4edb-a010-ea7f5f23ea24 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7814155d-1f8b-4e15-bf09-a0480bea7f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a2ea35c0-71fd-4edb-a010-ea7f5f23ea24 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7be0738-58a2-4691-bb0d-70d8eef06a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:40 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-a2ea35c0-71fd-4edb-a010-ea7f5f23ea24 tempest-CreateVolumesFromSnapshotTest-88895777 None] Volume a694a9b0-02f0-4d57-baed-d7bd22c76b07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a694a9b0-02f0-4d57-baed-d7bd22c76b07', 'volume_size': 1} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a2ea35c0-71fd-4edb-a010-ea7f5f23ea24 tempest-CreateVolumesFromSnapshotTest-88895777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-4841514b-00a5-462b-8ab3-8c008d442c18 tempest-CreateVolumesFromSnapshotTest-88895777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4841514b-00a5-462b-8ab3-8c008d442c18 tempest-CreateVolumesFromSnapshotTest-88895777 None] Flow 'volume_create_manager' (8c74fd5c-7a07-4b14-9a0f-6b7c7ce6e956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4841514b-00a5-462b-8ab3-8c008d442c18 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5aae29f-24d0-4894-b42a-fd1aa802b268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4841514b-00a5-462b-8ab3-8c008d442c18 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5aae29f-24d0-4894-b42a-fd1aa802b268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1140427210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d72170ef-e116-469a-8a96-b172bda2e1a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f48bce7084344cb49d9ddce7413f2cc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:42:41Z,use_quota=True,user_id='a0ca758da4eb4ebeb6732ce02af538d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4841514b-00a5-462b-8ab3-8c008d442c18 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3021052-18b4-48a9-ba1b-c047e02bb59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4841514b-00a5-462b-8ab3-8c008d442c18 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3021052-18b4-48a9-ba1b-c047e02bb59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4841514b-00a5-462b-8ab3-8c008d442c18 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c00e1c85-c6e1-47ea-84dd-6591d37f29fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4841514b-00a5-462b-8ab3-8c008d442c18 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c00e1c85-c6e1-47ea-84dd-6591d37f29fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd72170ef-e116-469a-8a96-b172bda2e1a4', 'volume_name': 'volume-d72170ef-e116-469a-8a96-b172bda2e1a4', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4841514b-00a5-462b-8ab3-8c008d442c18 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dde9913c-a1f2-47e7-b2ca-430b134b6ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4841514b-00a5-462b-8ab3-8c008d442c18 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dde9913c-a1f2-47e7-b2ca-430b134b6ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4841514b-00a5-462b-8ab3-8c008d442c18 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8004066b-7f45-432e-b3b8-0dbd1d277184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:40 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-4841514b-00a5-462b-8ab3-8c008d442c18 tempest-CreateVolumesFromSnapshotTest-88895777 None] Volume d72170ef-e116-469a-8a96-b172bda2e1a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d72170ef-e116-469a-8a96-b172bda2e1a4', 'volume_size': 1} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4841514b-00a5-462b-8ab3-8c008d442c18 tempest-CreateVolumesFromSnapshotTest-88895777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:42:40 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-73d6b67c-13d0-4b60-980b-c059bca786c0 tempest-CreateVolumesFromSnapshotTest-88895777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c41ea1a5-8e88-496f-ab42-942a2e08c935" returned: 0 in 0.734s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-73d6b67c-13d0-4b60-980b-c059bca786c0 tempest-CreateVolumesFromSnapshotTest-88895777 None] <== create_volume: return (1829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-73d6b67c-13d0-4b60-980b-c059bca786c0 tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.831s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e9664724-3771-441e-bbba-2fdbd076d01e tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.477s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e9664724-3771-441e-bbba-2fdbd076d01e tempest-CreateVolumesFromSnapshotTest-88895777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-903103481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad734fb4-3734-495b-a8db-13973128b2c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f48bce7084344cb49d9ddce7413f2cc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:42:39Z,use_quota=True,user_id='a0ca758da4eb4ebeb6732ce02af538d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-e9664724-3771-441e-bbba-2fdbd076d01e tempest-CreateVolumesFromSnapshotTest-88895777 None] Creating volume ad734fb4-3734-495b-a8db-13973128b2c9 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e9664724-3771-441e-bbba-2fdbd076d01e tempest-CreateVolumesFromSnapshotTest-88895777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e9664724-3771-441e-bbba-2fdbd076d01e tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e9664724-3771-441e-bbba-2fdbd076d01e tempest-CreateVolumesFromSnapshotTest-88895777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e9664724-3771-441e-bbba-2fdbd076d01e tempest-CreateVolumesFromSnapshotTest-88895777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e9664724-3771-441e-bbba-2fdbd076d01e tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e9664724-3771-441e-bbba-2fdbd076d01e tempest-CreateVolumesFromSnapshotTest-88895777 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:42:40 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-e9664724-3771-441e-bbba-2fdbd076d01e tempest-CreateVolumesFromSnapshotTest-88895777 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e9664724-3771-441e-bbba-2fdbd076d01e tempest-CreateVolumesFromSnapshotTest-88895777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ad734fb4-3734-495b-a8db-13973128b2c9 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:40 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ad734fb4-3734-495b-a8db-13973128b2c9 1073741824 Jul 11 04:42:40 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-73d6b67c-13d0-4b60-980b-c059bca786c0 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3abf7fb-b702-4c43-b847-e70e636073ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c41ea1a5-8e88-496f-ab42-942a2e08c935', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-73d6b67c-13d0-4b60-980b-c059bca786c0 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddc37f2d-3142-44de-bea3-fefe4a630f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:40 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-73d6b67c-13d0-4b60-980b-c059bca786c0 tempest-CreateVolumesFromSnapshotTest-88895777 None] Volume volume-c41ea1a5-8e88-496f-ab42-942a2e08c935 (c41ea1a5-8e88-496f-ab42-942a2e08c935): created successfully Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-73d6b67c-13d0-4b60-980b-c059bca786c0 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddc37f2d-3142-44de-bea3-fefe4a630f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:40 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-73d6b67c-13d0-4b60-980b-c059bca786c0 tempest-CreateVolumesFromSnapshotTest-88895777 None] Flow 'volume_create_manager' (db571171-6177-41cc-8638-04e00a20bfdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:42:40 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-73d6b67c-13d0-4b60-980b-c059bca786c0 tempest-CreateVolumesFromSnapshotTest-88895777 None] Created volume successfully. Jul 11 04:42:41 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e9664724-3771-441e-bbba-2fdbd076d01e tempest-CreateVolumesFromSnapshotTest-88895777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ad734fb4-3734-495b-a8db-13973128b2c9 1073741824" returned: 0 in 0.812s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e9664724-3771-441e-bbba-2fdbd076d01e tempest-CreateVolumesFromSnapshotTest-88895777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ad734fb4-3734-495b-a8db-13973128b2c9 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:41 devstack sudo[104675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ad734fb4-3734-495b-a8db-13973128b2c9 Jul 11 04:42:41 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:42 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e9664724-3771-441e-bbba-2fdbd076d01e tempest-CreateVolumesFromSnapshotTest-88895777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ad734fb4-3734-495b-a8db-13973128b2c9" returned: 0 in 0.631s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:42 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e9664724-3771-441e-bbba-2fdbd076d01e tempest-CreateVolumesFromSnapshotTest-88895777 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:42:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e9664724-3771-441e-bbba-2fdbd076d01e tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:42:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-527f304c-4bd0-4f82-9aa6-72dbe63946c1 tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.329s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:42:42 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-527f304c-4bd0-4f82-9aa6-72dbe63946c1 tempest-CreateVolumesFromSnapshotTest-88895777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-288811588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8411b15c-4d1a-4220-9b03-a8e3fee390ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f48bce7084344cb49d9ddce7413f2cc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:42:40Z,use_quota=True,user_id='a0ca758da4eb4ebeb6732ce02af538d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:42:42 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-527f304c-4bd0-4f82-9aa6-72dbe63946c1 tempest-CreateVolumesFromSnapshotTest-88895777 None] Creating volume 8411b15c-4d1a-4220-9b03-a8e3fee390ac {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:42:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-527f304c-4bd0-4f82-9aa6-72dbe63946c1 tempest-CreateVolumesFromSnapshotTest-88895777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:42:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-527f304c-4bd0-4f82-9aa6-72dbe63946c1 tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:42:42 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-527f304c-4bd0-4f82-9aa6-72dbe63946c1 tempest-CreateVolumesFromSnapshotTest-88895777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:42:42 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-527f304c-4bd0-4f82-9aa6-72dbe63946c1 tempest-CreateVolumesFromSnapshotTest-88895777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:42:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-527f304c-4bd0-4f82-9aa6-72dbe63946c1 tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:42:42 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-527f304c-4bd0-4f82-9aa6-72dbe63946c1 tempest-CreateVolumesFromSnapshotTest-88895777 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:42:42 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-527f304c-4bd0-4f82-9aa6-72dbe63946c1 tempest-CreateVolumesFromSnapshotTest-88895777 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:42:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-527f304c-4bd0-4f82-9aa6-72dbe63946c1 tempest-CreateVolumesFromSnapshotTest-88895777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8411b15c-4d1a-4220-9b03-a8e3fee390ac 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:42 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e9664724-3771-441e-bbba-2fdbd076d01e tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91ef09ce-af5e-4523-9cd0-66e759e95fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad734fb4-3734-495b-a8db-13973128b2c9', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:42 devstack sudo[104678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8411b15c-4d1a-4220-9b03-a8e3fee390ac 1073741824 Jul 11 04:42:42 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:42 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e9664724-3771-441e-bbba-2fdbd076d01e tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (843e42c6-9720-492d-a8ac-69952c7ad190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:42 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-e9664724-3771-441e-bbba-2fdbd076d01e tempest-CreateVolumesFromSnapshotTest-88895777 None] Volume volume-ad734fb4-3734-495b-a8db-13973128b2c9 (ad734fb4-3734-495b-a8db-13973128b2c9): created successfully Jul 11 04:42:42 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e9664724-3771-441e-bbba-2fdbd076d01e tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (843e42c6-9720-492d-a8ac-69952c7ad190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:42 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e9664724-3771-441e-bbba-2fdbd076d01e tempest-CreateVolumesFromSnapshotTest-88895777 None] Flow 'volume_create_manager' (35dfce27-4214-4ea5-ade3-aa85e8bb5258) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:42:42 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-e9664724-3771-441e-bbba-2fdbd076d01e tempest-CreateVolumesFromSnapshotTest-88895777 None] Created volume successfully. Jul 11 04:42:42 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-527f304c-4bd0-4f82-9aa6-72dbe63946c1 tempest-CreateVolumesFromSnapshotTest-88895777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8411b15c-4d1a-4220-9b03-a8e3fee390ac 1073741824" returned: 0 in 0.780s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-527f304c-4bd0-4f82-9aa6-72dbe63946c1 tempest-CreateVolumesFromSnapshotTest-88895777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8411b15c-4d1a-4220-9b03-a8e3fee390ac {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:43 devstack sudo[104684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8411b15c-4d1a-4220-9b03-a8e3fee390ac Jul 11 04:42:43 devstack sudo[104684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:43 devstack sudo[104684]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-527f304c-4bd0-4f82-9aa6-72dbe63946c1 tempest-CreateVolumesFromSnapshotTest-88895777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8411b15c-4d1a-4220-9b03-a8e3fee390ac" returned: 0 in 0.643s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:43 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-527f304c-4bd0-4f82-9aa6-72dbe63946c1 tempest-CreateVolumesFromSnapshotTest-88895777 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:42:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-527f304c-4bd0-4f82-9aa6-72dbe63946c1 tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:42:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-01f32e27-58d0-49a3-8048-a8583359352f tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.223s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:42:43 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-01f32e27-58d0-49a3-8048-a8583359352f tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1575761135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28b8e06f-ebef-4229-9ddf-b126afd2c401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6bacb4bb734570b4d285c448d1e2e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:42:40Z,use_quota=True,user_id='b9dda606a25641ffba4f598737c40541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:42:43 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-01f32e27-58d0-49a3-8048-a8583359352f tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Creating volume 28b8e06f-ebef-4229-9ddf-b126afd2c401 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:42:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-01f32e27-58d0-49a3-8048-a8583359352f tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:42:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-01f32e27-58d0-49a3-8048-a8583359352f tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:42:43 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-01f32e27-58d0-49a3-8048-a8583359352f tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:42:43 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-01f32e27-58d0-49a3-8048-a8583359352f tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:42:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-01f32e27-58d0-49a3-8048-a8583359352f tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:42:43 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-01f32e27-58d0-49a3-8048-a8583359352f tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:42:43 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-01f32e27-58d0-49a3-8048-a8583359352f tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:42:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-01f32e27-58d0-49a3-8048-a8583359352f tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-28b8e06f-ebef-4229-9ddf-b126afd2c401 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:43 devstack sudo[104687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-28b8e06f-ebef-4229-9ddf-b126afd2c401 1073741824 Jul 11 04:42:43 devstack sudo[104687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-527f304c-4bd0-4f82-9aa6-72dbe63946c1 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deadeaa2-ac9e-4333-a1a9-7db9b49fc370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8411b15c-4d1a-4220-9b03-a8e3fee390ac', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-527f304c-4bd0-4f82-9aa6-72dbe63946c1 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a31d4fe3-1b78-49b8-ad3b-4d48dbabaad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:43 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-527f304c-4bd0-4f82-9aa6-72dbe63946c1 tempest-CreateVolumesFromSnapshotTest-88895777 None] Volume volume-8411b15c-4d1a-4220-9b03-a8e3fee390ac (8411b15c-4d1a-4220-9b03-a8e3fee390ac): created successfully Jul 11 04:42:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-527f304c-4bd0-4f82-9aa6-72dbe63946c1 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a31d4fe3-1b78-49b8-ad3b-4d48dbabaad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-527f304c-4bd0-4f82-9aa6-72dbe63946c1 tempest-CreateVolumesFromSnapshotTest-88895777 None] Flow 'volume_create_manager' (d8449a3b-483e-4330-ba1f-c566d09a0a32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:42:43 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-527f304c-4bd0-4f82-9aa6-72dbe63946c1 tempest-CreateVolumesFromSnapshotTest-88895777 None] Created volume successfully. Jul 11 04:42:44 devstack sudo[104687]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-01f32e27-58d0-49a3-8048-a8583359352f tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-28b8e06f-ebef-4229-9ddf-b126afd2c401 1073741824" returned: 0 in 0.806s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-01f32e27-58d0-49a3-8048-a8583359352f tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-28b8e06f-ebef-4229-9ddf-b126afd2c401 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:44 devstack sudo[104693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-28b8e06f-ebef-4229-9ddf-b126afd2c401 Jul 11 04:42:44 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:45 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-01f32e27-58d0-49a3-8048-a8583359352f tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-28b8e06f-ebef-4229-9ddf-b126afd2c401" returned: 0 in 0.635s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-01f32e27-58d0-49a3-8048-a8583359352f tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:42:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-01f32e27-58d0-49a3-8048-a8583359352f tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.480s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:42:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a2ea35c0-71fd-4edb-a010-ea7f5f23ea24 tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.593s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:42:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-a2ea35c0-71fd-4edb-a010-ea7f5f23ea24 tempest-CreateVolumesFromSnapshotTest-88895777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1861903354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a694a9b0-02f0-4d57-baed-d7bd22c76b07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f48bce7084344cb49d9ddce7413f2cc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:42:40Z,use_quota=True,user_id='a0ca758da4eb4ebeb6732ce02af538d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:42:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-a2ea35c0-71fd-4edb-a010-ea7f5f23ea24 tempest-CreateVolumesFromSnapshotTest-88895777 None] Creating volume a694a9b0-02f0-4d57-baed-d7bd22c76b07 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:42:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a2ea35c0-71fd-4edb-a010-ea7f5f23ea24 tempest-CreateVolumesFromSnapshotTest-88895777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:42:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a2ea35c0-71fd-4edb-a010-ea7f5f23ea24 tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:42:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-a2ea35c0-71fd-4edb-a010-ea7f5f23ea24 tempest-CreateVolumesFromSnapshotTest-88895777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:42:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-a2ea35c0-71fd-4edb-a010-ea7f5f23ea24 tempest-CreateVolumesFromSnapshotTest-88895777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:42:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a2ea35c0-71fd-4edb-a010-ea7f5f23ea24 tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:42:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-a2ea35c0-71fd-4edb-a010-ea7f5f23ea24 tempest-CreateVolumesFromSnapshotTest-88895777 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:42:45 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-a2ea35c0-71fd-4edb-a010-ea7f5f23ea24 tempest-CreateVolumesFromSnapshotTest-88895777 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:42:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a2ea35c0-71fd-4edb-a010-ea7f5f23ea24 tempest-CreateVolumesFromSnapshotTest-88895777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a694a9b0-02f0-4d57-baed-d7bd22c76b07 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-01f32e27-58d0-49a3-8048-a8583359352f tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1072af43-198b-4e8d-bd7d-970c945e2829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28b8e06f-ebef-4229-9ddf-b126afd2c401', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:45 devstack sudo[104696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a694a9b0-02f0-4d57-baed-d7bd22c76b07 1073741824 Jul 11 04:42:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-01f32e27-58d0-49a3-8048-a8583359352f tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18b9383b-4615-4d02-8027-8497ebef3ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:45 devstack sudo[104696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:45 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-01f32e27-58d0-49a3-8048-a8583359352f tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Volume volume-28b8e06f-ebef-4229-9ddf-b126afd2c401 (28b8e06f-ebef-4229-9ddf-b126afd2c401): created successfully Jul 11 04:42:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-01f32e27-58d0-49a3-8048-a8583359352f tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18b9383b-4615-4d02-8027-8497ebef3ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-01f32e27-58d0-49a3-8048-a8583359352f tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Flow 'volume_create_manager' (7b7dabbb-9276-43f1-9c13-33a688a84bcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:42:45 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-01f32e27-58d0-49a3-8048-a8583359352f tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Created volume successfully. Jul 11 04:42:45 devstack sudo[104696]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a2ea35c0-71fd-4edb-a010-ea7f5f23ea24 tempest-CreateVolumesFromSnapshotTest-88895777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a694a9b0-02f0-4d57-baed-d7bd22c76b07 1073741824" returned: 0 in 0.812s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a2ea35c0-71fd-4edb-a010-ea7f5f23ea24 tempest-CreateVolumesFromSnapshotTest-88895777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a694a9b0-02f0-4d57-baed-d7bd22c76b07 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:46 devstack sudo[104705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a694a9b0-02f0-4d57-baed-d7bd22c76b07 Jul 11 04:42:46 devstack sudo[104705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:46 devstack sudo[104705]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a2ea35c0-71fd-4edb-a010-ea7f5f23ea24 tempest-CreateVolumesFromSnapshotTest-88895777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a694a9b0-02f0-4d57-baed-d7bd22c76b07" returned: 0 in 0.631s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:46 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-a2ea35c0-71fd-4edb-a010-ea7f5f23ea24 tempest-CreateVolumesFromSnapshotTest-88895777 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:42:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a2ea35c0-71fd-4edb-a010-ea7f5f23ea24 tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:42:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4841514b-00a5-462b-8ab3-8c008d442c18 tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.973s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:42:46 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4841514b-00a5-462b-8ab3-8c008d442c18 tempest-CreateVolumesFromSnapshotTest-88895777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1140427210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d72170ef-e116-469a-8a96-b172bda2e1a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f48bce7084344cb49d9ddce7413f2cc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:42:41Z,use_quota=True,user_id='a0ca758da4eb4ebeb6732ce02af538d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:42:46 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-4841514b-00a5-462b-8ab3-8c008d442c18 tempest-CreateVolumesFromSnapshotTest-88895777 None] Creating volume d72170ef-e116-469a-8a96-b172bda2e1a4 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:42:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4841514b-00a5-462b-8ab3-8c008d442c18 tempest-CreateVolumesFromSnapshotTest-88895777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:42:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4841514b-00a5-462b-8ab3-8c008d442c18 tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:42:46 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4841514b-00a5-462b-8ab3-8c008d442c18 tempest-CreateVolumesFromSnapshotTest-88895777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:42:46 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4841514b-00a5-462b-8ab3-8c008d442c18 tempest-CreateVolumesFromSnapshotTest-88895777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:42:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4841514b-00a5-462b-8ab3-8c008d442c18 tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:42:46 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4841514b-00a5-462b-8ab3-8c008d442c18 tempest-CreateVolumesFromSnapshotTest-88895777 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:42:46 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-4841514b-00a5-462b-8ab3-8c008d442c18 tempest-CreateVolumesFromSnapshotTest-88895777 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:42:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4841514b-00a5-462b-8ab3-8c008d442c18 tempest-CreateVolumesFromSnapshotTest-88895777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d72170ef-e116-469a-8a96-b172bda2e1a4 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a2ea35c0-71fd-4edb-a010-ea7f5f23ea24 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7be0738-58a2-4691-bb0d-70d8eef06a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a694a9b0-02f0-4d57-baed-d7bd22c76b07', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:46 devstack sudo[104708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d72170ef-e116-469a-8a96-b172bda2e1a4 1073741824 Jul 11 04:42:46 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a2ea35c0-71fd-4edb-a010-ea7f5f23ea24 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15f9b971-45fd-4686-98bb-76a3e3bbbbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:46 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-a2ea35c0-71fd-4edb-a010-ea7f5f23ea24 tempest-CreateVolumesFromSnapshotTest-88895777 None] Volume volume-a694a9b0-02f0-4d57-baed-d7bd22c76b07 (a694a9b0-02f0-4d57-baed-d7bd22c76b07): created successfully Jul 11 04:42:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a2ea35c0-71fd-4edb-a010-ea7f5f23ea24 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15f9b971-45fd-4686-98bb-76a3e3bbbbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a2ea35c0-71fd-4edb-a010-ea7f5f23ea24 tempest-CreateVolumesFromSnapshotTest-88895777 None] Flow 'volume_create_manager' (6b1b6a1f-cc18-48a2-b3bb-23c17314cd7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:42:46 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-a2ea35c0-71fd-4edb-a010-ea7f5f23ea24 tempest-CreateVolumesFromSnapshotTest-88895777 None] Created volume successfully. Jul 11 04:42:47 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4841514b-00a5-462b-8ab3-8c008d442c18 tempest-CreateVolumesFromSnapshotTest-88895777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d72170ef-e116-469a-8a96-b172bda2e1a4 1073741824" returned: 0 in 0.806s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4841514b-00a5-462b-8ab3-8c008d442c18 tempest-CreateVolumesFromSnapshotTest-88895777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d72170ef-e116-469a-8a96-b172bda2e1a4 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:47 devstack sudo[104713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d72170ef-e116-469a-8a96-b172bda2e1a4 Jul 11 04:42:47 devstack sudo[104713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:48 devstack sudo[104713]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4841514b-00a5-462b-8ab3-8c008d442c18 tempest-CreateVolumesFromSnapshotTest-88895777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d72170ef-e116-469a-8a96-b172bda2e1a4" returned: 0 in 0.645s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:48 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4841514b-00a5-462b-8ab3-8c008d442c18 tempest-CreateVolumesFromSnapshotTest-88895777 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:42:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4841514b-00a5-462b-8ab3-8c008d442c18 tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:42:48 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4841514b-00a5-462b-8ab3-8c008d442c18 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8004066b-7f45-432e-b3b8-0dbd1d277184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d72170ef-e116-469a-8a96-b172bda2e1a4', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:48 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4841514b-00a5-462b-8ab3-8c008d442c18 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf02f0b-9071-4aae-8899-81190d49ecb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:42:48 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-4841514b-00a5-462b-8ab3-8c008d442c18 tempest-CreateVolumesFromSnapshotTest-88895777 None] Volume volume-d72170ef-e116-469a-8a96-b172bda2e1a4 (d72170ef-e116-469a-8a96-b172bda2e1a4): created successfully Jul 11 04:42:48 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4841514b-00a5-462b-8ab3-8c008d442c18 tempest-CreateVolumesFromSnapshotTest-88895777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf02f0b-9071-4aae-8899-81190d49ecb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:42:48 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4841514b-00a5-462b-8ab3-8c008d442c18 tempest-CreateVolumesFromSnapshotTest-88895777 None] Flow 'volume_create_manager' (8c74fd5c-7a07-4b14-9a0f-6b7c7ce6e956) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:42:48 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-4841514b-00a5-462b-8ab3-8c008d442c18 tempest-CreateVolumesFromSnapshotTest-88895777 None] Created volume successfully. Jul 11 04:42:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-e4f38cbe-04cc-49b9-befe-c3af1a6bf021 req-7b01be04-e4af-4629-a5ea-7af9932a1dd6 tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:42:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-e4f38cbe-04cc-49b9-befe-c3af1a6bf021 req-7b01be04-e4af-4629-a5ea-7af9932a1dd6 tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:42:48 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f56b2e-4f13-4837-a319-cba6050717ea]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:42:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-e4f38cbe-04cc-49b9-befe-c3af1a6bf021 req-7b01be04-e4af-4629-a5ea-7af9932a1dd6 tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-28b8e06f-ebef-4229-9ddf-b126afd2c401 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:48 devstack sudo[104724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-28b8e06f-ebef-4229-9ddf-b126afd2c401 Jul 11 04:42:48 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:49 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [req-e4f38cbe-04cc-49b9-befe-c3af1a6bf021 req-7b01be04-e4af-4629-a5ea-7af9932a1dd6 tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-28b8e06f-ebef-4229-9ddf-b126afd2c401" returned: 0 in 0.760s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [req-e4f38cbe-04cc-49b9-befe-c3af1a6bf021 req-7b01be04-e4af-4629-a5ea-7af9932a1dd6 tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.778s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:42:49 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-e4f38cbe-04cc-49b9-befe-c3af1a6bf021 req-7b01be04-e4af-4629-a5ea-7af9932a1dd6 tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95', 'name': 'volume-28b8e06f-ebef-4229-9ddf-b126afd2c401', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '504db859-d0e8-434e-a9e7-13ce5257efdf', 'enforce_multipath': True} {{(pid=86964) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 04:42:49 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d0a21f1b-8f34-4d92-a834-92a4e4d42abc tempest-CreateVolumesFromSnapshotTest-88895777 None] Acquiring lock "cinder-d72170ef-e116-469a-8a96-b172bda2e1a4-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:42:49 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d0a21f1b-8f34-4d92-a834-92a4e4d42abc tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "cinder-d72170ef-e116-469a-8a96-b172bda2e1a4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:42:49 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-e4f38cbe-04cc-49b9-befe-c3af1a6bf021 req-7b01be04-e4af-4629-a5ea-7af9932a1dd6 tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] attachment_update completed successfully. Jul 11 04:42:49 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d0a21f1b-8f34-4d92-a834-92a4e4d42abc tempest-CreateVolumesFromSnapshotTest-88895777 None] Acquiring lock "cinder-quobyte-d72170ef-e116-469a-8a96-b172bda2e1a4" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:42:49 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d0a21f1b-8f34-4d92-a834-92a4e4d42abc tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "cinder-quobyte-d72170ef-e116-469a-8a96-b172bda2e1a4" acquired by "delete_volume" :: waited 0.013s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:42:49 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d0e70d-5979-4278-9f6a-d0161a56d16d]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:42:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d0a21f1b-8f34-4d92-a834-92a4e4d42abc tempest-CreateVolumesFromSnapshotTest-88895777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d72170ef-e116-469a-8a96-b172bda2e1a4 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:49 devstack sudo[104729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d72170ef-e116-469a-8a96-b172bda2e1a4 Jul 11 04:42:49 devstack sudo[104729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:50 devstack sudo[104729]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d0a21f1b-8f34-4d92-a834-92a4e4d42abc tempest-CreateVolumesFromSnapshotTest-88895777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d72170ef-e116-469a-8a96-b172bda2e1a4" returned: 0 in 0.751s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d0a21f1b-8f34-4d92-a834-92a4e4d42abc tempest-CreateVolumesFromSnapshotTest-88895777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d72170ef-e116-469a-8a96-b172bda2e1a4 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:50 devstack sudo[104801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d72170ef-e116-469a-8a96-b172bda2e1a4 Jul 11 04:42:50 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:50 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d0a21f1b-8f34-4d92-a834-92a4e4d42abc tempest-CreateVolumesFromSnapshotTest-88895777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d72170ef-e116-469a-8a96-b172bda2e1a4" returned: 0 in 0.657s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d0a21f1b-8f34-4d92-a834-92a4e4d42abc tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "cinder-quobyte-d72170ef-e116-469a-8a96-b172bda2e1a4" released by "delete_volume" :: held 1.444s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:42:50 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-d0a21f1b-8f34-4d92-a834-92a4e4d42abc tempest-CreateVolumesFromSnapshotTest-88895777 None] Created reservations ['cfdcd4c7-854e-4730-802a-93509cd564a5', '4a2484f6-7073-4268-9baf-11a0b1ca7203', '3e5919f5-36ef-42a2-8f2b-161349d4191b', 'c9d05675-8816-4ebb-8721-1bda39b9c942'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:42:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d0a21f1b-8f34-4d92-a834-92a4e4d42abc tempest-CreateVolumesFromSnapshotTest-88895777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:42:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d0a21f1b-8f34-4d92-a834-92a4e4d42abc tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:42:50 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-d0a21f1b-8f34-4d92-a834-92a4e4d42abc tempest-CreateVolumesFromSnapshotTest-88895777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:42:50 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-d0a21f1b-8f34-4d92-a834-92a4e4d42abc tempest-CreateVolumesFromSnapshotTest-88895777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:42:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d0a21f1b-8f34-4d92-a834-92a4e4d42abc tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:42:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d0a21f1b-8f34-4d92-a834-92a4e4d42abc tempest-CreateVolumesFromSnapshotTest-88895777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:50 devstack sudo[105119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:42:50 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ddefcb9c-3a6f-40cc-98eb-694618053539 tempest-CreateVolumesFromSnapshotTest-88895777 None] Acquiring lock "cinder-a694a9b0-02f0-4d57-baed-d7bd22c76b07-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:42:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ddefcb9c-3a6f-40cc-98eb-694618053539 tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "cinder-a694a9b0-02f0-4d57-baed-d7bd22c76b07-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:42:51 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d0a21f1b-8f34-4d92-a834-92a4e4d42abc tempest-CreateVolumesFromSnapshotTest-88895777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.646s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:51 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-d0a21f1b-8f34-4d92-a834-92a4e4d42abc tempest-CreateVolumesFromSnapshotTest-88895777 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:42:51 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-d0a21f1b-8f34-4d92-a834-92a4e4d42abc tempest-CreateVolumesFromSnapshotTest-88895777 None] Deleted volume successfully. Jul 11 04:42:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ddefcb9c-3a6f-40cc-98eb-694618053539 tempest-CreateVolumesFromSnapshotTest-88895777 None] Acquiring lock "cinder-quobyte-a694a9b0-02f0-4d57-baed-d7bd22c76b07" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:42:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ddefcb9c-3a6f-40cc-98eb-694618053539 tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "cinder-quobyte-a694a9b0-02f0-4d57-baed-d7bd22c76b07" acquired by "delete_volume" :: waited 0.022s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:42:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d0a21f1b-8f34-4d92-a834-92a4e4d42abc tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "cinder-d72170ef-e116-469a-8a96-b172bda2e1a4-delete_volume" released by "delete_volume" :: held 2.313s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:42:51 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fc07f1-8b25-49cf-abd0-3513fee33abd]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:42:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ddefcb9c-3a6f-40cc-98eb-694618053539 tempest-CreateVolumesFromSnapshotTest-88895777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a694a9b0-02f0-4d57-baed-d7bd22c76b07 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:51 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a694a9b0-02f0-4d57-baed-d7bd22c76b07 Jul 11 04:42:51 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:52 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ddefcb9c-3a6f-40cc-98eb-694618053539 tempest-CreateVolumesFromSnapshotTest-88895777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a694a9b0-02f0-4d57-baed-d7bd22c76b07" returned: 0 in 0.736s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ddefcb9c-3a6f-40cc-98eb-694618053539 tempest-CreateVolumesFromSnapshotTest-88895777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a694a9b0-02f0-4d57-baed-d7bd22c76b07 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:52 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a694a9b0-02f0-4d57-baed-d7bd22c76b07 Jul 11 04:42:52 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:52 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ddefcb9c-3a6f-40cc-98eb-694618053539 tempest-CreateVolumesFromSnapshotTest-88895777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a694a9b0-02f0-4d57-baed-d7bd22c76b07" returned: 0 in 0.638s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:52 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ddefcb9c-3a6f-40cc-98eb-694618053539 tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "cinder-quobyte-a694a9b0-02f0-4d57-baed-d7bd22c76b07" released by "delete_volume" :: held 1.416s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:42:53 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-ddefcb9c-3a6f-40cc-98eb-694618053539 tempest-CreateVolumesFromSnapshotTest-88895777 None] Created reservations ['77af32bb-d202-4f88-b271-7a518381d202', '726bbf36-ff8f-4955-a29c-b621bc50175e', '5f451aa9-59a7-4da9-96b3-5a95aa9e6a92', '742fb652-46c0-4d49-b9ab-dcc93bcdba2c'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:42:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ddefcb9c-3a6f-40cc-98eb-694618053539 tempest-CreateVolumesFromSnapshotTest-88895777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:42:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ddefcb9c-3a6f-40cc-98eb-694618053539 tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:42:53 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ddefcb9c-3a6f-40cc-98eb-694618053539 tempest-CreateVolumesFromSnapshotTest-88895777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:42:53 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ddefcb9c-3a6f-40cc-98eb-694618053539 tempest-CreateVolumesFromSnapshotTest-88895777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:42:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ddefcb9c-3a6f-40cc-98eb-694618053539 tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:42:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ddefcb9c-3a6f-40cc-98eb-694618053539 tempest-CreateVolumesFromSnapshotTest-88895777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:53 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:42:53 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:53 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-84dcc2a1-ecda-4f7c-8318-11fe7eb47fbe tempest-CreateVolumesFromSnapshotTest-88895777 None] Acquiring lock "cinder-8411b15c-4d1a-4220-9b03-a8e3fee390ac-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:42:53 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ddefcb9c-3a6f-40cc-98eb-694618053539 tempest-CreateVolumesFromSnapshotTest-88895777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.656s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:53 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-ddefcb9c-3a6f-40cc-98eb-694618053539 tempest-CreateVolumesFromSnapshotTest-88895777 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:42:53 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-84dcc2a1-ecda-4f7c-8318-11fe7eb47fbe tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "cinder-8411b15c-4d1a-4220-9b03-a8e3fee390ac-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:42:53 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-ddefcb9c-3a6f-40cc-98eb-694618053539 tempest-CreateVolumesFromSnapshotTest-88895777 None] Deleted volume successfully. Jul 11 04:42:53 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ddefcb9c-3a6f-40cc-98eb-694618053539 tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "cinder-a694a9b0-02f0-4d57-baed-d7bd22c76b07-delete_volume" released by "delete_volume" :: held 2.293s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:42:53 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-84dcc2a1-ecda-4f7c-8318-11fe7eb47fbe tempest-CreateVolumesFromSnapshotTest-88895777 None] Acquiring lock "cinder-quobyte-8411b15c-4d1a-4220-9b03-a8e3fee390ac" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:42:53 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-84dcc2a1-ecda-4f7c-8318-11fe7eb47fbe tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "cinder-quobyte-8411b15c-4d1a-4220-9b03-a8e3fee390ac" acquired by "delete_volume" :: waited 0.026s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:42:53 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0f230c-4fff-4543-a45f-84052cc7a484]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:42:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-84dcc2a1-ecda-4f7c-8318-11fe7eb47fbe tempest-CreateVolumesFromSnapshotTest-88895777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8411b15c-4d1a-4220-9b03-a8e3fee390ac {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:53 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8411b15c-4d1a-4220-9b03-a8e3fee390ac Jul 11 04:42:53 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:54 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-84dcc2a1-ecda-4f7c-8318-11fe7eb47fbe tempest-CreateVolumesFromSnapshotTest-88895777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8411b15c-4d1a-4220-9b03-a8e3fee390ac" returned: 0 in 0.770s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-84dcc2a1-ecda-4f7c-8318-11fe7eb47fbe tempest-CreateVolumesFromSnapshotTest-88895777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8411b15c-4d1a-4220-9b03-a8e3fee390ac {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:54 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8411b15c-4d1a-4220-9b03-a8e3fee390ac Jul 11 04:42:54 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:55 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-84dcc2a1-ecda-4f7c-8318-11fe7eb47fbe tempest-CreateVolumesFromSnapshotTest-88895777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8411b15c-4d1a-4220-9b03-a8e3fee390ac" returned: 0 in 0.635s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:55 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-84dcc2a1-ecda-4f7c-8318-11fe7eb47fbe tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "cinder-quobyte-8411b15c-4d1a-4220-9b03-a8e3fee390ac" released by "delete_volume" :: held 1.446s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:42:55 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-84dcc2a1-ecda-4f7c-8318-11fe7eb47fbe tempest-CreateVolumesFromSnapshotTest-88895777 None] Created reservations ['6d05eada-5cf6-4e52-a057-24b1a53f1e75', 'a54190ab-1e69-410b-95b5-3de4e63b7dd9', '070eb99c-d1b1-408e-ac0f-2818d577caee', '55a15895-d573-4301-8677-4e94483495d9'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:42:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-84dcc2a1-ecda-4f7c-8318-11fe7eb47fbe tempest-CreateVolumesFromSnapshotTest-88895777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:42:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-84dcc2a1-ecda-4f7c-8318-11fe7eb47fbe tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:42:55 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-84dcc2a1-ecda-4f7c-8318-11fe7eb47fbe tempest-CreateVolumesFromSnapshotTest-88895777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:42:55 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-84dcc2a1-ecda-4f7c-8318-11fe7eb47fbe tempest-CreateVolumesFromSnapshotTest-88895777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:42:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-84dcc2a1-ecda-4f7c-8318-11fe7eb47fbe tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:42:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-84dcc2a1-ecda-4f7c-8318-11fe7eb47fbe tempest-CreateVolumesFromSnapshotTest-88895777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:55 devstack sudo[105141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:42:55 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:55 devstack cinder-volume[86964]: INFO cinder.volume.manager [req-9629c280-244a-477b-a814-0fbedbf4a3f5 req-116e55e8-a1ea-4a18-ae09-d101ee5bf02a tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Terminate volume connection completed successfully. Jul 11 04:42:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [req-9629c280-244a-477b-a814-0fbedbf4a3f5 req-116e55e8-a1ea-4a18-ae09-d101ee5bf02a tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Deleting attachment 504db859-d0e8-434e-a9e7-13ce5257efdf. {{(pid=86964) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 04:42:56 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1ea16ccb-7f7e-4402-8a0d-0c8939794f41 tempest-CreateVolumesFromSnapshotTest-88895777 None] Acquiring lock "cinder-ad734fb4-3734-495b-a8db-13973128b2c9-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:42:56 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1ea16ccb-7f7e-4402-8a0d-0c8939794f41 tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "cinder-ad734fb4-3734-495b-a8db-13973128b2c9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:42:56 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1ea16ccb-7f7e-4402-8a0d-0c8939794f41 tempest-CreateVolumesFromSnapshotTest-88895777 None] Acquiring lock "cinder-quobyte-ad734fb4-3734-495b-a8db-13973128b2c9" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:42:56 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1ea16ccb-7f7e-4402-8a0d-0c8939794f41 tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "cinder-quobyte-ad734fb4-3734-495b-a8db-13973128b2c9" acquired by "delete_volume" :: waited 0.017s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:42:56 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-84dcc2a1-ecda-4f7c-8318-11fe7eb47fbe tempest-CreateVolumesFromSnapshotTest-88895777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.665s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:56 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-84dcc2a1-ecda-4f7c-8318-11fe7eb47fbe tempest-CreateVolumesFromSnapshotTest-88895777 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:42:56 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-84dcc2a1-ecda-4f7c-8318-11fe7eb47fbe tempest-CreateVolumesFromSnapshotTest-88895777 None] Deleted volume successfully. Jul 11 04:42:56 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8caf75-1270-4963-8c61-48db69625c2f]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:42:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1ea16ccb-7f7e-4402-8a0d-0c8939794f41 tempest-CreateVolumesFromSnapshotTest-88895777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ad734fb4-3734-495b-a8db-13973128b2c9 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:56 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-84dcc2a1-ecda-4f7c-8318-11fe7eb47fbe tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "cinder-8411b15c-4d1a-4220-9b03-a8e3fee390ac-delete_volume" released by "delete_volume" :: held 2.355s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:42:56 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ad734fb4-3734-495b-a8db-13973128b2c9 Jul 11 04:42:56 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:56 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1ea16ccb-7f7e-4402-8a0d-0c8939794f41 tempest-CreateVolumesFromSnapshotTest-88895777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ad734fb4-3734-495b-a8db-13973128b2c9" returned: 0 in 0.734s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1ea16ccb-7f7e-4402-8a0d-0c8939794f41 tempest-CreateVolumesFromSnapshotTest-88895777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ad734fb4-3734-495b-a8db-13973128b2c9 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:56 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ad734fb4-3734-495b-a8db-13973128b2c9 Jul 11 04:42:56 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:57 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1ea16ccb-7f7e-4402-8a0d-0c8939794f41 tempest-CreateVolumesFromSnapshotTest-88895777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ad734fb4-3734-495b-a8db-13973128b2c9" returned: 0 in 0.644s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:57 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1ea16ccb-7f7e-4402-8a0d-0c8939794f41 tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "cinder-quobyte-ad734fb4-3734-495b-a8db-13973128b2c9" released by "delete_volume" :: held 1.423s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:42:57 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-1ea16ccb-7f7e-4402-8a0d-0c8939794f41 tempest-CreateVolumesFromSnapshotTest-88895777 None] Created reservations ['c558b851-3d73-4f7c-aa15-1a5128acb330', '1fa27007-129e-4cf1-a769-235271b14433', '2d56fcf1-768b-4a70-8950-8b41087fcc4e', '6dd9d4ff-11a9-4aa2-8dae-eba3db6d0875'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:42:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1ea16ccb-7f7e-4402-8a0d-0c8939794f41 tempest-CreateVolumesFromSnapshotTest-88895777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:42:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1ea16ccb-7f7e-4402-8a0d-0c8939794f41 tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:42:57 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-1ea16ccb-7f7e-4402-8a0d-0c8939794f41 tempest-CreateVolumesFromSnapshotTest-88895777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:42:57 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-1ea16ccb-7f7e-4402-8a0d-0c8939794f41 tempest-CreateVolumesFromSnapshotTest-88895777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:42:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1ea16ccb-7f7e-4402-8a0d-0c8939794f41 tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:42:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1ea16ccb-7f7e-4402-8a0d-0c8939794f41 tempest-CreateVolumesFromSnapshotTest-88895777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:57 devstack sudo[105181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:42:57 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:57 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b3d66d76-bf38-41cc-a4cc-3dd450f95368 tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Acquiring lock "cinder-28b8e06f-ebef-4229-9ddf-b126afd2c401-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:42:57 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b3d66d76-bf38-41cc-a4cc-3dd450f95368 tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Lock "cinder-28b8e06f-ebef-4229-9ddf-b126afd2c401-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:42:57 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b3d66d76-bf38-41cc-a4cc-3dd450f95368 tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Acquiring lock "cinder-quobyte-28b8e06f-ebef-4229-9ddf-b126afd2c401" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:42:57 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b3d66d76-bf38-41cc-a4cc-3dd450f95368 tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Lock "cinder-quobyte-28b8e06f-ebef-4229-9ddf-b126afd2c401" acquired by "delete_volume" :: waited 0.014s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:42:57 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[61334cb7-de1d-44dc-8edd-d6b9a658d3cb]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:42:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b3d66d76-bf38-41cc-a4cc-3dd450f95368 tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-28b8e06f-ebef-4229-9ddf-b126afd2c401 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:58 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-28b8e06f-ebef-4229-9ddf-b126afd2c401 Jul 11 04:42:58 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:58 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ac39c493-f527-4b20-bc79-c9c4d80ba95f tempest-CreateVolumesFromSnapshotTest-88895777 None] Acquiring lock "cinder-c41ea1a5-8e88-496f-ab42-942a2e08c935-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:42:58 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ac39c493-f527-4b20-bc79-c9c4d80ba95f tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "cinder-c41ea1a5-8e88-496f-ab42-942a2e08c935-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:42:58 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ac39c493-f527-4b20-bc79-c9c4d80ba95f tempest-CreateVolumesFromSnapshotTest-88895777 None] Acquiring lock "cinder-quobyte-c41ea1a5-8e88-496f-ab42-942a2e08c935" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:42:58 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ac39c493-f527-4b20-bc79-c9c4d80ba95f tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "cinder-quobyte-c41ea1a5-8e88-496f-ab42-942a2e08c935" acquired by "delete_volume" :: waited 0.019s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:42:58 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1ea16ccb-7f7e-4402-8a0d-0c8939794f41 tempest-CreateVolumesFromSnapshotTest-88895777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.677s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:58 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-1ea16ccb-7f7e-4402-8a0d-0c8939794f41 tempest-CreateVolumesFromSnapshotTest-88895777 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:42:58 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-1ea16ccb-7f7e-4402-8a0d-0c8939794f41 tempest-CreateVolumesFromSnapshotTest-88895777 None] Deleted volume successfully. Jul 11 04:42:58 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eac1c16-9354-498c-9ac5-cc1c6565704a]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:42:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ac39c493-f527-4b20-bc79-c9c4d80ba95f tempest-CreateVolumesFromSnapshotTest-88895777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c41ea1a5-8e88-496f-ab42-942a2e08c935 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:58 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1ea16ccb-7f7e-4402-8a0d-0c8939794f41 tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "cinder-ad734fb4-3734-495b-a8db-13973128b2c9-delete_volume" released by "delete_volume" :: held 2.386s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:42:58 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c41ea1a5-8e88-496f-ab42-942a2e08c935 Jul 11 04:42:58 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:58 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b3d66d76-bf38-41cc-a4cc-3dd450f95368 tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-28b8e06f-ebef-4229-9ddf-b126afd2c401" returned: 0 in 0.779s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b3d66d76-bf38-41cc-a4cc-3dd450f95368 tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-28b8e06f-ebef-4229-9ddf-b126afd2c401 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:58 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-28b8e06f-ebef-4229-9ddf-b126afd2c401 Jul 11 04:42:58 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:59 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:42:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:42:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:42:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:42:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:42:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:42:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:59 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ac39c493-f527-4b20-bc79-c9c4d80ba95f tempest-CreateVolumesFromSnapshotTest-88895777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c41ea1a5-8e88-496f-ab42-942a2e08c935" returned: 0 in 0.791s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ac39c493-f527-4b20-bc79-c9c4d80ba95f tempest-CreateVolumesFromSnapshotTest-88895777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c41ea1a5-8e88-496f-ab42-942a2e08c935 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:59 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:42:59 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:59 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c41ea1a5-8e88-496f-ab42-942a2e08c935 Jul 11 04:42:59 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:59 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b3d66d76-bf38-41cc-a4cc-3dd450f95368 tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-28b8e06f-ebef-4229-9ddf-b126afd2c401" returned: 0 in 0.632s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:59 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b3d66d76-bf38-41cc-a4cc-3dd450f95368 tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Lock "cinder-quobyte-28b8e06f-ebef-4229-9ddf-b126afd2c401" released by "delete_volume" :: held 1.462s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:42:59 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-b3d66d76-bf38-41cc-a4cc-3dd450f95368 tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Created reservations ['59a79677-07d4-46fb-9c05-64eee7b3e99b', '9086fbf9-0c22-4fbc-b10d-6fd04c37119e', 'fe0ac546-a227-46a7-a234-4a8b2bd535e2', '836487aa-4f1e-41de-8a20-4a65f181d6a2'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:42:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b3d66d76-bf38-41cc-a4cc-3dd450f95368 tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:42:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b3d66d76-bf38-41cc-a4cc-3dd450f95368 tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:42:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b3d66d76-bf38-41cc-a4cc-3dd450f95368 tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:42:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b3d66d76-bf38-41cc-a4cc-3dd450f95368 tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:42:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b3d66d76-bf38-41cc-a4cc-3dd450f95368 tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:42:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b3d66d76-bf38-41cc-a4cc-3dd450f95368 tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:42:59 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:42:59 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:42:59 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.685s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:59 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:42:59 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager._thread_info {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:42:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread count: 28 {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:42:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread info: [<_MainThread(MainThread, started 124675027595392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:42:59 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Jul 11 04:42:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ac39c493-f527-4b20-bc79-c9c4d80ba95f tempest-CreateVolumesFromSnapshotTest-88895777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c41ea1a5-8e88-496f-ab42-942a2e08c935" returned: 0 in 0.703s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:42:59 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ac39c493-f527-4b20-bc79-c9c4d80ba95f tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "cinder-quobyte-c41ea1a5-8e88-496f-ab42-942a2e08c935" released by "delete_volume" :: held 1.561s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:42:59 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-ac39c493-f527-4b20-bc79-c9c4d80ba95f tempest-CreateVolumesFromSnapshotTest-88895777 None] Created reservations ['1aa0a956-67ed-4da4-a2c4-0deeca01c8d2', '48f82b12-d5c3-4796-aeb0-6d210211c379', '1a6a3641-9f0c-42f5-a8bb-c0e819b1533d', 'c98861b2-0110-4b30-b5a2-0a5267284820'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:43:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ac39c493-f527-4b20-bc79-c9c4d80ba95f tempest-CreateVolumesFromSnapshotTest-88895777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ac39c493-f527-4b20-bc79-c9c4d80ba95f tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:00 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ac39c493-f527-4b20-bc79-c9c4d80ba95f tempest-CreateVolumesFromSnapshotTest-88895777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:43:00 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ac39c493-f527-4b20-bc79-c9c4d80ba95f tempest-CreateVolumesFromSnapshotTest-88895777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:43:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ac39c493-f527-4b20-bc79-c9c4d80ba95f tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ac39c493-f527-4b20-bc79-c9c4d80ba95f tempest-CreateVolumesFromSnapshotTest-88895777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:00 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:43:00 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:00 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b3d66d76-bf38-41cc-a4cc-3dd450f95368 tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.737s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:00 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-b3d66d76-bf38-41cc-a4cc-3dd450f95368 tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:43:00 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-b3d66d76-bf38-41cc-a4cc-3dd450f95368 tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Deleted volume successfully. Jul 11 04:43:00 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b3d66d76-bf38-41cc-a4cc-3dd450f95368 tempest-TestServerVolumeAttachScenarioOldVersion-212750174 None] Lock "cinder-28b8e06f-ebef-4229-9ddf-b126afd2c401-delete_volume" released by "delete_volume" :: held 2.437s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:43:00 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-24e4aa90-a88a-42a4-a531-bb07caf8aefe tempest-CreateVolumesFromSnapshotTest-88895777 None] Acquiring lock "cinder-e84a2124-2cf3-46ba-a8fb-bc4d0e4209d4-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:43:00 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-24e4aa90-a88a-42a4-a531-bb07caf8aefe tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "cinder-e84a2124-2cf3-46ba-a8fb-bc4d0e4209d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:43:00 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-24e4aa90-a88a-42a4-a531-bb07caf8aefe tempest-CreateVolumesFromSnapshotTest-88895777 None] Acquiring lock "cinder-quobyte-791bb6df-02f2-4b13-ab04-79134ca57beb" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:43:00 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-24e4aa90-a88a-42a4-a531-bb07caf8aefe tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "cinder-quobyte-791bb6df-02f2-4b13-ab04-79134ca57beb" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:43:00 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-24e4aa90-a88a-42a4-a531-bb07caf8aefe tempest-CreateVolumesFromSnapshotTest-88895777 None] Acquiring lock "cinder-quobyte-e84a2124-2cf3-46ba-a8fb-bc4d0e4209d4" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:43:00 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-24e4aa90-a88a-42a4-a531-bb07caf8aefe tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "cinder-quobyte-e84a2124-2cf3-46ba-a8fb-bc4d0e4209d4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:43:00 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-24e4aa90-a88a-42a4-a531-bb07caf8aefe tempest-CreateVolumesFromSnapshotTest-88895777 None] Deleting offline snapshot e84a2124-2cf3-46ba-a8fb-bc4d0e4209d4 of volume 791bb6df-02f2-4b13-ab04-79134ca57beb {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:43:00 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-24e4aa90-a88a-42a4-a531-bb07caf8aefe tempest-CreateVolumesFromSnapshotTest-88895777 None] snapshot_file for this snap is: volume-791bb6df-02f2-4b13-ab04-79134ca57beb.e84a2124-2cf3-46ba-a8fb-bc4d0e4209d4 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:43:00 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b8a55f-f6a0-4859-b799-ddaee54a46b3]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:43:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-24e4aa90-a88a-42a4-a531-bb07caf8aefe tempest-CreateVolumesFromSnapshotTest-88895777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb.e84a2124-2cf3-46ba-a8fb-bc4d0e4209d4 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:00 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb.e84a2124-2cf3-46ba-a8fb-bc4d0e4209d4 Jul 11 04:43:00 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:00 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ac39c493-f527-4b20-bc79-c9c4d80ba95f tempest-CreateVolumesFromSnapshotTest-88895777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.735s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:00 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-ac39c493-f527-4b20-bc79-c9c4d80ba95f tempest-CreateVolumesFromSnapshotTest-88895777 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:43:00 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-ac39c493-f527-4b20-bc79-c9c4d80ba95f tempest-CreateVolumesFromSnapshotTest-88895777 None] Deleted volume successfully. Jul 11 04:43:00 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ac39c493-f527-4b20-bc79-c9c4d80ba95f tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "cinder-c41ea1a5-8e88-496f-ab42-942a2e08c935-delete_volume" released by "delete_volume" :: held 2.519s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:43:01 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-24e4aa90-a88a-42a4-a531-bb07caf8aefe tempest-CreateVolumesFromSnapshotTest-88895777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb.e84a2124-2cf3-46ba-a8fb-bc4d0e4209d4" returned: 0 in 0.752s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:01 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-24e4aa90-a88a-42a4-a531-bb07caf8aefe tempest-CreateVolumesFromSnapshotTest-88895777 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-791bb6df-02f2-4b13-ab04-79134ca57beb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:43:01 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[46de706a-a009-4773-8ebb-16c7607c2006]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:43:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-24e4aa90-a88a-42a4-a531-bb07caf8aefe tempest-CreateVolumesFromSnapshotTest-88895777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:01 devstack sudo[105219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb Jul 11 04:43:01 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:02 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-24e4aa90-a88a-42a4-a531-bb07caf8aefe tempest-CreateVolumesFromSnapshotTest-88895777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb" returned: 0 in 0.852s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-24e4aa90-a88a-42a4-a531-bb07caf8aefe tempest-CreateVolumesFromSnapshotTest-88895777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb.e84a2124-2cf3-46ba-a8fb-bc4d0e4209d4 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:02 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb.e84a2124-2cf3-46ba-a8fb-bc4d0e4209d4 Jul 11 04:43:02 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:03 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-24e4aa90-a88a-42a4-a531-bb07caf8aefe tempest-CreateVolumesFromSnapshotTest-88895777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb.e84a2124-2cf3-46ba-a8fb-bc4d0e4209d4" returned: 0 in 0.792s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-24e4aa90-a88a-42a4-a531-bb07caf8aefe tempest-CreateVolumesFromSnapshotTest-88895777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb.e84a2124-2cf3-46ba-a8fb-bc4d0e4209d4 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:03 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb.e84a2124-2cf3-46ba-a8fb-bc4d0e4209d4 Jul 11 04:43:03 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:03 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-24e4aa90-a88a-42a4-a531-bb07caf8aefe tempest-CreateVolumesFromSnapshotTest-88895777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb.e84a2124-2cf3-46ba-a8fb-bc4d0e4209d4" returned: 0 in 0.680s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:03 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-24e4aa90-a88a-42a4-a531-bb07caf8aefe tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "cinder-quobyte-e84a2124-2cf3-46ba-a8fb-bc4d0e4209d4" released by "_delete_snapshot" :: held 3.176s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:43:03 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-24e4aa90-a88a-42a4-a531-bb07caf8aefe tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "cinder-quobyte-791bb6df-02f2-4b13-ab04-79134ca57beb" released by "delete_snapshot" :: held 3.201s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:43:03 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-24e4aa90-a88a-42a4-a531-bb07caf8aefe tempest-CreateVolumesFromSnapshotTest-88895777 None] Created reservations ['f17be3a1-9b5a-441c-b0ba-a6514af8c6b7', 'b5a29810-d272-40ca-8a3d-d879d16465ad', '3f96d1f9-6575-4fd3-9d80-d51e8c2aac2c', '6c484822-0ef5-4179-ae34-aeebf6ec854c'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:43:03 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-24e4aa90-a88a-42a4-a531-bb07caf8aefe tempest-CreateVolumesFromSnapshotTest-88895777 None] Delete snapshot completed successfully. Jul 11 04:43:03 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-24e4aa90-a88a-42a4-a531-bb07caf8aefe tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "cinder-e84a2124-2cf3-46ba-a8fb-bc4d0e4209d4-delete_snapshot" released by "delete_snapshot" :: held 3.339s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:43:04 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f73eece9-72ec-4688-86da-6b88d1981909 tempest-CreateVolumesFromSnapshotTest-88895777 None] Acquiring lock "cinder-791bb6df-02f2-4b13-ab04-79134ca57beb-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:43:04 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f73eece9-72ec-4688-86da-6b88d1981909 tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "cinder-791bb6df-02f2-4b13-ab04-79134ca57beb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:43:04 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f73eece9-72ec-4688-86da-6b88d1981909 tempest-CreateVolumesFromSnapshotTest-88895777 None] Acquiring lock "cinder-quobyte-791bb6df-02f2-4b13-ab04-79134ca57beb" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:43:04 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f73eece9-72ec-4688-86da-6b88d1981909 tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "cinder-quobyte-791bb6df-02f2-4b13-ab04-79134ca57beb" acquired by "delete_volume" :: waited 0.014s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:43:04 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ef20e4-75ab-48b8-8952-5370b1258a28]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:43:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f73eece9-72ec-4688-86da-6b88d1981909 tempest-CreateVolumesFromSnapshotTest-88895777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:04 devstack sudo[105254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb Jul 11 04:43:04 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:05 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f73eece9-72ec-4688-86da-6b88d1981909 tempest-CreateVolumesFromSnapshotTest-88895777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb" returned: 0 in 0.762s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f73eece9-72ec-4688-86da-6b88d1981909 tempest-CreateVolumesFromSnapshotTest-88895777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:05 devstack sudo[105260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb Jul 11 04:43:05 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:06 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f73eece9-72ec-4688-86da-6b88d1981909 tempest-CreateVolumesFromSnapshotTest-88895777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-791bb6df-02f2-4b13-ab04-79134ca57beb" returned: 0 in 0.652s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:06 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f73eece9-72ec-4688-86da-6b88d1981909 tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "cinder-quobyte-791bb6df-02f2-4b13-ab04-79134ca57beb" released by "delete_volume" :: held 1.467s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:43:06 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-f73eece9-72ec-4688-86da-6b88d1981909 tempest-CreateVolumesFromSnapshotTest-88895777 None] Created reservations ['8de0f014-d1ef-47d2-959e-932d7fc50379', 'a35b306b-7425-4eca-91c3-debf2dd04129', '89b7d024-1f07-4288-9c89-ca556931ff78', '7c8374e4-1d7a-45a8-9e34-c8fb7d029ab4'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:43:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f73eece9-72ec-4688-86da-6b88d1981909 tempest-CreateVolumesFromSnapshotTest-88895777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f73eece9-72ec-4688-86da-6b88d1981909 tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-f73eece9-72ec-4688-86da-6b88d1981909 tempest-CreateVolumesFromSnapshotTest-88895777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:43:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-f73eece9-72ec-4688-86da-6b88d1981909 tempest-CreateVolumesFromSnapshotTest-88895777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:43:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f73eece9-72ec-4688-86da-6b88d1981909 tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f73eece9-72ec-4688-86da-6b88d1981909 tempest-CreateVolumesFromSnapshotTest-88895777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:06 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:43:06 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:07 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f73eece9-72ec-4688-86da-6b88d1981909 tempest-CreateVolumesFromSnapshotTest-88895777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.647s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:07 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-f73eece9-72ec-4688-86da-6b88d1981909 tempest-CreateVolumesFromSnapshotTest-88895777 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:43:07 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-f73eece9-72ec-4688-86da-6b88d1981909 tempest-CreateVolumesFromSnapshotTest-88895777 None] Deleted volume successfully. Jul 11 04:43:07 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f73eece9-72ec-4688-86da-6b88d1981909 tempest-CreateVolumesFromSnapshotTest-88895777 None] Lock "cinder-791bb6df-02f2-4b13-ab04-79134ca57beb-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:43:09 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f1a5faa-3e6f-464d-99b0-6b11cd9ec497 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:43:09 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1f1a5faa-3e6f-464d-99b0-6b11cd9ec497 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Flow 'volume_create_manager' (d233c41c-01ff-4188-b7ef-a4f8e5f7c86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:43:09 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1f1a5faa-3e6f-464d-99b0-6b11cd9ec497 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b746f41-866d-40f6-aab6-6d0d4c9ad9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:09 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1f1a5faa-3e6f-464d-99b0-6b11cd9ec497 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b746f41-866d-40f6-aab6-6d0d4c9ad9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-957592947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0712ec8-6afa-40a8-ace3-4a8a7550b4e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a035ea9836a4381b5ca274949ced4b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:43:10Z,use_quota=True,user_id='aee4d774fb574ac88bbdb0dc72cc1f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1f1a5faa-3e6f-464d-99b0-6b11cd9ec497 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (427cac6e-29df-4ff8-aa17-70ab04eeb701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1f1a5faa-3e6f-464d-99b0-6b11cd9ec497 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (427cac6e-29df-4ff8-aa17-70ab04eeb701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1f1a5faa-3e6f-464d-99b0-6b11cd9ec497 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9658e9d9-b504-4a6a-9da6-b63e16f7872b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1f1a5faa-3e6f-464d-99b0-6b11cd9ec497 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9658e9d9-b504-4a6a-9da6-b63e16f7872b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0712ec8-6afa-40a8-ace3-4a8a7550b4e6', 'volume_name': 'volume-d0712ec8-6afa-40a8-ace3-4a8a7550b4e6', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1f1a5faa-3e6f-464d-99b0-6b11cd9ec497 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea5accb6-1d54-4c86-a544-8ed606071180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1f1a5faa-3e6f-464d-99b0-6b11cd9ec497 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea5accb6-1d54-4c86-a544-8ed606071180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1f1a5faa-3e6f-464d-99b0-6b11cd9ec497 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dd23207-9d3c-4cca-9cda-a25fae6f5eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:10 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-1f1a5faa-3e6f-464d-99b0-6b11cd9ec497 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Volume d0712ec8-6afa-40a8-ace3-4a8a7550b4e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0712ec8-6afa-40a8-ace3-4a8a7550b4e6', 'volume_size': 1} Jul 11 04:43:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1f1a5faa-3e6f-464d-99b0-6b11cd9ec497 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1f1a5faa-3e6f-464d-99b0-6b11cd9ec497 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:10 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-1f1a5faa-3e6f-464d-99b0-6b11cd9ec497 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-957592947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0712ec8-6afa-40a8-ace3-4a8a7550b4e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a035ea9836a4381b5ca274949ced4b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:43:10Z,use_quota=True,user_id='aee4d774fb574ac88bbdb0dc72cc1f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:43:10 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-1f1a5faa-3e6f-464d-99b0-6b11cd9ec497 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Creating volume d0712ec8-6afa-40a8-ace3-4a8a7550b4e6 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:43:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1f1a5faa-3e6f-464d-99b0-6b11cd9ec497 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1f1a5faa-3e6f-464d-99b0-6b11cd9ec497 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:10 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-1f1a5faa-3e6f-464d-99b0-6b11cd9ec497 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:43:10 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-1f1a5faa-3e6f-464d-99b0-6b11cd9ec497 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:43:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1f1a5faa-3e6f-464d-99b0-6b11cd9ec497 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:10 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-1f1a5faa-3e6f-464d-99b0-6b11cd9ec497 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:43:10 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-1f1a5faa-3e6f-464d-99b0-6b11cd9ec497 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:43:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1f1a5faa-3e6f-464d-99b0-6b11cd9ec497 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d0712ec8-6afa-40a8-ace3-4a8a7550b4e6 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:10 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d0712ec8-6afa-40a8-ace3-4a8a7550b4e6 1073741824 Jul 11 04:43:10 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:10 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1f1a5faa-3e6f-464d-99b0-6b11cd9ec497 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d0712ec8-6afa-40a8-ace3-4a8a7550b4e6 1073741824" returned: 0 in 0.904s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1f1a5faa-3e6f-464d-99b0-6b11cd9ec497 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d0712ec8-6afa-40a8-ace3-4a8a7550b4e6 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:11 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d0712ec8-6afa-40a8-ace3-4a8a7550b4e6 Jul 11 04:43:11 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:11 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1f1a5faa-3e6f-464d-99b0-6b11cd9ec497 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d0712ec8-6afa-40a8-ace3-4a8a7550b4e6" returned: 0 in 0.691s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:11 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-1f1a5faa-3e6f-464d-99b0-6b11cd9ec497 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] <== create_volume: return (1669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:43:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1f1a5faa-3e6f-464d-99b0-6b11cd9ec497 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:11 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1f1a5faa-3e6f-464d-99b0-6b11cd9ec497 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dd23207-9d3c-4cca-9cda-a25fae6f5eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0712ec8-6afa-40a8-ace3-4a8a7550b4e6', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:11 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1f1a5faa-3e6f-464d-99b0-6b11cd9ec497 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c847b453-7b8a-4855-a5af-95ecfe0d1799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:11 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-1f1a5faa-3e6f-464d-99b0-6b11cd9ec497 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Volume volume-d0712ec8-6afa-40a8-ace3-4a8a7550b4e6 (d0712ec8-6afa-40a8-ace3-4a8a7550b4e6): created successfully Jul 11 04:43:11 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1f1a5faa-3e6f-464d-99b0-6b11cd9ec497 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c847b453-7b8a-4855-a5af-95ecfe0d1799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:11 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1f1a5faa-3e6f-464d-99b0-6b11cd9ec497 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Flow 'volume_create_manager' (d233c41c-01ff-4188-b7ef-a4f8e5f7c86c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:43:11 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-1f1a5faa-3e6f-464d-99b0-6b11cd9ec497 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Created volume successfully. Jul 11 04:43:12 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-677a120b-6064-4e0e-84d5-393819a37f86 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:43:12 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-677a120b-6064-4e0e-84d5-393819a37f86 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Flow 'volume_create_manager' (20ebd7a3-52af-47e4-98eb-aa064cebf985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:43:12 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-677a120b-6064-4e0e-84d5-393819a37f86 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5b79e6a-4dd1-436d-9b90-fd28ef07d915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:12 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-677a120b-6064-4e0e-84d5-393819a37f86 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5b79e6a-4dd1-436d-9b90-fd28ef07d915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-546136399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9829cc69-0e52-453e-b349-23ae876d4b18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a035ea9836a4381b5ca274949ced4b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:43:12Z,use_quota=True,user_id='aee4d774fb574ac88bbdb0dc72cc1f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:12 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-677a120b-6064-4e0e-84d5-393819a37f86 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa61938-22d6-40c5-b54d-ef90149714fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:12 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-677a120b-6064-4e0e-84d5-393819a37f86 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa61938-22d6-40c5-b54d-ef90149714fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:12 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-677a120b-6064-4e0e-84d5-393819a37f86 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1358b694-099f-4794-95b1-291cf91aeacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:12 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-677a120b-6064-4e0e-84d5-393819a37f86 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1358b694-099f-4794-95b1-291cf91aeacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9829cc69-0e52-453e-b349-23ae876d4b18', 'volume_name': 'volume-9829cc69-0e52-453e-b349-23ae876d4b18', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:12 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-677a120b-6064-4e0e-84d5-393819a37f86 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d150c85-2baa-44d6-ae75-80969ab6b71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:12 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-677a120b-6064-4e0e-84d5-393819a37f86 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d150c85-2baa-44d6-ae75-80969ab6b71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:12 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-677a120b-6064-4e0e-84d5-393819a37f86 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70c8178-5d4e-4722-9894-78db178789c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:12 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-677a120b-6064-4e0e-84d5-393819a37f86 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Volume 9829cc69-0e52-453e-b349-23ae876d4b18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9829cc69-0e52-453e-b349-23ae876d4b18', 'volume_size': 1} Jul 11 04:43:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-677a120b-6064-4e0e-84d5-393819a37f86 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-677a120b-6064-4e0e-84d5-393819a37f86 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:12 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-677a120b-6064-4e0e-84d5-393819a37f86 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-546136399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9829cc69-0e52-453e-b349-23ae876d4b18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a035ea9836a4381b5ca274949ced4b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:43:12Z,use_quota=True,user_id='aee4d774fb574ac88bbdb0dc72cc1f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:43:12 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-677a120b-6064-4e0e-84d5-393819a37f86 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Creating volume 9829cc69-0e52-453e-b349-23ae876d4b18 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:43:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-677a120b-6064-4e0e-84d5-393819a37f86 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-677a120b-6064-4e0e-84d5-393819a37f86 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:12 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-677a120b-6064-4e0e-84d5-393819a37f86 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:43:12 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-677a120b-6064-4e0e-84d5-393819a37f86 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:43:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-677a120b-6064-4e0e-84d5-393819a37f86 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:12 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-677a120b-6064-4e0e-84d5-393819a37f86 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:43:12 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-677a120b-6064-4e0e-84d5-393819a37f86 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:43:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-677a120b-6064-4e0e-84d5-393819a37f86 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9829cc69-0e52-453e-b349-23ae876d4b18 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:12 devstack sudo[105315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9829cc69-0e52-453e-b349-23ae876d4b18 1073741824 Jul 11 04:43:12 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:13 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a70b8c0-afa7-4707-bc9e-600e05728cbc tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:43:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3a70b8c0-afa7-4707-bc9e-600e05728cbc tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Flow 'volume_create_manager' (492bfa8c-e4c0-4455-9614-9624549e537a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:43:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3a70b8c0-afa7-4707-bc9e-600e05728cbc tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a7a99ac-e957-4589-b786-92e77b4a1067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3a70b8c0-afa7-4707-bc9e-600e05728cbc tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a7a99ac-e957-4589-b786-92e77b4a1067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2043348817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=588a40fb-b11d-4415-a846-c2c052560ef8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a035ea9836a4381b5ca274949ced4b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:43:13Z,use_quota=True,user_id='aee4d774fb574ac88bbdb0dc72cc1f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3a70b8c0-afa7-4707-bc9e-600e05728cbc tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b81fb29d-a57b-4738-94a6-c27ce0b885ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3a70b8c0-afa7-4707-bc9e-600e05728cbc tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b81fb29d-a57b-4738-94a6-c27ce0b885ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3a70b8c0-afa7-4707-bc9e-600e05728cbc tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0e6e9fb-f936-4a17-80f5-d95bdc8a853d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3a70b8c0-afa7-4707-bc9e-600e05728cbc tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0e6e9fb-f936-4a17-80f5-d95bdc8a853d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '588a40fb-b11d-4415-a846-c2c052560ef8', 'volume_name': 'volume-588a40fb-b11d-4415-a846-c2c052560ef8', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3a70b8c0-afa7-4707-bc9e-600e05728cbc tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2efc825-69ec-43db-b520-573555b06f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3a70b8c0-afa7-4707-bc9e-600e05728cbc tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2efc825-69ec-43db-b520-573555b06f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3a70b8c0-afa7-4707-bc9e-600e05728cbc tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f2f717f-eaaf-4929-b356-b14bb93a4b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:13 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-3a70b8c0-afa7-4707-bc9e-600e05728cbc tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Volume 588a40fb-b11d-4415-a846-c2c052560ef8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-588a40fb-b11d-4415-a846-c2c052560ef8', 'volume_size': 1} Jul 11 04:43:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3a70b8c0-afa7-4707-bc9e-600e05728cbc tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:13 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-07668b97-1373-4366-83e2-a1a5285beff4 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:43:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-07668b97-1373-4366-83e2-a1a5285beff4 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Flow 'volume_create_manager' (a505a32e-ba4c-4530-a860-754d8f377984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:43:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-07668b97-1373-4366-83e2-a1a5285beff4 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf6c86c-77be-4ad2-ac1f-ee5234305693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-07668b97-1373-4366-83e2-a1a5285beff4 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf6c86c-77be-4ad2-ac1f-ee5234305693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1595534398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f72656db-7f33-4f77-b7af-9268a3263d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a035ea9836a4381b5ca274949ced4b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:43:13Z,use_quota=True,user_id='aee4d774fb574ac88bbdb0dc72cc1f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-07668b97-1373-4366-83e2-a1a5285beff4 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f4545e0-f114-43c4-ba1b-58b3bec4d177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-07668b97-1373-4366-83e2-a1a5285beff4 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f4545e0-f114-43c4-ba1b-58b3bec4d177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-07668b97-1373-4366-83e2-a1a5285beff4 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fafa331e-b981-49d6-a83c-1debaa1b1d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-07668b97-1373-4366-83e2-a1a5285beff4 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fafa331e-b981-49d6-a83c-1debaa1b1d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f72656db-7f33-4f77-b7af-9268a3263d07', 'volume_name': 'volume-f72656db-7f33-4f77-b7af-9268a3263d07', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-07668b97-1373-4366-83e2-a1a5285beff4 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9da4a635-6982-4e74-8af1-f5e0faf61ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-07668b97-1373-4366-83e2-a1a5285beff4 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9da4a635-6982-4e74-8af1-f5e0faf61ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-07668b97-1373-4366-83e2-a1a5285beff4 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34df562d-9a0e-47ac-876c-2e1158e41f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:13 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-07668b97-1373-4366-83e2-a1a5285beff4 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Volume f72656db-7f33-4f77-b7af-9268a3263d07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f72656db-7f33-4f77-b7af-9268a3263d07', 'volume_size': 1} Jul 11 04:43:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-07668b97-1373-4366-83e2-a1a5285beff4 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:13 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:13 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a7aae65-0793-4da8-94eb-13f03c67e6c9 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:43:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1a7aae65-0793-4da8-94eb-13f03c67e6c9 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Flow 'volume_create_manager' (bf5f3137-0daf-4de4-bd19-53b1e40c929c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:43:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1a7aae65-0793-4da8-94eb-13f03c67e6c9 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7e433c6-6828-436f-80ba-e4dd80bdf29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-677a120b-6064-4e0e-84d5-393819a37f86 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9829cc69-0e52-453e-b349-23ae876d4b18 1073741824" returned: 0 in 1.123s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1a7aae65-0793-4da8-94eb-13f03c67e6c9 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7e433c6-6828-436f-80ba-e4dd80bdf29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-432529378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=323590fe-e607-469a-a323-5e79be56e236,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a035ea9836a4381b5ca274949ced4b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:43:14Z,use_quota=True,user_id='aee4d774fb574ac88bbdb0dc72cc1f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1a7aae65-0793-4da8-94eb-13f03c67e6c9 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3db11a02-2d76-4153-9935-7f98d713beb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1a7aae65-0793-4da8-94eb-13f03c67e6c9 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3db11a02-2d76-4153-9935-7f98d713beb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1a7aae65-0793-4da8-94eb-13f03c67e6c9 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1475086-a88e-4ba6-9ce2-39cc3bad8413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1a7aae65-0793-4da8-94eb-13f03c67e6c9 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1475086-a88e-4ba6-9ce2-39cc3bad8413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '323590fe-e607-469a-a323-5e79be56e236', 'volume_name': 'volume-323590fe-e607-469a-a323-5e79be56e236', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1a7aae65-0793-4da8-94eb-13f03c67e6c9 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0760440-ed95-4636-b267-0f23e593f328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1a7aae65-0793-4da8-94eb-13f03c67e6c9 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0760440-ed95-4636-b267-0f23e593f328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1a7aae65-0793-4da8-94eb-13f03c67e6c9 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b51cc9e1-063e-422d-994b-78442123471f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:13 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-1a7aae65-0793-4da8-94eb-13f03c67e6c9 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Volume 323590fe-e607-469a-a323-5e79be56e236: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-323590fe-e607-469a-a323-5e79be56e236', 'volume_size': 1} Jul 11 04:43:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1a7aae65-0793-4da8-94eb-13f03c67e6c9 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-677a120b-6064-4e0e-84d5-393819a37f86 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9829cc69-0e52-453e-b349-23ae876d4b18 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:13 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9829cc69-0e52-453e-b349-23ae876d4b18 Jul 11 04:43:13 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:14 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ce30a05-1e79-4b89-ba96-e7308a605251 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:43:14 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6ce30a05-1e79-4b89-ba96-e7308a605251 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Flow 'volume_create_manager' (89eea797-e1fb-4928-a486-d262d5f6ffad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:43:14 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6ce30a05-1e79-4b89-ba96-e7308a605251 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d69c2f91-4c79-4835-aace-cec93bfef7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:14 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6ce30a05-1e79-4b89-ba96-e7308a605251 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d69c2f91-4c79-4835-aace-cec93bfef7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-11709143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa616bfb-c211-4857-a69f-b7b8f948e8b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a035ea9836a4381b5ca274949ced4b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:43:14Z,use_quota=True,user_id='aee4d774fb574ac88bbdb0dc72cc1f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:14 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6ce30a05-1e79-4b89-ba96-e7308a605251 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39937ae6-5f6d-4680-abf1-5ed0135aaf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:14 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6ce30a05-1e79-4b89-ba96-e7308a605251 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39937ae6-5f6d-4680-abf1-5ed0135aaf16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:14 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6ce30a05-1e79-4b89-ba96-e7308a605251 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02eeb0c2-c56a-49ac-a3b9-375fcb0827c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:14 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6ce30a05-1e79-4b89-ba96-e7308a605251 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02eeb0c2-c56a-49ac-a3b9-375fcb0827c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa616bfb-c211-4857-a69f-b7b8f948e8b7', 'volume_name': 'volume-aa616bfb-c211-4857-a69f-b7b8f948e8b7', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:14 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6ce30a05-1e79-4b89-ba96-e7308a605251 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bce37769-647e-4bcf-9118-4833e0cd8345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:14 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6ce30a05-1e79-4b89-ba96-e7308a605251 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bce37769-647e-4bcf-9118-4833e0cd8345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:14 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6ce30a05-1e79-4b89-ba96-e7308a605251 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98f296db-a413-43cb-b517-e16749ed4f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:14 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-6ce30a05-1e79-4b89-ba96-e7308a605251 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Volume aa616bfb-c211-4857-a69f-b7b8f948e8b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa616bfb-c211-4857-a69f-b7b8f948e8b7', 'volume_size': 1} Jul 11 04:43:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6ce30a05-1e79-4b89-ba96-e7308a605251 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:14 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-677a120b-6064-4e0e-84d5-393819a37f86 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9829cc69-0e52-453e-b349-23ae876d4b18" returned: 0 in 0.690s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:14 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-677a120b-6064-4e0e-84d5-393819a37f86 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] <== create_volume: return (1903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:43:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-677a120b-6064-4e0e-84d5-393819a37f86 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.909s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3a70b8c0-afa7-4707-bc9e-600e05728cbc tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.457s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:14 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-3a70b8c0-afa7-4707-bc9e-600e05728cbc tempest-CreateVolumesFromSourceVolumeTest-56715922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2043348817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=588a40fb-b11d-4415-a846-c2c052560ef8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a035ea9836a4381b5ca274949ced4b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:43:13Z,use_quota=True,user_id='aee4d774fb574ac88bbdb0dc72cc1f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:43:14 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-3a70b8c0-afa7-4707-bc9e-600e05728cbc tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Creating volume 588a40fb-b11d-4415-a846-c2c052560ef8 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:43:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3a70b8c0-afa7-4707-bc9e-600e05728cbc tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3a70b8c0-afa7-4707-bc9e-600e05728cbc tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:14 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-3a70b8c0-afa7-4707-bc9e-600e05728cbc tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:43:14 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-3a70b8c0-afa7-4707-bc9e-600e05728cbc tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:43:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3a70b8c0-afa7-4707-bc9e-600e05728cbc tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:14 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-3a70b8c0-afa7-4707-bc9e-600e05728cbc tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:43:14 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-3a70b8c0-afa7-4707-bc9e-600e05728cbc tempest-CreateVolumesFromSourceVolumeTest-56715922 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:43:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3a70b8c0-afa7-4707-bc9e-600e05728cbc tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-588a40fb-b11d-4415-a846-c2c052560ef8 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:14 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-677a120b-6064-4e0e-84d5-393819a37f86 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70c8178-5d4e-4722-9894-78db178789c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9829cc69-0e52-453e-b349-23ae876d4b18', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:14 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-677a120b-6064-4e0e-84d5-393819a37f86 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c37878ff-d6a3-406f-9ff0-45e6e74f40fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:14 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-588a40fb-b11d-4415-a846-c2c052560ef8 1073741824 Jul 11 04:43:14 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:14 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-677a120b-6064-4e0e-84d5-393819a37f86 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Volume volume-9829cc69-0e52-453e-b349-23ae876d4b18 (9829cc69-0e52-453e-b349-23ae876d4b18): created successfully Jul 11 04:43:14 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-677a120b-6064-4e0e-84d5-393819a37f86 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c37878ff-d6a3-406f-9ff0-45e6e74f40fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:14 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-677a120b-6064-4e0e-84d5-393819a37f86 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Flow 'volume_create_manager' (20ebd7a3-52af-47e4-98eb-aa064cebf985) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:43:14 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-677a120b-6064-4e0e-84d5-393819a37f86 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Created volume successfully. Jul 11 04:43:15 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3a70b8c0-afa7-4707-bc9e-600e05728cbc tempest-CreateVolumesFromSourceVolumeTest-56715922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-588a40fb-b11d-4415-a846-c2c052560ef8 1073741824" returned: 0 in 0.949s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3a70b8c0-afa7-4707-bc9e-600e05728cbc tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-588a40fb-b11d-4415-a846-c2c052560ef8 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:15 devstack sudo[105331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-588a40fb-b11d-4415-a846-c2c052560ef8 Jul 11 04:43:15 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:16 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3a70b8c0-afa7-4707-bc9e-600e05728cbc tempest-CreateVolumesFromSourceVolumeTest-56715922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-588a40fb-b11d-4415-a846-c2c052560ef8" returned: 0 in 0.693s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:16 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-3a70b8c0-afa7-4707-bc9e-600e05728cbc tempest-CreateVolumesFromSourceVolumeTest-56715922 None] <== create_volume: return (1697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:43:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3a70b8c0-afa7-4707-bc9e-600e05728cbc tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.699s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-07668b97-1373-4366-83e2-a1a5285beff4 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.805s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:16 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-07668b97-1373-4366-83e2-a1a5285beff4 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1595534398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f72656db-7f33-4f77-b7af-9268a3263d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a035ea9836a4381b5ca274949ced4b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:43:13Z,use_quota=True,user_id='aee4d774fb574ac88bbdb0dc72cc1f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:43:16 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-07668b97-1373-4366-83e2-a1a5285beff4 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Creating volume f72656db-7f33-4f77-b7af-9268a3263d07 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:43:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-07668b97-1373-4366-83e2-a1a5285beff4 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-07668b97-1373-4366-83e2-a1a5285beff4 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:16 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-07668b97-1373-4366-83e2-a1a5285beff4 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:43:16 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-07668b97-1373-4366-83e2-a1a5285beff4 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:43:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-07668b97-1373-4366-83e2-a1a5285beff4 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:16 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-07668b97-1373-4366-83e2-a1a5285beff4 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:43:16 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-07668b97-1373-4366-83e2-a1a5285beff4 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:43:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-07668b97-1373-4366-83e2-a1a5285beff4 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f72656db-7f33-4f77-b7af-9268a3263d07 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:16 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3a70b8c0-afa7-4707-bc9e-600e05728cbc tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f2f717f-eaaf-4929-b356-b14bb93a4b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-588a40fb-b11d-4415-a846-c2c052560ef8', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:16 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3a70b8c0-afa7-4707-bc9e-600e05728cbc tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab502a7-8304-4884-990a-107edf8dbbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:16 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f72656db-7f33-4f77-b7af-9268a3263d07 1073741824 Jul 11 04:43:16 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:16 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-3a70b8c0-afa7-4707-bc9e-600e05728cbc tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Volume volume-588a40fb-b11d-4415-a846-c2c052560ef8 (588a40fb-b11d-4415-a846-c2c052560ef8): created successfully Jul 11 04:43:16 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3a70b8c0-afa7-4707-bc9e-600e05728cbc tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab502a7-8304-4884-990a-107edf8dbbf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:16 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3a70b8c0-afa7-4707-bc9e-600e05728cbc tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Flow 'volume_create_manager' (492bfa8c-e4c0-4455-9614-9624549e537a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:43:16 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-3a70b8c0-afa7-4707-bc9e-600e05728cbc tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Created volume successfully. Jul 11 04:43:17 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-07668b97-1373-4366-83e2-a1a5285beff4 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f72656db-7f33-4f77-b7af-9268a3263d07 1073741824" returned: 0 in 0.883s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-07668b97-1373-4366-83e2-a1a5285beff4 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f72656db-7f33-4f77-b7af-9268a3263d07 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:17 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f72656db-7f33-4f77-b7af-9268a3263d07 Jul 11 04:43:17 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:17 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-07668b97-1373-4366-83e2-a1a5285beff4 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f72656db-7f33-4f77-b7af-9268a3263d07" returned: 0 in 0.695s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:17 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-07668b97-1373-4366-83e2-a1a5285beff4 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] <== create_volume: return (1621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:43:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-07668b97-1373-4366-83e2-a1a5285beff4 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.625s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1a7aae65-0793-4da8-94eb-13f03c67e6c9 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.052s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:17 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-1a7aae65-0793-4da8-94eb-13f03c67e6c9 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-432529378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=323590fe-e607-469a-a323-5e79be56e236,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a035ea9836a4381b5ca274949ced4b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:43:14Z,use_quota=True,user_id='aee4d774fb574ac88bbdb0dc72cc1f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:43:17 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-1a7aae65-0793-4da8-94eb-13f03c67e6c9 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Creating volume 323590fe-e607-469a-a323-5e79be56e236 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:43:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1a7aae65-0793-4da8-94eb-13f03c67e6c9 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1a7aae65-0793-4da8-94eb-13f03c67e6c9 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:17 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-1a7aae65-0793-4da8-94eb-13f03c67e6c9 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:43:17 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-1a7aae65-0793-4da8-94eb-13f03c67e6c9 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:43:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1a7aae65-0793-4da8-94eb-13f03c67e6c9 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:17 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-1a7aae65-0793-4da8-94eb-13f03c67e6c9 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:43:17 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-1a7aae65-0793-4da8-94eb-13f03c67e6c9 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:43:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1a7aae65-0793-4da8-94eb-13f03c67e6c9 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-323590fe-e607-469a-a323-5e79be56e236 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:17 devstack sudo[105346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-323590fe-e607-469a-a323-5e79be56e236 1073741824 Jul 11 04:43:17 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:17 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-07668b97-1373-4366-83e2-a1a5285beff4 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34df562d-9a0e-47ac-876c-2e1158e41f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f72656db-7f33-4f77-b7af-9268a3263d07', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:17 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-07668b97-1373-4366-83e2-a1a5285beff4 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50b2d8ba-5dcb-4720-89ae-1b07ddf34afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:17 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-07668b97-1373-4366-83e2-a1a5285beff4 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Volume volume-f72656db-7f33-4f77-b7af-9268a3263d07 (f72656db-7f33-4f77-b7af-9268a3263d07): created successfully Jul 11 04:43:17 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-07668b97-1373-4366-83e2-a1a5285beff4 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50b2d8ba-5dcb-4720-89ae-1b07ddf34afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:17 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-07668b97-1373-4366-83e2-a1a5285beff4 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Flow 'volume_create_manager' (a505a32e-ba4c-4530-a860-754d8f377984) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:43:18 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-07668b97-1373-4366-83e2-a1a5285beff4 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Created volume successfully. Jul 11 04:43:18 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1a7aae65-0793-4da8-94eb-13f03c67e6c9 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-323590fe-e607-469a-a323-5e79be56e236 1073741824" returned: 0 in 0.907s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1a7aae65-0793-4da8-94eb-13f03c67e6c9 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-323590fe-e607-469a-a323-5e79be56e236 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:18 devstack sudo[105352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-323590fe-e607-469a-a323-5e79be56e236 Jul 11 04:43:18 devstack sudo[105352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fbd8507-a891-47c7-a1a9-24fe76014cd6 tempest-CreateVolumesFromImageTest-251776532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5fbd8507-a891-47c7-a1a9-24fe76014cd6 tempest-CreateVolumesFromImageTest-251776532 None] Flow 'volume_create_manager' (7f70adfb-e7d9-40f5-be26-7d979e5a99f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5fbd8507-a891-47c7-a1a9-24fe76014cd6 tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (415fda17-1040-4fb3-a1b5-7275c57cb1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5fbd8507-a891-47c7-a1a9-24fe76014cd6 tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (415fda17-1040-4fb3-a1b5-7275c57cb1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1644455433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a145a59f-d46b-4347-9c8f-a6b6ca9bb687,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cfc42bc409743968d26d7d873da7f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:43:19Z,use_quota=True,user_id='2c66fea970d24609871dd8b06cbdaadf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5fbd8507-a891-47c7-a1a9-24fe76014cd6 tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b00c8b41-e2bb-4108-9135-8e0e7ecf45c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5fbd8507-a891-47c7-a1a9-24fe76014cd6 tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b00c8b41-e2bb-4108-9135-8e0e7ecf45c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5fbd8507-a891-47c7-a1a9-24fe76014cd6 tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9760f0b1-d5cf-4c7d-aac0-d3263aade574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5fbd8507-a891-47c7-a1a9-24fe76014cd6 tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9760f0b1-d5cf-4c7d-aac0-d3263aade574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a145a59f-d46b-4347-9c8f-a6b6ca9bb687', 'volume_name': 'volume-a145a59f-d46b-4347-9c8f-a6b6ca9bb687', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5fbd8507-a891-47c7-a1a9-24fe76014cd6 tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7feee50b-2724-4d67-86cc-cf644f7064c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5fbd8507-a891-47c7-a1a9-24fe76014cd6 tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7feee50b-2724-4d67-86cc-cf644f7064c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5fbd8507-a891-47c7-a1a9-24fe76014cd6 tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8eb5a99-5f07-43e6-9f9b-0e2714813daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:19 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-5fbd8507-a891-47c7-a1a9-24fe76014cd6 tempest-CreateVolumesFromImageTest-251776532 None] Volume a145a59f-d46b-4347-9c8f-a6b6ca9bb687: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a145a59f-d46b-4347-9c8f-a6b6ca9bb687', 'volume_size': 1} Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5fbd8507-a891-47c7-a1a9-24fe76014cd6 tempest-CreateVolumesFromImageTest-251776532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:19 devstack sudo[105352]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1a7aae65-0793-4da8-94eb-13f03c67e6c9 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-323590fe-e607-469a-a323-5e79be56e236" returned: 0 in 0.674s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-1a7aae65-0793-4da8-94eb-13f03c67e6c9 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1a7aae65-0793-4da8-94eb-13f03c67e6c9 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6ce30a05-1e79-4b89-ba96-e7308a605251 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.082s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6ce30a05-1e79-4b89-ba96-e7308a605251 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-11709143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa616bfb-c211-4857-a69f-b7b8f948e8b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a035ea9836a4381b5ca274949ced4b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:43:14Z,use_quota=True,user_id='aee4d774fb574ac88bbdb0dc72cc1f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-6ce30a05-1e79-4b89-ba96-e7308a605251 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Creating volume aa616bfb-c211-4857-a69f-b7b8f948e8b7 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6ce30a05-1e79-4b89-ba96-e7308a605251 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6ce30a05-1e79-4b89-ba96-e7308a605251 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6ce30a05-1e79-4b89-ba96-e7308a605251 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6ce30a05-1e79-4b89-ba96-e7308a605251 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6ce30a05-1e79-4b89-ba96-e7308a605251 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6ce30a05-1e79-4b89-ba96-e7308a605251 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:43:19 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-6ce30a05-1e79-4b89-ba96-e7308a605251 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6ce30a05-1e79-4b89-ba96-e7308a605251 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-aa616bfb-c211-4857-a69f-b7b8f948e8b7 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:19 devstack sudo[105355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-aa616bfb-c211-4857-a69f-b7b8f948e8b7 1073741824 Jul 11 04:43:19 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1a7aae65-0793-4da8-94eb-13f03c67e6c9 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b51cc9e1-063e-422d-994b-78442123471f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-323590fe-e607-469a-a323-5e79be56e236', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1a7aae65-0793-4da8-94eb-13f03c67e6c9 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (420e5c71-6853-4417-b41b-0c83dbf59427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:19 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-1a7aae65-0793-4da8-94eb-13f03c67e6c9 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Volume volume-323590fe-e607-469a-a323-5e79be56e236 (323590fe-e607-469a-a323-5e79be56e236): created successfully Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1a7aae65-0793-4da8-94eb-13f03c67e6c9 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (420e5c71-6853-4417-b41b-0c83dbf59427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-1a7aae65-0793-4da8-94eb-13f03c67e6c9 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Flow 'volume_create_manager' (bf5f3137-0daf-4de4-bd19-53b1e40c929c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:43:19 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-1a7aae65-0793-4da8-94eb-13f03c67e6c9 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Created volume successfully. Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-baa31912-ecfc-448a-8f7a-85bfd0b23dab tempest-CreateVolumesFromImageTest-251776532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-baa31912-ecfc-448a-8f7a-85bfd0b23dab tempest-CreateVolumesFromImageTest-251776532 None] Flow 'volume_create_manager' (267cd32c-c9eb-404c-a49e-e69a587fc23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-baa31912-ecfc-448a-8f7a-85bfd0b23dab tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19c28a49-f96b-46e6-b7a9-a103bbbd06dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-baa31912-ecfc-448a-8f7a-85bfd0b23dab tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19c28a49-f96b-46e6-b7a9-a103bbbd06dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1957473445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9676df5-f999-463d-b149-9a1b9c996d00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cfc42bc409743968d26d7d873da7f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:43:20Z,use_quota=True,user_id='2c66fea970d24609871dd8b06cbdaadf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-baa31912-ecfc-448a-8f7a-85bfd0b23dab tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc6c642a-d8df-4427-b96d-9607bc1484f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-baa31912-ecfc-448a-8f7a-85bfd0b23dab tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc6c642a-d8df-4427-b96d-9607bc1484f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-baa31912-ecfc-448a-8f7a-85bfd0b23dab tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dd8489f-6568-4f2c-beb4-23250e0c3ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-baa31912-ecfc-448a-8f7a-85bfd0b23dab tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dd8489f-6568-4f2c-beb4-23250e0c3ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9676df5-f999-463d-b149-9a1b9c996d00', 'volume_name': 'volume-f9676df5-f999-463d-b149-9a1b9c996d00', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-baa31912-ecfc-448a-8f7a-85bfd0b23dab tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5492b612-cde9-4063-895a-6711ed7a49a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-baa31912-ecfc-448a-8f7a-85bfd0b23dab tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5492b612-cde9-4063-895a-6711ed7a49a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-baa31912-ecfc-448a-8f7a-85bfd0b23dab tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cdd7852-296e-4e4c-983f-9c2d7677e464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:19 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-baa31912-ecfc-448a-8f7a-85bfd0b23dab tempest-CreateVolumesFromImageTest-251776532 None] Volume f9676df5-f999-463d-b149-9a1b9c996d00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9676df5-f999-463d-b149-9a1b9c996d00', 'volume_size': 1} Jul 11 04:43:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-baa31912-ecfc-448a-8f7a-85bfd0b23dab tempest-CreateVolumesFromImageTest-251776532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:20 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f85f886-2ebf-4114-929d-957f0cd8df4d tempest-CreateVolumesFromImageTest-251776532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:43:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5f85f886-2ebf-4114-929d-957f0cd8df4d tempest-CreateVolumesFromImageTest-251776532 None] Flow 'volume_create_manager' (d6a391a9-1404-4709-988c-3c40c6269805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:43:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5f85f886-2ebf-4114-929d-957f0cd8df4d tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbb229f8-6b28-438b-99c3-09c960ee7e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5f85f886-2ebf-4114-929d-957f0cd8df4d tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbb229f8-6b28-438b-99c3-09c960ee7e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2073963394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e11c01f-ed7b-408a-ba51-e237facc733a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cfc42bc409743968d26d7d873da7f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:43:20Z,use_quota=True,user_id='2c66fea970d24609871dd8b06cbdaadf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5f85f886-2ebf-4114-929d-957f0cd8df4d tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adee36b3-50ca-45d1-80bf-fb9b196377c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5f85f886-2ebf-4114-929d-957f0cd8df4d tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adee36b3-50ca-45d1-80bf-fb9b196377c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5f85f886-2ebf-4114-929d-957f0cd8df4d tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (089329ec-c11c-4077-9596-9f84327170a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5f85f886-2ebf-4114-929d-957f0cd8df4d tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (089329ec-c11c-4077-9596-9f84327170a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e11c01f-ed7b-408a-ba51-e237facc733a', 'volume_name': 'volume-5e11c01f-ed7b-408a-ba51-e237facc733a', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5f85f886-2ebf-4114-929d-957f0cd8df4d tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fda2020f-3d62-485d-9a38-b1c8b558af4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5f85f886-2ebf-4114-929d-957f0cd8df4d tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fda2020f-3d62-485d-9a38-b1c8b558af4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5f85f886-2ebf-4114-929d-957f0cd8df4d tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a1ecf36-3e5e-494b-9bfa-0fab770c96fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:20 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-5f85f886-2ebf-4114-929d-957f0cd8df4d tempest-CreateVolumesFromImageTest-251776532 None] Volume 5e11c01f-ed7b-408a-ba51-e237facc733a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e11c01f-ed7b-408a-ba51-e237facc733a', 'volume_size': 1} Jul 11 04:43:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5f85f886-2ebf-4114-929d-957f0cd8df4d tempest-CreateVolumesFromImageTest-251776532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:20 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-b22757f5-e414-4b3d-9521-7bd692a470ec tempest-CreateVolumesFromImageTest-251776532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:43:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b22757f5-e414-4b3d-9521-7bd692a470ec tempest-CreateVolumesFromImageTest-251776532 None] Flow 'volume_create_manager' (c5695da2-724e-49fa-97b9-ec306693c7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:43:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b22757f5-e414-4b3d-9521-7bd692a470ec tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89582a83-7108-42db-a848-78f1f8d6e3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b22757f5-e414-4b3d-9521-7bd692a470ec tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89582a83-7108-42db-a848-78f1f8d6e3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-122309918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f691860e-8cf9-4ea7-91ae-e9fd8293d32c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cfc42bc409743968d26d7d873da7f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:43:20Z,use_quota=True,user_id='2c66fea970d24609871dd8b06cbdaadf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b22757f5-e414-4b3d-9521-7bd692a470ec tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68ecb93f-6194-4b74-9cc5-f42a9232f352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b22757f5-e414-4b3d-9521-7bd692a470ec tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68ecb93f-6194-4b74-9cc5-f42a9232f352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b22757f5-e414-4b3d-9521-7bd692a470ec tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2671618a-b5ee-4a3b-9c1b-7c1f8413aeb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b22757f5-e414-4b3d-9521-7bd692a470ec tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2671618a-b5ee-4a3b-9c1b-7c1f8413aeb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f691860e-8cf9-4ea7-91ae-e9fd8293d32c', 'volume_name': 'volume-f691860e-8cf9-4ea7-91ae-e9fd8293d32c', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b22757f5-e414-4b3d-9521-7bd692a470ec tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a735f11-b8c3-42dc-911f-a25d1665c4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b22757f5-e414-4b3d-9521-7bd692a470ec tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a735f11-b8c3-42dc-911f-a25d1665c4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b22757f5-e414-4b3d-9521-7bd692a470ec tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba896be8-0f7a-47b7-8a6a-1e6df8764f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:20 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-b22757f5-e414-4b3d-9521-7bd692a470ec tempest-CreateVolumesFromImageTest-251776532 None] Volume f691860e-8cf9-4ea7-91ae-e9fd8293d32c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f691860e-8cf9-4ea7-91ae-e9fd8293d32c', 'volume_size': 1} Jul 11 04:43:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b22757f5-e414-4b3d-9521-7bd692a470ec tempest-CreateVolumesFromImageTest-251776532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:20 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6ce30a05-1e79-4b89-ba96-e7308a605251 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-aa616bfb-c211-4857-a69f-b7b8f948e8b7 1073741824" returned: 0 in 1.011s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6ce30a05-1e79-4b89-ba96-e7308a605251 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-aa616bfb-c211-4857-a69f-b7b8f948e8b7 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:20 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-aa616bfb-c211-4857-a69f-b7b8f948e8b7 Jul 11 04:43:20 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:20 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-af73d318-ae08-4486-a286-430913833fbc tempest-CreateVolumesFromImageTest-251776532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:43:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-af73d318-ae08-4486-a286-430913833fbc tempest-CreateVolumesFromImageTest-251776532 None] Flow 'volume_create_manager' (77d2fdbb-d940-4d04-81f8-3481e58a6d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:43:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-af73d318-ae08-4486-a286-430913833fbc tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60ef0cf8-a79f-48dc-83f2-3c1c30d993e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-af73d318-ae08-4486-a286-430913833fbc tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60ef0cf8-a79f-48dc-83f2-3c1c30d993e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1699277588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5679ef9-283e-42af-9b12-43239349f694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cfc42bc409743968d26d7d873da7f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:43:21Z,use_quota=True,user_id='2c66fea970d24609871dd8b06cbdaadf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-af73d318-ae08-4486-a286-430913833fbc tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab0c5d68-ae6f-48db-a17f-f346ff9312d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-af73d318-ae08-4486-a286-430913833fbc tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab0c5d68-ae6f-48db-a17f-f346ff9312d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-af73d318-ae08-4486-a286-430913833fbc tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b681f51-7207-49ff-9ab9-307c52308a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-af73d318-ae08-4486-a286-430913833fbc tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b681f51-7207-49ff-9ab9-307c52308a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5679ef9-283e-42af-9b12-43239349f694', 'volume_name': 'volume-b5679ef9-283e-42af-9b12-43239349f694', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-af73d318-ae08-4486-a286-430913833fbc tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a32c7683-c2a0-42c5-ae9a-f652a4dea6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-af73d318-ae08-4486-a286-430913833fbc tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a32c7683-c2a0-42c5-ae9a-f652a4dea6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-af73d318-ae08-4486-a286-430913833fbc tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (147e3a21-1ec7-4459-bd48-e13708fe766a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:20 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-af73d318-ae08-4486-a286-430913833fbc tempest-CreateVolumesFromImageTest-251776532 None] Volume b5679ef9-283e-42af-9b12-43239349f694: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5679ef9-283e-42af-9b12-43239349f694', 'volume_size': 1} Jul 11 04:43:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-af73d318-ae08-4486-a286-430913833fbc tempest-CreateVolumesFromImageTest-251776532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:21 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6ce30a05-1e79-4b89-ba96-e7308a605251 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-aa616bfb-c211-4857-a69f-b7b8f948e8b7" returned: 0 in 0.651s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:21 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6ce30a05-1e79-4b89-ba96-e7308a605251 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] <== create_volume: return (1709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:43:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6ce30a05-1e79-4b89-ba96-e7308a605251 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5fbd8507-a891-47c7-a1a9-24fe76014cd6 tempest-CreateVolumesFromImageTest-251776532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.836s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:21 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-5fbd8507-a891-47c7-a1a9-24fe76014cd6 tempest-CreateVolumesFromImageTest-251776532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1644455433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a145a59f-d46b-4347-9c8f-a6b6ca9bb687,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cfc42bc409743968d26d7d873da7f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:43:19Z,use_quota=True,user_id='2c66fea970d24609871dd8b06cbdaadf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:43:21 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-5fbd8507-a891-47c7-a1a9-24fe76014cd6 tempest-CreateVolumesFromImageTest-251776532 None] Creating volume a145a59f-d46b-4347-9c8f-a6b6ca9bb687 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:43:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5fbd8507-a891-47c7-a1a9-24fe76014cd6 tempest-CreateVolumesFromImageTest-251776532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5fbd8507-a891-47c7-a1a9-24fe76014cd6 tempest-CreateVolumesFromImageTest-251776532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:21 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-5fbd8507-a891-47c7-a1a9-24fe76014cd6 tempest-CreateVolumesFromImageTest-251776532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:43:21 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-5fbd8507-a891-47c7-a1a9-24fe76014cd6 tempest-CreateVolumesFromImageTest-251776532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:43:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5fbd8507-a891-47c7-a1a9-24fe76014cd6 tempest-CreateVolumesFromImageTest-251776532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:21 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-5fbd8507-a891-47c7-a1a9-24fe76014cd6 tempest-CreateVolumesFromImageTest-251776532 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:43:21 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-5fbd8507-a891-47c7-a1a9-24fe76014cd6 tempest-CreateVolumesFromImageTest-251776532 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:43:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5fbd8507-a891-47c7-a1a9-24fe76014cd6 tempest-CreateVolumesFromImageTest-251776532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a145a59f-d46b-4347-9c8f-a6b6ca9bb687 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:21 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6ce30a05-1e79-4b89-ba96-e7308a605251 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98f296db-a413-43cb-b517-e16749ed4f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa616bfb-c211-4857-a69f-b7b8f948e8b7', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:21 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a145a59f-d46b-4347-9c8f-a6b6ca9bb687 1073741824 Jul 11 04:43:21 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6ce30a05-1e79-4b89-ba96-e7308a605251 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c79788cf-4014-4504-aef8-b8deec519966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:21 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:21 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-6ce30a05-1e79-4b89-ba96-e7308a605251 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Volume volume-aa616bfb-c211-4857-a69f-b7b8f948e8b7 (aa616bfb-c211-4857-a69f-b7b8f948e8b7): created successfully Jul 11 04:43:21 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6ce30a05-1e79-4b89-ba96-e7308a605251 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c79788cf-4014-4504-aef8-b8deec519966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:21 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-6ce30a05-1e79-4b89-ba96-e7308a605251 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Flow 'volume_create_manager' (89eea797-e1fb-4928-a486-d262d5f6ffad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:43:21 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-6ce30a05-1e79-4b89-ba96-e7308a605251 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Created volume successfully. Jul 11 04:43:22 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-567484e9-192c-4777-916c-f7c0dac8da38 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Acquiring lock "cinder-aa616bfb-c211-4857-a69f-b7b8f948e8b7-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:43:22 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-567484e9-192c-4777-916c-f7c0dac8da38 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "cinder-aa616bfb-c211-4857-a69f-b7b8f948e8b7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:43:22 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-567484e9-192c-4777-916c-f7c0dac8da38 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Acquiring lock "cinder-quobyte-aa616bfb-c211-4857-a69f-b7b8f948e8b7" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:43:22 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-567484e9-192c-4777-916c-f7c0dac8da38 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "cinder-quobyte-aa616bfb-c211-4857-a69f-b7b8f948e8b7" acquired by "delete_volume" :: waited 0.014s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:43:22 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[357f03af-62f4-4095-ab98-6249f9a1f9fe]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:43:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-567484e9-192c-4777-916c-f7c0dac8da38 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-aa616bfb-c211-4857-a69f-b7b8f948e8b7 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:22 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5fbd8507-a891-47c7-a1a9-24fe76014cd6 tempest-CreateVolumesFromImageTest-251776532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a145a59f-d46b-4347-9c8f-a6b6ca9bb687 1073741824" returned: 0 in 0.866s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5fbd8507-a891-47c7-a1a9-24fe76014cd6 tempest-CreateVolumesFromImageTest-251776532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a145a59f-d46b-4347-9c8f-a6b6ca9bb687 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:22 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a145a59f-d46b-4347-9c8f-a6b6ca9bb687 Jul 11 04:43:22 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:22 devstack sudo[105376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-aa616bfb-c211-4857-a69f-b7b8f948e8b7 Jul 11 04:43:22 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:22 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5fbd8507-a891-47c7-a1a9-24fe76014cd6 tempest-CreateVolumesFromImageTest-251776532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a145a59f-d46b-4347-9c8f-a6b6ca9bb687" returned: 0 in 0.655s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-5fbd8507-a891-47c7-a1a9-24fe76014cd6 tempest-CreateVolumesFromImageTest-251776532 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:43:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5fbd8507-a891-47c7-a1a9-24fe76014cd6 tempest-CreateVolumesFromImageTest-251776532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-baa31912-ecfc-448a-8f7a-85bfd0b23dab tempest-CreateVolumesFromImageTest-251776532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.035s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-baa31912-ecfc-448a-8f7a-85bfd0b23dab tempest-CreateVolumesFromImageTest-251776532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1957473445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9676df5-f999-463d-b149-9a1b9c996d00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cfc42bc409743968d26d7d873da7f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:43:20Z,use_quota=True,user_id='2c66fea970d24609871dd8b06cbdaadf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:43:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-baa31912-ecfc-448a-8f7a-85bfd0b23dab tempest-CreateVolumesFromImageTest-251776532 None] Creating volume f9676df5-f999-463d-b149-9a1b9c996d00 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:43:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-baa31912-ecfc-448a-8f7a-85bfd0b23dab tempest-CreateVolumesFromImageTest-251776532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-baa31912-ecfc-448a-8f7a-85bfd0b23dab tempest-CreateVolumesFromImageTest-251776532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-baa31912-ecfc-448a-8f7a-85bfd0b23dab tempest-CreateVolumesFromImageTest-251776532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:43:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-baa31912-ecfc-448a-8f7a-85bfd0b23dab tempest-CreateVolumesFromImageTest-251776532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:43:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-baa31912-ecfc-448a-8f7a-85bfd0b23dab tempest-CreateVolumesFromImageTest-251776532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-baa31912-ecfc-448a-8f7a-85bfd0b23dab tempest-CreateVolumesFromImageTest-251776532 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:43:22 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-baa31912-ecfc-448a-8f7a-85bfd0b23dab tempest-CreateVolumesFromImageTest-251776532 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:43:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-baa31912-ecfc-448a-8f7a-85bfd0b23dab tempest-CreateVolumesFromImageTest-251776532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f9676df5-f999-463d-b149-9a1b9c996d00 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:22 devstack sudo[105385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f9676df5-f999-463d-b149-9a1b9c996d00 1073741824 Jul 11 04:43:22 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:22 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5fbd8507-a891-47c7-a1a9-24fe76014cd6 tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8eb5a99-5f07-43e6-9f9b-0e2714813daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a145a59f-d46b-4347-9c8f-a6b6ca9bb687', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:22 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5fbd8507-a891-47c7-a1a9-24fe76014cd6 tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a16b8fa1-2f50-4999-b562-63968bf7dc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:22 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-567484e9-192c-4777-916c-f7c0dac8da38 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-aa616bfb-c211-4857-a69f-b7b8f948e8b7" returned: 0 in 0.781s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-567484e9-192c-4777-916c-f7c0dac8da38 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-aa616bfb-c211-4857-a69f-b7b8f948e8b7 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:22 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-5fbd8507-a891-47c7-a1a9-24fe76014cd6 tempest-CreateVolumesFromImageTest-251776532 None] Volume volume-a145a59f-d46b-4347-9c8f-a6b6ca9bb687 (a145a59f-d46b-4347-9c8f-a6b6ca9bb687): created successfully Jul 11 04:43:22 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5fbd8507-a891-47c7-a1a9-24fe76014cd6 tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a16b8fa1-2f50-4999-b562-63968bf7dc1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:22 devstack sudo[105387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-aa616bfb-c211-4857-a69f-b7b8f948e8b7 Jul 11 04:43:22 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:22 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5fbd8507-a891-47c7-a1a9-24fe76014cd6 tempest-CreateVolumesFromImageTest-251776532 None] Flow 'volume_create_manager' (7f70adfb-e7d9-40f5-be26-7d979e5a99f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:43:22 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-5fbd8507-a891-47c7-a1a9-24fe76014cd6 tempest-CreateVolumesFromImageTest-251776532 None] Created volume successfully. Jul 11 04:43:23 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-567484e9-192c-4777-916c-f7c0dac8da38 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-aa616bfb-c211-4857-a69f-b7b8f948e8b7" returned: 0 in 0.705s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:23 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-567484e9-192c-4777-916c-f7c0dac8da38 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "cinder-quobyte-aa616bfb-c211-4857-a69f-b7b8f948e8b7" released by "delete_volume" :: held 1.531s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:43:23 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-567484e9-192c-4777-916c-f7c0dac8da38 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Created reservations ['cbc4517e-623a-4b74-9846-86477605df1a', 'f929b0cd-1b49-416f-8bb7-6f1b3e63b977', '28483aff-dd74-4869-9863-e324942ba233', '4dedc5e5-8065-44be-8d11-a6e86099eb96'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:43:23 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-baa31912-ecfc-448a-8f7a-85bfd0b23dab tempest-CreateVolumesFromImageTest-251776532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f9676df5-f999-463d-b149-9a1b9c996d00 1073741824" returned: 0 in 0.845s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-baa31912-ecfc-448a-8f7a-85bfd0b23dab tempest-CreateVolumesFromImageTest-251776532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f9676df5-f999-463d-b149-9a1b9c996d00 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-567484e9-192c-4777-916c-f7c0dac8da38 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-567484e9-192c-4777-916c-f7c0dac8da38 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:23 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-567484e9-192c-4777-916c-f7c0dac8da38 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:43:23 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-567484e9-192c-4777-916c-f7c0dac8da38 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:43:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-567484e9-192c-4777-916c-f7c0dac8da38 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:23 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f9676df5-f999-463d-b149-9a1b9c996d00 Jul 11 04:43:23 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-567484e9-192c-4777-916c-f7c0dac8da38 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:23 devstack sudo[105395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:43:23 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:24 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f16da9b4-31f2-4f4c-b646-d11696414ca3 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Acquiring lock "cinder-323590fe-e607-469a-a323-5e79be56e236-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:43:24 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f16da9b4-31f2-4f4c-b646-d11696414ca3 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "cinder-323590fe-e607-469a-a323-5e79be56e236-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:43:24 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f16da9b4-31f2-4f4c-b646-d11696414ca3 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Acquiring lock "cinder-quobyte-323590fe-e607-469a-a323-5e79be56e236" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:43:24 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f16da9b4-31f2-4f4c-b646-d11696414ca3 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "cinder-quobyte-323590fe-e607-469a-a323-5e79be56e236" acquired by "delete_volume" :: waited 0.018s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:43:24 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-baa31912-ecfc-448a-8f7a-85bfd0b23dab tempest-CreateVolumesFromImageTest-251776532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f9676df5-f999-463d-b149-9a1b9c996d00" returned: 0 in 0.690s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:24 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-baa31912-ecfc-448a-8f7a-85bfd0b23dab tempest-CreateVolumesFromImageTest-251776532 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:43:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-baa31912-ecfc-448a-8f7a-85bfd0b23dab tempest-CreateVolumesFromImageTest-251776532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5f85f886-2ebf-4114-929d-957f0cd8df4d tempest-CreateVolumesFromImageTest-251776532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.235s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:24 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-5f85f886-2ebf-4114-929d-957f0cd8df4d tempest-CreateVolumesFromImageTest-251776532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2073963394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e11c01f-ed7b-408a-ba51-e237facc733a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cfc42bc409743968d26d7d873da7f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:43:20Z,use_quota=True,user_id='2c66fea970d24609871dd8b06cbdaadf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:43:24 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-5f85f886-2ebf-4114-929d-957f0cd8df4d tempest-CreateVolumesFromImageTest-251776532 None] Creating volume 5e11c01f-ed7b-408a-ba51-e237facc733a {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:43:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5f85f886-2ebf-4114-929d-957f0cd8df4d tempest-CreateVolumesFromImageTest-251776532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5f85f886-2ebf-4114-929d-957f0cd8df4d tempest-CreateVolumesFromImageTest-251776532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:24 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-5f85f886-2ebf-4114-929d-957f0cd8df4d tempest-CreateVolumesFromImageTest-251776532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:43:24 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-5f85f886-2ebf-4114-929d-957f0cd8df4d tempest-CreateVolumesFromImageTest-251776532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:43:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5f85f886-2ebf-4114-929d-957f0cd8df4d tempest-CreateVolumesFromImageTest-251776532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:24 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-5f85f886-2ebf-4114-929d-957f0cd8df4d tempest-CreateVolumesFromImageTest-251776532 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:43:24 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-5f85f886-2ebf-4114-929d-957f0cd8df4d tempest-CreateVolumesFromImageTest-251776532 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:43:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5f85f886-2ebf-4114-929d-957f0cd8df4d tempest-CreateVolumesFromImageTest-251776532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5e11c01f-ed7b-408a-ba51-e237facc733a 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:24 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c898eb-1340-4f1b-aed8-636ee9493929]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:43:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f16da9b4-31f2-4f4c-b646-d11696414ca3 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-323590fe-e607-469a-a323-5e79be56e236 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:24 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5e11c01f-ed7b-408a-ba51-e237facc733a 1073741824 Jul 11 04:43:24 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:24 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-baa31912-ecfc-448a-8f7a-85bfd0b23dab tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cdd7852-296e-4e4c-983f-9c2d7677e464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9676df5-f999-463d-b149-9a1b9c996d00', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-baa31912-ecfc-448a-8f7a-85bfd0b23dab tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba233945-8f90-4d26-ae44-db7a304422cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-567484e9-192c-4777-916c-f7c0dac8da38 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.725s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:24 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-567484e9-192c-4777-916c-f7c0dac8da38 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:43:24 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-567484e9-192c-4777-916c-f7c0dac8da38 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Deleted volume successfully. Jul 11 04:43:24 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-baa31912-ecfc-448a-8f7a-85bfd0b23dab tempest-CreateVolumesFromImageTest-251776532 None] Volume volume-f9676df5-f999-463d-b149-9a1b9c996d00 (f9676df5-f999-463d-b149-9a1b9c996d00): created successfully Jul 11 04:43:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-baa31912-ecfc-448a-8f7a-85bfd0b23dab tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba233945-8f90-4d26-ae44-db7a304422cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-baa31912-ecfc-448a-8f7a-85bfd0b23dab tempest-CreateVolumesFromImageTest-251776532 None] Flow 'volume_create_manager' (267cd32c-c9eb-404c-a49e-e69a587fc23e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:43:24 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-baa31912-ecfc-448a-8f7a-85bfd0b23dab tempest-CreateVolumesFromImageTest-251776532 None] Created volume successfully. Jul 11 04:43:24 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-567484e9-192c-4777-916c-f7c0dac8da38 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "cinder-aa616bfb-c211-4857-a69f-b7b8f948e8b7-delete_volume" released by "delete_volume" :: held 2.508s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:43:24 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-323590fe-e607-469a-a323-5e79be56e236 Jul 11 04:43:24 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:25 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f16da9b4-31f2-4f4c-b646-d11696414ca3 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-323590fe-e607-469a-a323-5e79be56e236" returned: 0 in 0.805s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f16da9b4-31f2-4f4c-b646-d11696414ca3 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-323590fe-e607-469a-a323-5e79be56e236 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:25 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5f85f886-2ebf-4114-929d-957f0cd8df4d tempest-CreateVolumesFromImageTest-251776532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5e11c01f-ed7b-408a-ba51-e237facc733a 1073741824" returned: 0 in 0.835s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:25 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-323590fe-e607-469a-a323-5e79be56e236 Jul 11 04:43:25 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5f85f886-2ebf-4114-929d-957f0cd8df4d tempest-CreateVolumesFromImageTest-251776532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5e11c01f-ed7b-408a-ba51-e237facc733a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:25 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5e11c01f-ed7b-408a-ba51-e237facc733a Jul 11 04:43:25 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:25 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f16da9b4-31f2-4f4c-b646-d11696414ca3 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-323590fe-e607-469a-a323-5e79be56e236" returned: 0 in 0.632s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:25 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f16da9b4-31f2-4f4c-b646-d11696414ca3 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "cinder-quobyte-323590fe-e607-469a-a323-5e79be56e236" released by "delete_volume" :: held 1.512s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:43:25 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-5f85f886-2ebf-4114-929d-957f0cd8df4d tempest-CreateVolumesFromImageTest-251776532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5e11c01f-ed7b-408a-ba51-e237facc733a" returned: 0 in 0.652s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:25 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-5f85f886-2ebf-4114-929d-957f0cd8df4d tempest-CreateVolumesFromImageTest-251776532 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:43:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-5f85f886-2ebf-4114-929d-957f0cd8df4d tempest-CreateVolumesFromImageTest-251776532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b22757f5-e414-4b3d-9521-7bd692a470ec tempest-CreateVolumesFromImageTest-251776532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.430s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:25 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b22757f5-e414-4b3d-9521-7bd692a470ec tempest-CreateVolumesFromImageTest-251776532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-122309918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f691860e-8cf9-4ea7-91ae-e9fd8293d32c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cfc42bc409743968d26d7d873da7f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:43:20Z,use_quota=True,user_id='2c66fea970d24609871dd8b06cbdaadf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:43:25 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-b22757f5-e414-4b3d-9521-7bd692a470ec tempest-CreateVolumesFromImageTest-251776532 None] Creating volume f691860e-8cf9-4ea7-91ae-e9fd8293d32c {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:43:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b22757f5-e414-4b3d-9521-7bd692a470ec tempest-CreateVolumesFromImageTest-251776532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b22757f5-e414-4b3d-9521-7bd692a470ec tempest-CreateVolumesFromImageTest-251776532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:25 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b22757f5-e414-4b3d-9521-7bd692a470ec tempest-CreateVolumesFromImageTest-251776532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:43:25 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b22757f5-e414-4b3d-9521-7bd692a470ec tempest-CreateVolumesFromImageTest-251776532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:43:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b22757f5-e414-4b3d-9521-7bd692a470ec tempest-CreateVolumesFromImageTest-251776532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:25 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b22757f5-e414-4b3d-9521-7bd692a470ec tempest-CreateVolumesFromImageTest-251776532 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:43:25 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-b22757f5-e414-4b3d-9521-7bd692a470ec tempest-CreateVolumesFromImageTest-251776532 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:43:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b22757f5-e414-4b3d-9521-7bd692a470ec tempest-CreateVolumesFromImageTest-251776532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f691860e-8cf9-4ea7-91ae-e9fd8293d32c 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:25 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-f16da9b4-31f2-4f4c-b646-d11696414ca3 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Created reservations ['9ff4bf54-d705-43e3-9de5-bd6ca6d33d84', '88a38c8b-7fc8-4a5a-afb9-807a8a982561', 'a02e8abc-850f-4cac-982f-7914487792d1', 'b3c83665-b0b8-4080-bdf1-8b44b5c48e2d'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:43:25 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f691860e-8cf9-4ea7-91ae-e9fd8293d32c 1073741824 Jul 11 04:43:25 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:26 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5f85f886-2ebf-4114-929d-957f0cd8df4d tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a1ecf36-3e5e-494b-9bfa-0fab770c96fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e11c01f-ed7b-408a-ba51-e237facc733a', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:26 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5f85f886-2ebf-4114-929d-957f0cd8df4d tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b11d53d0-8c87-4f4f-a612-07b59276ec14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:26 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-5f85f886-2ebf-4114-929d-957f0cd8df4d tempest-CreateVolumesFromImageTest-251776532 None] Volume volume-5e11c01f-ed7b-408a-ba51-e237facc733a (5e11c01f-ed7b-408a-ba51-e237facc733a): created successfully Jul 11 04:43:26 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5f85f886-2ebf-4114-929d-957f0cd8df4d tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b11d53d0-8c87-4f4f-a612-07b59276ec14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:26 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-5f85f886-2ebf-4114-929d-957f0cd8df4d tempest-CreateVolumesFromImageTest-251776532 None] Flow 'volume_create_manager' (d6a391a9-1404-4709-988c-3c40c6269805) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:43:26 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-5f85f886-2ebf-4114-929d-957f0cd8df4d tempest-CreateVolumesFromImageTest-251776532 None] Created volume successfully. Jul 11 04:43:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f16da9b4-31f2-4f4c-b646-d11696414ca3 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f16da9b4-31f2-4f4c-b646-d11696414ca3 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:26 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-f16da9b4-31f2-4f4c-b646-d11696414ca3 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:43:26 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-f16da9b4-31f2-4f4c-b646-d11696414ca3 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:43:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f16da9b4-31f2-4f4c-b646-d11696414ca3 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f16da9b4-31f2-4f4c-b646-d11696414ca3 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:26 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:43:26 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:26 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ae932920-146e-4f6a-a978-e7885a87cf66 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Acquiring lock "cinder-f72656db-7f33-4f77-b7af-9268a3263d07-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:43:26 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ae932920-146e-4f6a-a978-e7885a87cf66 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "cinder-f72656db-7f33-4f77-b7af-9268a3263d07-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:43:26 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ae932920-146e-4f6a-a978-e7885a87cf66 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Acquiring lock "cinder-quobyte-f72656db-7f33-4f77-b7af-9268a3263d07" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:43:26 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ae932920-146e-4f6a-a978-e7885a87cf66 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "cinder-quobyte-f72656db-7f33-4f77-b7af-9268a3263d07" acquired by "delete_volume" :: waited 0.021s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:43:26 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f85038-bb89-41b2-bd70-5d23641412eb]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:43:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ae932920-146e-4f6a-a978-e7885a87cf66 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f72656db-7f33-4f77-b7af-9268a3263d07 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:26 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f72656db-7f33-4f77-b7af-9268a3263d07 Jul 11 04:43:26 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:26 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f16da9b4-31f2-4f4c-b646-d11696414ca3 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.730s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:26 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-f16da9b4-31f2-4f4c-b646-d11696414ca3 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:43:26 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-f16da9b4-31f2-4f4c-b646-d11696414ca3 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Deleted volume successfully. Jul 11 04:43:26 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f16da9b4-31f2-4f4c-b646-d11696414ca3 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "cinder-323590fe-e607-469a-a323-5e79be56e236-delete_volume" released by "delete_volume" :: held 2.530s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:43:26 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b22757f5-e414-4b3d-9521-7bd692a470ec tempest-CreateVolumesFromImageTest-251776532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f691860e-8cf9-4ea7-91ae-e9fd8293d32c 1073741824" returned: 0 in 0.936s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b22757f5-e414-4b3d-9521-7bd692a470ec tempest-CreateVolumesFromImageTest-251776532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f691860e-8cf9-4ea7-91ae-e9fd8293d32c {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:26 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f691860e-8cf9-4ea7-91ae-e9fd8293d32c Jul 11 04:43:26 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:27 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ae932920-146e-4f6a-a978-e7885a87cf66 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f72656db-7f33-4f77-b7af-9268a3263d07" returned: 0 in 0.790s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ae932920-146e-4f6a-a978-e7885a87cf66 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f72656db-7f33-4f77-b7af-9268a3263d07 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:27 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f72656db-7f33-4f77-b7af-9268a3263d07 Jul 11 04:43:27 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:27 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b22757f5-e414-4b3d-9521-7bd692a470ec tempest-CreateVolumesFromImageTest-251776532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f691860e-8cf9-4ea7-91ae-e9fd8293d32c" returned: 0 in 0.673s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:27 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b22757f5-e414-4b3d-9521-7bd692a470ec tempest-CreateVolumesFromImageTest-251776532 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:43:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b22757f5-e414-4b3d-9521-7bd692a470ec tempest-CreateVolumesFromImageTest-251776532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-af73d318-ae08-4486-a286-430913833fbc tempest-CreateVolumesFromImageTest-251776532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.731s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:27 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-af73d318-ae08-4486-a286-430913833fbc tempest-CreateVolumesFromImageTest-251776532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1699277588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5679ef9-283e-42af-9b12-43239349f694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cfc42bc409743968d26d7d873da7f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:43:21Z,use_quota=True,user_id='2c66fea970d24609871dd8b06cbdaadf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:43:27 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-af73d318-ae08-4486-a286-430913833fbc tempest-CreateVolumesFromImageTest-251776532 None] Creating volume b5679ef9-283e-42af-9b12-43239349f694 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:43:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-af73d318-ae08-4486-a286-430913833fbc tempest-CreateVolumesFromImageTest-251776532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-af73d318-ae08-4486-a286-430913833fbc tempest-CreateVolumesFromImageTest-251776532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:27 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-af73d318-ae08-4486-a286-430913833fbc tempest-CreateVolumesFromImageTest-251776532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:43:27 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-af73d318-ae08-4486-a286-430913833fbc tempest-CreateVolumesFromImageTest-251776532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:43:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-af73d318-ae08-4486-a286-430913833fbc tempest-CreateVolumesFromImageTest-251776532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:27 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-af73d318-ae08-4486-a286-430913833fbc tempest-CreateVolumesFromImageTest-251776532 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:43:27 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-af73d318-ae08-4486-a286-430913833fbc tempest-CreateVolumesFromImageTest-251776532 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:43:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-af73d318-ae08-4486-a286-430913833fbc tempest-CreateVolumesFromImageTest-251776532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b5679ef9-283e-42af-9b12-43239349f694 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b22757f5-e414-4b3d-9521-7bd692a470ec tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba896be8-0f7a-47b7-8a6a-1e6df8764f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f691860e-8cf9-4ea7-91ae-e9fd8293d32c', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:27 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b5679ef9-283e-42af-9b12-43239349f694 1073741824 Jul 11 04:43:27 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b22757f5-e414-4b3d-9521-7bd692a470ec tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f57ed3b3-c5ba-49ad-97b3-7eeeb99ecf3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:27 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-b22757f5-e414-4b3d-9521-7bd692a470ec tempest-CreateVolumesFromImageTest-251776532 None] Volume volume-f691860e-8cf9-4ea7-91ae-e9fd8293d32c (f691860e-8cf9-4ea7-91ae-e9fd8293d32c): created successfully Jul 11 04:43:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b22757f5-e414-4b3d-9521-7bd692a470ec tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f57ed3b3-c5ba-49ad-97b3-7eeeb99ecf3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b22757f5-e414-4b3d-9521-7bd692a470ec tempest-CreateVolumesFromImageTest-251776532 None] Flow 'volume_create_manager' (c5695da2-724e-49fa-97b9-ec306693c7a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:43:27 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-b22757f5-e414-4b3d-9521-7bd692a470ec tempest-CreateVolumesFromImageTest-251776532 None] Created volume successfully. Jul 11 04:43:28 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ae932920-146e-4f6a-a978-e7885a87cf66 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f72656db-7f33-4f77-b7af-9268a3263d07" returned: 0 in 0.663s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:28 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ae932920-146e-4f6a-a978-e7885a87cf66 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "cinder-quobyte-f72656db-7f33-4f77-b7af-9268a3263d07" released by "delete_volume" :: held 1.500s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:43:28 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-ae932920-146e-4f6a-a978-e7885a87cf66 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Created reservations ['8a95a96a-44ae-483b-9b56-17370e41cec9', 'b6c14867-9a4c-48c5-ae5e-6ae78a59c421', 'c44affea-6290-4576-925d-383fddf9ba18', '3891cd7d-96c1-4d3b-853d-1017983e1491'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:43:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ae932920-146e-4f6a-a978-e7885a87cf66 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ae932920-146e-4f6a-a978-e7885a87cf66 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ae932920-146e-4f6a-a978-e7885a87cf66 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:43:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ae932920-146e-4f6a-a978-e7885a87cf66 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:43:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ae932920-146e-4f6a-a978-e7885a87cf66 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ae932920-146e-4f6a-a978-e7885a87cf66 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:28 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:43:28 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:28 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-af73d318-ae08-4486-a286-430913833fbc tempest-CreateVolumesFromImageTest-251776532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b5679ef9-283e-42af-9b12-43239349f694 1073741824" returned: 0 in 0.883s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-af73d318-ae08-4486-a286-430913833fbc tempest-CreateVolumesFromImageTest-251776532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b5679ef9-283e-42af-9b12-43239349f694 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:28 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b5679ef9-283e-42af-9b12-43239349f694 Jul 11 04:43:28 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:28 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c254c7a8-74d7-4d4b-bb63-bcaed7d2dbc3 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Acquiring lock "cinder-588a40fb-b11d-4415-a846-c2c052560ef8-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:43:28 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c254c7a8-74d7-4d4b-bb63-bcaed7d2dbc3 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "cinder-588a40fb-b11d-4415-a846-c2c052560ef8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:43:28 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c254c7a8-74d7-4d4b-bb63-bcaed7d2dbc3 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Acquiring lock "cinder-quobyte-588a40fb-b11d-4415-a846-c2c052560ef8" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:43:28 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c254c7a8-74d7-4d4b-bb63-bcaed7d2dbc3 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "cinder-quobyte-588a40fb-b11d-4415-a846-c2c052560ef8" acquired by "delete_volume" :: waited 0.021s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:43:28 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c270f42-cf5f-4ee6-9483-b923a9041151]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:43:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c254c7a8-74d7-4d4b-bb63-bcaed7d2dbc3 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-588a40fb-b11d-4415-a846-c2c052560ef8 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:28 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ae932920-146e-4f6a-a978-e7885a87cf66 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.720s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:28 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-ae932920-146e-4f6a-a978-e7885a87cf66 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:43:28 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-ae932920-146e-4f6a-a978-e7885a87cf66 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Deleted volume successfully. Jul 11 04:43:29 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ae932920-146e-4f6a-a978-e7885a87cf66 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "cinder-f72656db-7f33-4f77-b7af-9268a3263d07-delete_volume" released by "delete_volume" :: held 2.441s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:43:29 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-588a40fb-b11d-4415-a846-c2c052560ef8 Jul 11 04:43:29 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:29 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-af73d318-ae08-4486-a286-430913833fbc tempest-CreateVolumesFromImageTest-251776532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b5679ef9-283e-42af-9b12-43239349f694" returned: 0 in 0.698s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:29 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-af73d318-ae08-4486-a286-430913833fbc tempest-CreateVolumesFromImageTest-251776532 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:43:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-af73d318-ae08-4486-a286-430913833fbc tempest-CreateVolumesFromImageTest-251776532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.625s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:29 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-af73d318-ae08-4486-a286-430913833fbc tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (147e3a21-1ec7-4459-bd48-e13708fe766a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5679ef9-283e-42af-9b12-43239349f694', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:29 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-af73d318-ae08-4486-a286-430913833fbc tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a95e2589-3a43-4ee0-b56d-61b66d49fa44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:29 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-af73d318-ae08-4486-a286-430913833fbc tempest-CreateVolumesFromImageTest-251776532 None] Volume volume-b5679ef9-283e-42af-9b12-43239349f694 (b5679ef9-283e-42af-9b12-43239349f694): created successfully Jul 11 04:43:29 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-af73d318-ae08-4486-a286-430913833fbc tempest-CreateVolumesFromImageTest-251776532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a95e2589-3a43-4ee0-b56d-61b66d49fa44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:29 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-af73d318-ae08-4486-a286-430913833fbc tempest-CreateVolumesFromImageTest-251776532 None] Flow 'volume_create_manager' (77d2fdbb-d940-4d04-81f8-3481e58a6d5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:43:29 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-af73d318-ae08-4486-a286-430913833fbc tempest-CreateVolumesFromImageTest-251776532 None] Created volume successfully. Jul 11 04:43:29 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-337c8c2b-46c8-4b73-a78b-cf2da07cc9c7 tempest-CreateVolumesFromImageTest-251776532 None] Acquiring lock "cinder-b5679ef9-283e-42af-9b12-43239349f694-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:43:29 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-337c8c2b-46c8-4b73-a78b-cf2da07cc9c7 tempest-CreateVolumesFromImageTest-251776532 None] Lock "cinder-b5679ef9-283e-42af-9b12-43239349f694-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:43:29 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-337c8c2b-46c8-4b73-a78b-cf2da07cc9c7 tempest-CreateVolumesFromImageTest-251776532 None] Acquiring lock "cinder-quobyte-b5679ef9-283e-42af-9b12-43239349f694" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:43:29 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-337c8c2b-46c8-4b73-a78b-cf2da07cc9c7 tempest-CreateVolumesFromImageTest-251776532 None] Lock "cinder-quobyte-b5679ef9-283e-42af-9b12-43239349f694" acquired by "delete_volume" :: waited 0.015s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:43:29 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c50566-fac2-4eb0-bb91-ace56e1b9b84]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:43:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-337c8c2b-46c8-4b73-a78b-cf2da07cc9c7 tempest-CreateVolumesFromImageTest-251776532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b5679ef9-283e-42af-9b12-43239349f694 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:29 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c254c7a8-74d7-4d4b-bb63-bcaed7d2dbc3 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-588a40fb-b11d-4415-a846-c2c052560ef8" returned: 0 in 0.778s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c254c7a8-74d7-4d4b-bb63-bcaed7d2dbc3 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-588a40fb-b11d-4415-a846-c2c052560ef8 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:29 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-588a40fb-b11d-4415-a846-c2c052560ef8 Jul 11 04:43:29 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:29 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b5679ef9-283e-42af-9b12-43239349f694 Jul 11 04:43:29 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:30 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c254c7a8-74d7-4d4b-bb63-bcaed7d2dbc3 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-588a40fb-b11d-4415-a846-c2c052560ef8" returned: 0 in 0.642s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:30 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c254c7a8-74d7-4d4b-bb63-bcaed7d2dbc3 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "cinder-quobyte-588a40fb-b11d-4415-a846-c2c052560ef8" released by "delete_volume" :: held 1.471s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:43:30 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=108,cinder:UPDATE=155,cinder:INSERT=26,cinder:DELETE=10 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:43:30 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-c254c7a8-74d7-4d4b-bb63-bcaed7d2dbc3 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Created reservations ['0540ec6d-0e2b-425d-a209-f3b3597b7e37', '1f0a4be6-8d67-4dcd-aa07-6a42ffcafe02', '64c9a50c-cabb-4777-b12b-c392d12e648c', 'bdb8f673-e308-4c81-a291-32469ed43755'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:43:30 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-337c8c2b-46c8-4b73-a78b-cf2da07cc9c7 tempest-CreateVolumesFromImageTest-251776532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b5679ef9-283e-42af-9b12-43239349f694" returned: 0 in 0.794s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-337c8c2b-46c8-4b73-a78b-cf2da07cc9c7 tempest-CreateVolumesFromImageTest-251776532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b5679ef9-283e-42af-9b12-43239349f694 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:30 devstack sudo[105461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b5679ef9-283e-42af-9b12-43239349f694 Jul 11 04:43:30 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c254c7a8-74d7-4d4b-bb63-bcaed7d2dbc3 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c254c7a8-74d7-4d4b-bb63-bcaed7d2dbc3 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:30 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c254c7a8-74d7-4d4b-bb63-bcaed7d2dbc3 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:43:30 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c254c7a8-74d7-4d4b-bb63-bcaed7d2dbc3 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:43:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c254c7a8-74d7-4d4b-bb63-bcaed7d2dbc3 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c254c7a8-74d7-4d4b-bb63-bcaed7d2dbc3 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:30 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:43:30 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:31 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ccd2e6cc-f5d4-4208-aff2-c235c5c26af0 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Acquiring lock "cinder-9829cc69-0e52-453e-b349-23ae876d4b18-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:43:31 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ccd2e6cc-f5d4-4208-aff2-c235c5c26af0 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "cinder-9829cc69-0e52-453e-b349-23ae876d4b18-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:43:31 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=106,cinder:UPDATE=141,cinder:INSERT=40,cinder:DELETE=19 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:43:31 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ccd2e6cc-f5d4-4208-aff2-c235c5c26af0 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Acquiring lock "cinder-quobyte-9829cc69-0e52-453e-b349-23ae876d4b18" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:43:31 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-337c8c2b-46c8-4b73-a78b-cf2da07cc9c7 tempest-CreateVolumesFromImageTest-251776532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b5679ef9-283e-42af-9b12-43239349f694" returned: 0 in 0.679s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:31 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ccd2e6cc-f5d4-4208-aff2-c235c5c26af0 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "cinder-quobyte-9829cc69-0e52-453e-b349-23ae876d4b18" acquired by "delete_volume" :: waited 0.026s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:43:31 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-337c8c2b-46c8-4b73-a78b-cf2da07cc9c7 tempest-CreateVolumesFromImageTest-251776532 None] Lock "cinder-quobyte-b5679ef9-283e-42af-9b12-43239349f694" released by "delete_volume" :: held 1.529s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:43:31 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[3988dccd-362a-4bd4-83a4-9bed3e7ad72d]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:43:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ccd2e6cc-f5d4-4208-aff2-c235c5c26af0 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9829cc69-0e52-453e-b349-23ae876d4b18 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:31 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c254c7a8-74d7-4d4b-bb63-bcaed7d2dbc3 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.690s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:31 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-c254c7a8-74d7-4d4b-bb63-bcaed7d2dbc3 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:43:31 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-337c8c2b-46c8-4b73-a78b-cf2da07cc9c7 tempest-CreateVolumesFromImageTest-251776532 None] Created reservations ['21417967-e613-4da7-b976-4d1de2a59ffa', '24451b4f-279b-428d-b647-435d72101ced', 'd7cfa6b6-5549-46ed-8daf-b9a8117538d1', '3fd44a2f-e0da-4bf2-b9c6-db8bc88c83b9'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:43:31 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-c254c7a8-74d7-4d4b-bb63-bcaed7d2dbc3 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Deleted volume successfully. Jul 11 04:43:31 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c254c7a8-74d7-4d4b-bb63-bcaed7d2dbc3 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "cinder-588a40fb-b11d-4415-a846-c2c052560ef8-delete_volume" released by "delete_volume" :: held 2.412s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:43:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-337c8c2b-46c8-4b73-a78b-cf2da07cc9c7 tempest-CreateVolumesFromImageTest-251776532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-337c8c2b-46c8-4b73-a78b-cf2da07cc9c7 tempest-CreateVolumesFromImageTest-251776532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:31 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9829cc69-0e52-453e-b349-23ae876d4b18 Jul 11 04:43:31 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-337c8c2b-46c8-4b73-a78b-cf2da07cc9c7 tempest-CreateVolumesFromImageTest-251776532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:43:31 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:31 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-337c8c2b-46c8-4b73-a78b-cf2da07cc9c7 tempest-CreateVolumesFromImageTest-251776532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:43:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-337c8c2b-46c8-4b73-a78b-cf2da07cc9c7 tempest-CreateVolumesFromImageTest-251776532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-337c8c2b-46c8-4b73-a78b-cf2da07cc9c7 tempest-CreateVolumesFromImageTest-251776532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:31 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:43:31 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:31 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e23e335f-712f-4f66-a8bc-5dec0215d81d tempest-CreateVolumesFromImageTest-251776532 None] Acquiring lock "cinder-f691860e-8cf9-4ea7-91ae-e9fd8293d32c-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:43:31 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e23e335f-712f-4f66-a8bc-5dec0215d81d tempest-CreateVolumesFromImageTest-251776532 None] Lock "cinder-f691860e-8cf9-4ea7-91ae-e9fd8293d32c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:43:31 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e23e335f-712f-4f66-a8bc-5dec0215d81d tempest-CreateVolumesFromImageTest-251776532 None] Acquiring lock "cinder-quobyte-f691860e-8cf9-4ea7-91ae-e9fd8293d32c" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:43:31 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e23e335f-712f-4f66-a8bc-5dec0215d81d tempest-CreateVolumesFromImageTest-251776532 None] Lock "cinder-quobyte-f691860e-8cf9-4ea7-91ae-e9fd8293d32c" acquired by "delete_volume" :: waited 0.017s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:43:31 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[328a8f8e-2df2-4351-92bc-f9c504c93ede]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:43:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e23e335f-712f-4f66-a8bc-5dec0215d81d tempest-CreateVolumesFromImageTest-251776532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f691860e-8cf9-4ea7-91ae-e9fd8293d32c {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:31 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-337c8c2b-46c8-4b73-a78b-cf2da07cc9c7 tempest-CreateVolumesFromImageTest-251776532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.680s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:31 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-337c8c2b-46c8-4b73-a78b-cf2da07cc9c7 tempest-CreateVolumesFromImageTest-251776532 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:43:31 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-337c8c2b-46c8-4b73-a78b-cf2da07cc9c7 tempest-CreateVolumesFromImageTest-251776532 None] Deleted volume successfully. Jul 11 04:43:31 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:31 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f691860e-8cf9-4ea7-91ae-e9fd8293d32c Jul 11 04:43:31 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ccd2e6cc-f5d4-4208-aff2-c235c5c26af0 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9829cc69-0e52-453e-b349-23ae876d4b18" returned: 0 in 0.837s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ccd2e6cc-f5d4-4208-aff2-c235c5c26af0 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9829cc69-0e52-453e-b349-23ae876d4b18 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:32 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-337c8c2b-46c8-4b73-a78b-cf2da07cc9c7 tempest-CreateVolumesFromImageTest-251776532 None] Lock "cinder-b5679ef9-283e-42af-9b12-43239349f694-delete_volume" released by "delete_volume" :: held 2.460s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:43:32 devstack sudo[105477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9829cc69-0e52-453e-b349-23ae876d4b18 Jul 11 04:43:32 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:32 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:32 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ccd2e6cc-f5d4-4208-aff2-c235c5c26af0 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9829cc69-0e52-453e-b349-23ae876d4b18" returned: 0 in 0.663s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e23e335f-712f-4f66-a8bc-5dec0215d81d tempest-CreateVolumesFromImageTest-251776532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f691860e-8cf9-4ea7-91ae-e9fd8293d32c" returned: 0 in 0.795s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e23e335f-712f-4f66-a8bc-5dec0215d81d tempest-CreateVolumesFromImageTest-251776532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f691860e-8cf9-4ea7-91ae-e9fd8293d32c {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:32 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ccd2e6cc-f5d4-4208-aff2-c235c5c26af0 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "cinder-quobyte-9829cc69-0e52-453e-b349-23ae876d4b18" released by "delete_volume" :: held 1.556s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:43:32 devstack sudo[105483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f691860e-8cf9-4ea7-91ae-e9fd8293d32c Jul 11 04:43:32 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:32 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-ccd2e6cc-f5d4-4208-aff2-c235c5c26af0 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Created reservations ['e39aebe1-1807-450b-a159-bcc7589f66ec', 'cd6d80af-37b5-42bc-a3cc-02c3e8957fd9', '2828bc3f-cb09-4ca3-b268-87b77305d5d9', '65bb073b-d461-4866-8a5c-c8fe18c3b1d6'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:43:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ccd2e6cc-f5d4-4208-aff2-c235c5c26af0 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ccd2e6cc-f5d4-4208-aff2-c235c5c26af0 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:32 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ccd2e6cc-f5d4-4208-aff2-c235c5c26af0 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:43:32 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ccd2e6cc-f5d4-4208-aff2-c235c5c26af0 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:43:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ccd2e6cc-f5d4-4208-aff2-c235c5c26af0 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ccd2e6cc-f5d4-4208-aff2-c235c5c26af0 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:32 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:43:32 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:33 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-813690bb-131a-4baf-b12d-76915e2ddc32 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Acquiring lock "cinder-d0712ec8-6afa-40a8-ace3-4a8a7550b4e6-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:43:33 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-813690bb-131a-4baf-b12d-76915e2ddc32 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "cinder-d0712ec8-6afa-40a8-ace3-4a8a7550b4e6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:43:33 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-813690bb-131a-4baf-b12d-76915e2ddc32 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Acquiring lock "cinder-quobyte-d0712ec8-6afa-40a8-ace3-4a8a7550b4e6" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:43:33 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e23e335f-712f-4f66-a8bc-5dec0215d81d tempest-CreateVolumesFromImageTest-251776532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f691860e-8cf9-4ea7-91ae-e9fd8293d32c" returned: 0 in 0.690s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:33 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-813690bb-131a-4baf-b12d-76915e2ddc32 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "cinder-quobyte-d0712ec8-6afa-40a8-ace3-4a8a7550b4e6" acquired by "delete_volume" :: waited 0.023s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:43:33 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e23e335f-712f-4f66-a8bc-5dec0215d81d tempest-CreateVolumesFromImageTest-251776532 None] Lock "cinder-quobyte-f691860e-8cf9-4ea7-91ae-e9fd8293d32c" released by "delete_volume" :: held 1.544s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:43:33 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[292371c4-ed27-4618-97d8-810a45a9eb9a]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:43:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-813690bb-131a-4baf-b12d-76915e2ddc32 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d0712ec8-6afa-40a8-ace3-4a8a7550b4e6 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:33 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-e23e335f-712f-4f66-a8bc-5dec0215d81d tempest-CreateVolumesFromImageTest-251776532 None] Created reservations ['46fa7cb2-c997-4e97-8d72-495fd175383c', 'bcbb6531-3382-4b6b-8de8-5f6877a9613d', 'a27b150c-7904-40f0-8a20-309ecf5cef9d', 'e841df96-7e51-4fea-ae36-05bf75acbbfc'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:43:33 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ccd2e6cc-f5d4-4208-aff2-c235c5c26af0 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.688s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:33 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-ccd2e6cc-f5d4-4208-aff2-c235c5c26af0 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:43:33 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-ccd2e6cc-f5d4-4208-aff2-c235c5c26af0 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Deleted volume successfully. Jul 11 04:43:33 devstack sudo[105489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d0712ec8-6afa-40a8-ace3-4a8a7550b4e6 Jul 11 04:43:33 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:33 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ccd2e6cc-f5d4-4208-aff2-c235c5c26af0 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "cinder-9829cc69-0e52-453e-b349-23ae876d4b18-delete_volume" released by "delete_volume" :: held 2.461s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:43:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e23e335f-712f-4f66-a8bc-5dec0215d81d tempest-CreateVolumesFromImageTest-251776532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e23e335f-712f-4f66-a8bc-5dec0215d81d tempest-CreateVolumesFromImageTest-251776532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:33 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e23e335f-712f-4f66-a8bc-5dec0215d81d tempest-CreateVolumesFromImageTest-251776532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:43:33 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e23e335f-712f-4f66-a8bc-5dec0215d81d tempest-CreateVolumesFromImageTest-251776532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:43:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e23e335f-712f-4f66-a8bc-5dec0215d81d tempest-CreateVolumesFromImageTest-251776532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e23e335f-712f-4f66-a8bc-5dec0215d81d tempest-CreateVolumesFromImageTest-251776532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:33 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:43:33 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e1e769e0-17c1-4764-a82a-3f94fc099345 tempest-CreateVolumesFromImageTest-251776532 None] Acquiring lock "cinder-5e11c01f-ed7b-408a-ba51-e237facc733a-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:43:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e1e769e0-17c1-4764-a82a-3f94fc099345 tempest-CreateVolumesFromImageTest-251776532 None] Lock "cinder-5e11c01f-ed7b-408a-ba51-e237facc733a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:43:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e1e769e0-17c1-4764-a82a-3f94fc099345 tempest-CreateVolumesFromImageTest-251776532 None] Acquiring lock "cinder-quobyte-5e11c01f-ed7b-408a-ba51-e237facc733a" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:43:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e1e769e0-17c1-4764-a82a-3f94fc099345 tempest-CreateVolumesFromImageTest-251776532 None] Lock "cinder-quobyte-5e11c01f-ed7b-408a-ba51-e237facc733a" acquired by "delete_volume" :: waited 0.016s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:43:34 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6346b2f-8114-4bd1-a86f-da5f3a1cfc3c]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:43:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e1e769e0-17c1-4764-a82a-3f94fc099345 tempest-CreateVolumesFromImageTest-251776532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5e11c01f-ed7b-408a-ba51-e237facc733a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:34 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e23e335f-712f-4f66-a8bc-5dec0215d81d tempest-CreateVolumesFromImageTest-251776532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.669s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:34 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-e23e335f-712f-4f66-a8bc-5dec0215d81d tempest-CreateVolumesFromImageTest-251776532 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:43:34 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-e23e335f-712f-4f66-a8bc-5dec0215d81d tempest-CreateVolumesFromImageTest-251776532 None] Deleted volume successfully. Jul 11 04:43:34 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-813690bb-131a-4baf-b12d-76915e2ddc32 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d0712ec8-6afa-40a8-ace3-4a8a7550b4e6" returned: 0 in 0.834s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-813690bb-131a-4baf-b12d-76915e2ddc32 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d0712ec8-6afa-40a8-ace3-4a8a7550b4e6 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:34 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5e11c01f-ed7b-408a-ba51-e237facc733a Jul 11 04:43:34 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e23e335f-712f-4f66-a8bc-5dec0215d81d tempest-CreateVolumesFromImageTest-251776532 None] Lock "cinder-f691860e-8cf9-4ea7-91ae-e9fd8293d32c-delete_volume" released by "delete_volume" :: held 2.471s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:43:34 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d0712ec8-6afa-40a8-ace3-4a8a7550b4e6 Jul 11 04:43:34 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:34 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:34 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e1e769e0-17c1-4764-a82a-3f94fc099345 tempest-CreateVolumesFromImageTest-251776532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5e11c01f-ed7b-408a-ba51-e237facc733a" returned: 0 in 0.763s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e1e769e0-17c1-4764-a82a-3f94fc099345 tempest-CreateVolumesFromImageTest-251776532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5e11c01f-ed7b-408a-ba51-e237facc733a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-813690bb-131a-4baf-b12d-76915e2ddc32 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d0712ec8-6afa-40a8-ace3-4a8a7550b4e6" returned: 0 in 0.674s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:34 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5e11c01f-ed7b-408a-ba51-e237facc733a Jul 11 04:43:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-813690bb-131a-4baf-b12d-76915e2ddc32 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "cinder-quobyte-d0712ec8-6afa-40a8-ace3-4a8a7550b4e6" released by "delete_volume" :: held 1.554s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:43:34 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:34 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-813690bb-131a-4baf-b12d-76915e2ddc32 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Created reservations ['3db8d1d5-9c58-44e0-9996-ec9d4ff2196c', '2635b476-ee9b-4a39-b47b-51ab06324869', 'e89d9bbf-8945-4571-bf76-30206a2fac9b', 'c5e11d00-1a66-47b6-a2c2-27aa60b98590'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:43:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-813690bb-131a-4baf-b12d-76915e2ddc32 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-813690bb-131a-4baf-b12d-76915e2ddc32 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:35 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-813690bb-131a-4baf-b12d-76915e2ddc32 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:43:35 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-813690bb-131a-4baf-b12d-76915e2ddc32 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:43:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-813690bb-131a-4baf-b12d-76915e2ddc32 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-813690bb-131a-4baf-b12d-76915e2ddc32 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:35 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:43:35 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:35 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e1e769e0-17c1-4764-a82a-3f94fc099345 tempest-CreateVolumesFromImageTest-251776532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5e11c01f-ed7b-408a-ba51-e237facc733a" returned: 0 in 0.678s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:35 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e1e769e0-17c1-4764-a82a-3f94fc099345 tempest-CreateVolumesFromImageTest-251776532 None] Lock "cinder-quobyte-5e11c01f-ed7b-408a-ba51-e237facc733a" released by "delete_volume" :: held 1.499s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:43:35 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-e1e769e0-17c1-4764-a82a-3f94fc099345 tempest-CreateVolumesFromImageTest-251776532 None] Created reservations ['f5ecfcbb-ad92-4bc9-b220-53f6d9324bea', 'f7e13bcd-fba6-47ea-a673-5998ca1a5f32', '2c0b8f28-5413-4cbc-9881-9e38aefee1d0', 'b41b33ba-2a09-4f59-a14e-fa7abb50d55c'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:43:35 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-813690bb-131a-4baf-b12d-76915e2ddc32 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.681s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:35 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-813690bb-131a-4baf-b12d-76915e2ddc32 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:43:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e1e769e0-17c1-4764-a82a-3f94fc099345 tempest-CreateVolumesFromImageTest-251776532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e1e769e0-17c1-4764-a82a-3f94fc099345 tempest-CreateVolumesFromImageTest-251776532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:35 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e1e769e0-17c1-4764-a82a-3f94fc099345 tempest-CreateVolumesFromImageTest-251776532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:43:35 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e1e769e0-17c1-4764-a82a-3f94fc099345 tempest-CreateVolumesFromImageTest-251776532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:43:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e1e769e0-17c1-4764-a82a-3f94fc099345 tempest-CreateVolumesFromImageTest-251776532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e1e769e0-17c1-4764-a82a-3f94fc099345 tempest-CreateVolumesFromImageTest-251776532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:35 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-813690bb-131a-4baf-b12d-76915e2ddc32 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Deleted volume successfully. Jul 11 04:43:35 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:43:35 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:35 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-813690bb-131a-4baf-b12d-76915e2ddc32 tempest-CreateVolumesFromSourceVolumeTest-56715922 None] Lock "cinder-d0712ec8-6afa-40a8-ace3-4a8a7550b4e6-delete_volume" released by "delete_volume" :: held 2.473s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:43:36 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-16462eb1-3fce-4d19-850d-2fc95423a5d9 tempest-CreateVolumesFromImageTest-251776532 None] Acquiring lock "cinder-f9676df5-f999-463d-b149-9a1b9c996d00-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:43:36 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-16462eb1-3fce-4d19-850d-2fc95423a5d9 tempest-CreateVolumesFromImageTest-251776532 None] Lock "cinder-f9676df5-f999-463d-b149-9a1b9c996d00-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:43:36 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-16462eb1-3fce-4d19-850d-2fc95423a5d9 tempest-CreateVolumesFromImageTest-251776532 None] Acquiring lock "cinder-quobyte-f9676df5-f999-463d-b149-9a1b9c996d00" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:43:36 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-16462eb1-3fce-4d19-850d-2fc95423a5d9 tempest-CreateVolumesFromImageTest-251776532 None] Lock "cinder-quobyte-f9676df5-f999-463d-b149-9a1b9c996d00" acquired by "delete_volume" :: waited 0.031s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:43:36 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[195dcc58-7dcc-4092-82c8-d664acd3c368]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:43:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-16462eb1-3fce-4d19-850d-2fc95423a5d9 tempest-CreateVolumesFromImageTest-251776532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f9676df5-f999-463d-b149-9a1b9c996d00 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:36 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e1e769e0-17c1-4764-a82a-3f94fc099345 tempest-CreateVolumesFromImageTest-251776532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.715s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:36 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-e1e769e0-17c1-4764-a82a-3f94fc099345 tempest-CreateVolumesFromImageTest-251776532 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:43:36 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-e1e769e0-17c1-4764-a82a-3f94fc099345 tempest-CreateVolumesFromImageTest-251776532 None] Deleted volume successfully. Jul 11 04:43:36 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e1e769e0-17c1-4764-a82a-3f94fc099345 tempest-CreateVolumesFromImageTest-251776532 None] Lock "cinder-5e11c01f-ed7b-408a-ba51-e237facc733a-delete_volume" released by "delete_volume" :: held 2.452s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:43:36 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f9676df5-f999-463d-b149-9a1b9c996d00 Jul 11 04:43:36 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:37 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-16462eb1-3fce-4d19-850d-2fc95423a5d9 tempest-CreateVolumesFromImageTest-251776532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f9676df5-f999-463d-b149-9a1b9c996d00" returned: 0 in 0.804s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-16462eb1-3fce-4d19-850d-2fc95423a5d9 tempest-CreateVolumesFromImageTest-251776532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f9676df5-f999-463d-b149-9a1b9c996d00 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:37 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f9676df5-f999-463d-b149-9a1b9c996d00 Jul 11 04:43:37 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:37 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-16462eb1-3fce-4d19-850d-2fc95423a5d9 tempest-CreateVolumesFromImageTest-251776532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f9676df5-f999-463d-b149-9a1b9c996d00" returned: 0 in 0.645s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:37 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-16462eb1-3fce-4d19-850d-2fc95423a5d9 tempest-CreateVolumesFromImageTest-251776532 None] Lock "cinder-quobyte-f9676df5-f999-463d-b149-9a1b9c996d00" released by "delete_volume" :: held 1.493s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:43:37 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-16462eb1-3fce-4d19-850d-2fc95423a5d9 tempest-CreateVolumesFromImageTest-251776532 None] Created reservations ['1b43cbd7-0db1-42a7-af1f-f2484c56ed27', 'f53b1fca-cfd9-4e05-95b9-e9e2694b19a3', '7f3a92d9-2b34-47ad-9c8d-8afbb6b68acb', 'd42cd366-3d85-4c7a-99b7-62e0000f44f3'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:43:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-16462eb1-3fce-4d19-850d-2fc95423a5d9 tempest-CreateVolumesFromImageTest-251776532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-16462eb1-3fce-4d19-850d-2fc95423a5d9 tempest-CreateVolumesFromImageTest-251776532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:37 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-16462eb1-3fce-4d19-850d-2fc95423a5d9 tempest-CreateVolumesFromImageTest-251776532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:43:37 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-16462eb1-3fce-4d19-850d-2fc95423a5d9 tempest-CreateVolumesFromImageTest-251776532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:43:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-16462eb1-3fce-4d19-850d-2fc95423a5d9 tempest-CreateVolumesFromImageTest-251776532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-16462eb1-3fce-4d19-850d-2fc95423a5d9 tempest-CreateVolumesFromImageTest-251776532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:38 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:43:38 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:38 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-df7c7ae9-7f1a-4fe7-a687-8b210d769430 tempest-CreateVolumesFromImageTest-251776532 None] Acquiring lock "cinder-a145a59f-d46b-4347-9c8f-a6b6ca9bb687-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:43:38 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-df7c7ae9-7f1a-4fe7-a687-8b210d769430 tempest-CreateVolumesFromImageTest-251776532 None] Lock "cinder-a145a59f-d46b-4347-9c8f-a6b6ca9bb687-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:43:38 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-16462eb1-3fce-4d19-850d-2fc95423a5d9 tempest-CreateVolumesFromImageTest-251776532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.647s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:38 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-16462eb1-3fce-4d19-850d-2fc95423a5d9 tempest-CreateVolumesFromImageTest-251776532 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:43:38 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-df7c7ae9-7f1a-4fe7-a687-8b210d769430 tempest-CreateVolumesFromImageTest-251776532 None] Acquiring lock "cinder-quobyte-a145a59f-d46b-4347-9c8f-a6b6ca9bb687" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:43:38 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-16462eb1-3fce-4d19-850d-2fc95423a5d9 tempest-CreateVolumesFromImageTest-251776532 None] Deleted volume successfully. Jul 11 04:43:38 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-df7c7ae9-7f1a-4fe7-a687-8b210d769430 tempest-CreateVolumesFromImageTest-251776532 None] Lock "cinder-quobyte-a145a59f-d46b-4347-9c8f-a6b6ca9bb687" acquired by "delete_volume" :: waited 0.018s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:43:38 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-16462eb1-3fce-4d19-850d-2fc95423a5d9 tempest-CreateVolumesFromImageTest-251776532 None] Lock "cinder-f9676df5-f999-463d-b149-9a1b9c996d00-delete_volume" released by "delete_volume" :: held 2.396s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:43:38 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f98ae8-c84b-47a5-84b4-2edf30cedc98]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:43:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-df7c7ae9-7f1a-4fe7-a687-8b210d769430 tempest-CreateVolumesFromImageTest-251776532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a145a59f-d46b-4347-9c8f-a6b6ca9bb687 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:38 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a145a59f-d46b-4347-9c8f-a6b6ca9bb687 Jul 11 04:43:38 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:39 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-df7c7ae9-7f1a-4fe7-a687-8b210d769430 tempest-CreateVolumesFromImageTest-251776532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a145a59f-d46b-4347-9c8f-a6b6ca9bb687" returned: 0 in 0.777s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-df7c7ae9-7f1a-4fe7-a687-8b210d769430 tempest-CreateVolumesFromImageTest-251776532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a145a59f-d46b-4347-9c8f-a6b6ca9bb687 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:39 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a145a59f-d46b-4347-9c8f-a6b6ca9bb687 Jul 11 04:43:39 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:40 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-df7c7ae9-7f1a-4fe7-a687-8b210d769430 tempest-CreateVolumesFromImageTest-251776532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a145a59f-d46b-4347-9c8f-a6b6ca9bb687" returned: 0 in 0.644s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:40 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-df7c7ae9-7f1a-4fe7-a687-8b210d769430 tempest-CreateVolumesFromImageTest-251776532 None] Lock "cinder-quobyte-a145a59f-d46b-4347-9c8f-a6b6ca9bb687" released by "delete_volume" :: held 1.470s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:43:40 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-df7c7ae9-7f1a-4fe7-a687-8b210d769430 tempest-CreateVolumesFromImageTest-251776532 None] Created reservations ['62dd777d-95e9-4c34-9b51-476102d6e846', '8ecea0c6-b47d-45d1-b362-046f1da33cd6', '41bff45a-0d73-446a-b6a7-6d808a570c2c', '79d1a818-198f-4974-8525-4683b1fe47ff'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:43:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-df7c7ae9-7f1a-4fe7-a687-8b210d769430 tempest-CreateVolumesFromImageTest-251776532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-df7c7ae9-7f1a-4fe7-a687-8b210d769430 tempest-CreateVolumesFromImageTest-251776532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:40 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-df7c7ae9-7f1a-4fe7-a687-8b210d769430 tempest-CreateVolumesFromImageTest-251776532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:43:40 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-df7c7ae9-7f1a-4fe7-a687-8b210d769430 tempest-CreateVolumesFromImageTest-251776532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:43:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-df7c7ae9-7f1a-4fe7-a687-8b210d769430 tempest-CreateVolumesFromImageTest-251776532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-df7c7ae9-7f1a-4fe7-a687-8b210d769430 tempest-CreateVolumesFromImageTest-251776532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:40 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:43:40 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:40 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-df7c7ae9-7f1a-4fe7-a687-8b210d769430 tempest-CreateVolumesFromImageTest-251776532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.674s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:40 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-df7c7ae9-7f1a-4fe7-a687-8b210d769430 tempest-CreateVolumesFromImageTest-251776532 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:43:40 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-df7c7ae9-7f1a-4fe7-a687-8b210d769430 tempest-CreateVolumesFromImageTest-251776532 None] Deleted volume successfully. Jul 11 04:43:40 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-df7c7ae9-7f1a-4fe7-a687-8b210d769430 tempest-CreateVolumesFromImageTest-251776532 None] Lock "cinder-a145a59f-d46b-4347-9c8f-a6b6ca9bb687-delete_volume" released by "delete_volume" :: held 2.392s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:43:44 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-09cf6f74-6d9a-45c9-af52-773ffec021e6 tempest-ProjectReaderTests-1094159103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:43:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-09cf6f74-6d9a-45c9-af52-773ffec021e6 tempest-ProjectReaderTests-1094159103 None] Flow 'volume_create_manager' (22970791-f5ce-4cb3-9112-b3ad32e430c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:43:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-09cf6f74-6d9a-45c9-af52-773ffec021e6 tempest-ProjectReaderTests-1094159103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b727e7f6-8bff-4c22-b5bd-c10800b811cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-09cf6f74-6d9a-45c9-af52-773ffec021e6 tempest-ProjectReaderTests-1094159103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b727e7f6-8bff-4c22-b5bd-c10800b811cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1368401372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d88c0f6-bb31-4e39-aca4-11f05ba09174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1169f1ff160643639552e5735084d2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:43:44Z,use_quota=True,user_id='e0b8c6a9ca054fdbbd3757a6169a59c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-09cf6f74-6d9a-45c9-af52-773ffec021e6 tempest-ProjectReaderTests-1094159103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab081462-5b95-4f17-9277-54b6fe52461c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-09cf6f74-6d9a-45c9-af52-773ffec021e6 tempest-ProjectReaderTests-1094159103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab081462-5b95-4f17-9277-54b6fe52461c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-09cf6f74-6d9a-45c9-af52-773ffec021e6 tempest-ProjectReaderTests-1094159103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95a39b78-371c-4374-81d5-24880674d941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-09cf6f74-6d9a-45c9-af52-773ffec021e6 tempest-ProjectReaderTests-1094159103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95a39b78-371c-4374-81d5-24880674d941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d88c0f6-bb31-4e39-aca4-11f05ba09174', 'volume_name': 'volume-6d88c0f6-bb31-4e39-aca4-11f05ba09174', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-09cf6f74-6d9a-45c9-af52-773ffec021e6 tempest-ProjectReaderTests-1094159103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c85b1f3-8757-4fb9-93bd-508c72d2cc20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-09cf6f74-6d9a-45c9-af52-773ffec021e6 tempest-ProjectReaderTests-1094159103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c85b1f3-8757-4fb9-93bd-508c72d2cc20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-09cf6f74-6d9a-45c9-af52-773ffec021e6 tempest-ProjectReaderTests-1094159103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce3c837-c24b-46d0-9f66-20d18748ceab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:44 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-09cf6f74-6d9a-45c9-af52-773ffec021e6 tempest-ProjectReaderTests-1094159103 None] Volume 6d88c0f6-bb31-4e39-aca4-11f05ba09174: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d88c0f6-bb31-4e39-aca4-11f05ba09174', 'volume_size': 1} Jul 11 04:43:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-09cf6f74-6d9a-45c9-af52-773ffec021e6 tempest-ProjectReaderTests-1094159103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-09cf6f74-6d9a-45c9-af52-773ffec021e6 tempest-ProjectReaderTests-1094159103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:44 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-09cf6f74-6d9a-45c9-af52-773ffec021e6 tempest-ProjectReaderTests-1094159103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1368401372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d88c0f6-bb31-4e39-aca4-11f05ba09174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1169f1ff160643639552e5735084d2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:43:44Z,use_quota=True,user_id='e0b8c6a9ca054fdbbd3757a6169a59c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:43:44 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-09cf6f74-6d9a-45c9-af52-773ffec021e6 tempest-ProjectReaderTests-1094159103 None] Creating volume 6d88c0f6-bb31-4e39-aca4-11f05ba09174 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:43:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-09cf6f74-6d9a-45c9-af52-773ffec021e6 tempest-ProjectReaderTests-1094159103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-09cf6f74-6d9a-45c9-af52-773ffec021e6 tempest-ProjectReaderTests-1094159103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:44 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-09cf6f74-6d9a-45c9-af52-773ffec021e6 tempest-ProjectReaderTests-1094159103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:43:44 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-09cf6f74-6d9a-45c9-af52-773ffec021e6 tempest-ProjectReaderTests-1094159103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:43:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-09cf6f74-6d9a-45c9-af52-773ffec021e6 tempest-ProjectReaderTests-1094159103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:44 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-09cf6f74-6d9a-45c9-af52-773ffec021e6 tempest-ProjectReaderTests-1094159103 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:43:44 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-09cf6f74-6d9a-45c9-af52-773ffec021e6 tempest-ProjectReaderTests-1094159103 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:43:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-09cf6f74-6d9a-45c9-af52-773ffec021e6 tempest-ProjectReaderTests-1094159103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6d88c0f6-bb31-4e39-aca4-11f05ba09174 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:44 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6d88c0f6-bb31-4e39-aca4-11f05ba09174 1073741824 Jul 11 04:43:44 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:45 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-09cf6f74-6d9a-45c9-af52-773ffec021e6 tempest-ProjectReaderTests-1094159103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6d88c0f6-bb31-4e39-aca4-11f05ba09174 1073741824" returned: 0 in 0.844s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-09cf6f74-6d9a-45c9-af52-773ffec021e6 tempest-ProjectReaderTests-1094159103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6d88c0f6-bb31-4e39-aca4-11f05ba09174 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:45 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6d88c0f6-bb31-4e39-aca4-11f05ba09174 Jul 11 04:43:45 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:46 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-09cf6f74-6d9a-45c9-af52-773ffec021e6 tempest-ProjectReaderTests-1094159103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6d88c0f6-bb31-4e39-aca4-11f05ba09174" returned: 0 in 0.715s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:46 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-09cf6f74-6d9a-45c9-af52-773ffec021e6 tempest-ProjectReaderTests-1094159103 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:43:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-09cf6f74-6d9a-45c9-af52-773ffec021e6 tempest-ProjectReaderTests-1094159103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-09cf6f74-6d9a-45c9-af52-773ffec021e6 tempest-ProjectReaderTests-1094159103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce3c837-c24b-46d0-9f66-20d18748ceab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d88c0f6-bb31-4e39-aca4-11f05ba09174', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-09cf6f74-6d9a-45c9-af52-773ffec021e6 tempest-ProjectReaderTests-1094159103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c2fe6cd-599c-4ab6-9514-becffb48e65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:46 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-09cf6f74-6d9a-45c9-af52-773ffec021e6 tempest-ProjectReaderTests-1094159103 None] Volume volume-6d88c0f6-bb31-4e39-aca4-11f05ba09174 (6d88c0f6-bb31-4e39-aca4-11f05ba09174): created successfully Jul 11 04:43:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-09cf6f74-6d9a-45c9-af52-773ffec021e6 tempest-ProjectReaderTests-1094159103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c2fe6cd-599c-4ab6-9514-becffb48e65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:46 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-09cf6f74-6d9a-45c9-af52-773ffec021e6 tempest-ProjectReaderTests-1094159103 None] Flow 'volume_create_manager' (22970791-f5ce-4cb3-9112-b3ad32e430c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:43:46 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-09cf6f74-6d9a-45c9-af52-773ffec021e6 tempest-ProjectReaderTests-1094159103 None] Created volume successfully. Jul 11 04:43:46 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fd8f9ce9-c074-42c8-bcf4-995052850982 tempest-ProjectReaderTests-1094159103 None] Acquiring lock "cinder-6d88c0f6-bb31-4e39-aca4-11f05ba09174-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:43:46 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fd8f9ce9-c074-42c8-bcf4-995052850982 tempest-ProjectReaderTests-1094159103 None] Lock "cinder-6d88c0f6-bb31-4e39-aca4-11f05ba09174-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:43:46 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fd8f9ce9-c074-42c8-bcf4-995052850982 tempest-ProjectReaderTests-1094159103 None] Acquiring lock "cinder-quobyte-6d88c0f6-bb31-4e39-aca4-11f05ba09174" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:43:46 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fd8f9ce9-c074-42c8-bcf4-995052850982 tempest-ProjectReaderTests-1094159103 None] Lock "cinder-quobyte-6d88c0f6-bb31-4e39-aca4-11f05ba09174" acquired by "delete_volume" :: waited 0.021s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:43:46 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a20e3a-10c1-4bea-831b-3045a9b984df]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:43:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fd8f9ce9-c074-42c8-bcf4-995052850982 tempest-ProjectReaderTests-1094159103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6d88c0f6-bb31-4e39-aca4-11f05ba09174 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:47 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6d88c0f6-bb31-4e39-aca4-11f05ba09174 Jul 11 04:43:47 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:47 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fd8f9ce9-c074-42c8-bcf4-995052850982 tempest-ProjectReaderTests-1094159103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6d88c0f6-bb31-4e39-aca4-11f05ba09174" returned: 0 in 0.829s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fd8f9ce9-c074-42c8-bcf4-995052850982 tempest-ProjectReaderTests-1094159103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6d88c0f6-bb31-4e39-aca4-11f05ba09174 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:47 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6d88c0f6-bb31-4e39-aca4-11f05ba09174 Jul 11 04:43:47 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:48 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fd8f9ce9-c074-42c8-bcf4-995052850982 tempest-ProjectReaderTests-1094159103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6d88c0f6-bb31-4e39-aca4-11f05ba09174" returned: 0 in 0.737s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:48 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fd8f9ce9-c074-42c8-bcf4-995052850982 tempest-ProjectReaderTests-1094159103 None] Lock "cinder-quobyte-6d88c0f6-bb31-4e39-aca4-11f05ba09174" released by "delete_volume" :: held 1.638s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:43:48 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-fd8f9ce9-c074-42c8-bcf4-995052850982 tempest-ProjectReaderTests-1094159103 None] Created reservations ['b373536d-d08e-4d97-b13a-ce472d9e02d9', 'f107c0b5-b259-4b5e-a61b-78e6c1cff6a3', '7cbbacba-92ae-4392-864b-0c285d311586', 'f1f5a652-7ddf-43c8-9287-f27fa5dadaff'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:43:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fd8f9ce9-c074-42c8-bcf4-995052850982 tempest-ProjectReaderTests-1094159103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fd8f9ce9-c074-42c8-bcf4-995052850982 tempest-ProjectReaderTests-1094159103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:48 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-fd8f9ce9-c074-42c8-bcf4-995052850982 tempest-ProjectReaderTests-1094159103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:43:48 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-fd8f9ce9-c074-42c8-bcf4-995052850982 tempest-ProjectReaderTests-1094159103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:43:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fd8f9ce9-c074-42c8-bcf4-995052850982 tempest-ProjectReaderTests-1094159103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fd8f9ce9-c074-42c8-bcf4-995052850982 tempest-ProjectReaderTests-1094159103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:48 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:43:48 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:49 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fd8f9ce9-c074-42c8-bcf4-995052850982 tempest-ProjectReaderTests-1094159103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.693s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:49 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-fd8f9ce9-c074-42c8-bcf4-995052850982 tempest-ProjectReaderTests-1094159103 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:43:49 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-fd8f9ce9-c074-42c8-bcf4-995052850982 tempest-ProjectReaderTests-1094159103 None] Deleted volume successfully. Jul 11 04:43:49 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fd8f9ce9-c074-42c8-bcf4-995052850982 tempest-ProjectReaderTests-1094159103 None] Lock "cinder-6d88c0f6-bb31-4e39-aca4-11f05ba09174-delete_volume" released by "delete_volume" :: held 2.650s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:43:49 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaf4b1bc-c05f-4119-901b-f59179057724 tempest-ProjectReaderTests-1094159103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:43:49 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-aaf4b1bc-c05f-4119-901b-f59179057724 tempest-ProjectReaderTests-1094159103 None] Flow 'volume_create_manager' (06b9ed5a-8feb-4e18-b45b-78d60db69d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:43:49 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-aaf4b1bc-c05f-4119-901b-f59179057724 tempest-ProjectReaderTests-1094159103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d5dcca6-d215-402b-af3b-29edf4179705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:49 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-aaf4b1bc-c05f-4119-901b-f59179057724 tempest-ProjectReaderTests-1094159103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d5dcca6-d215-402b-af3b-29edf4179705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-222481279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dfca08b-1ba6-45f7-9cee-53b25e671739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1169f1ff160643639552e5735084d2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:43:50Z,use_quota=True,user_id='e0b8c6a9ca054fdbbd3757a6169a59c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:49 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-aaf4b1bc-c05f-4119-901b-f59179057724 tempest-ProjectReaderTests-1094159103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4329c02-a304-4073-8bd1-5096ef4191f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:49 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-aaf4b1bc-c05f-4119-901b-f59179057724 tempest-ProjectReaderTests-1094159103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4329c02-a304-4073-8bd1-5096ef4191f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:49 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-aaf4b1bc-c05f-4119-901b-f59179057724 tempest-ProjectReaderTests-1094159103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e493a9a4-2d65-4fdb-89ae-d27f2cdce2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:49 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-aaf4b1bc-c05f-4119-901b-f59179057724 tempest-ProjectReaderTests-1094159103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e493a9a4-2d65-4fdb-89ae-d27f2cdce2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dfca08b-1ba6-45f7-9cee-53b25e671739', 'volume_name': 'volume-8dfca08b-1ba6-45f7-9cee-53b25e671739', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:49 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-aaf4b1bc-c05f-4119-901b-f59179057724 tempest-ProjectReaderTests-1094159103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8777a696-1d9e-4e86-a84d-4729c9c22428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:49 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-aaf4b1bc-c05f-4119-901b-f59179057724 tempest-ProjectReaderTests-1094159103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8777a696-1d9e-4e86-a84d-4729c9c22428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:49 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-aaf4b1bc-c05f-4119-901b-f59179057724 tempest-ProjectReaderTests-1094159103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddf806b7-35cd-4b2a-b4d7-4210b63a3793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:49 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-aaf4b1bc-c05f-4119-901b-f59179057724 tempest-ProjectReaderTests-1094159103 None] Volume 8dfca08b-1ba6-45f7-9cee-53b25e671739: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dfca08b-1ba6-45f7-9cee-53b25e671739', 'volume_size': 1} Jul 11 04:43:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-aaf4b1bc-c05f-4119-901b-f59179057724 tempest-ProjectReaderTests-1094159103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-aaf4b1bc-c05f-4119-901b-f59179057724 tempest-ProjectReaderTests-1094159103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-aaf4b1bc-c05f-4119-901b-f59179057724 tempest-ProjectReaderTests-1094159103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-222481279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dfca08b-1ba6-45f7-9cee-53b25e671739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1169f1ff160643639552e5735084d2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:43:50Z,use_quota=True,user_id='e0b8c6a9ca054fdbbd3757a6169a59c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:43:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-aaf4b1bc-c05f-4119-901b-f59179057724 tempest-ProjectReaderTests-1094159103 None] Creating volume 8dfca08b-1ba6-45f7-9cee-53b25e671739 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:43:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-aaf4b1bc-c05f-4119-901b-f59179057724 tempest-ProjectReaderTests-1094159103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-aaf4b1bc-c05f-4119-901b-f59179057724 tempest-ProjectReaderTests-1094159103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-aaf4b1bc-c05f-4119-901b-f59179057724 tempest-ProjectReaderTests-1094159103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:43:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-aaf4b1bc-c05f-4119-901b-f59179057724 tempest-ProjectReaderTests-1094159103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:43:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-aaf4b1bc-c05f-4119-901b-f59179057724 tempest-ProjectReaderTests-1094159103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-aaf4b1bc-c05f-4119-901b-f59179057724 tempest-ProjectReaderTests-1094159103 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:43:49 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-aaf4b1bc-c05f-4119-901b-f59179057724 tempest-ProjectReaderTests-1094159103 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:43:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-aaf4b1bc-c05f-4119-901b-f59179057724 tempest-ProjectReaderTests-1094159103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8dfca08b-1ba6-45f7-9cee-53b25e671739 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:49 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8dfca08b-1ba6-45f7-9cee-53b25e671739 1073741824 Jul 11 04:43:49 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:50 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-aaf4b1bc-c05f-4119-901b-f59179057724 tempest-ProjectReaderTests-1094159103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8dfca08b-1ba6-45f7-9cee-53b25e671739 1073741824" returned: 0 in 0.997s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-aaf4b1bc-c05f-4119-901b-f59179057724 tempest-ProjectReaderTests-1094159103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8dfca08b-1ba6-45f7-9cee-53b25e671739 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:50 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8dfca08b-1ba6-45f7-9cee-53b25e671739 Jul 11 04:43:50 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:51 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-aaf4b1bc-c05f-4119-901b-f59179057724 tempest-ProjectReaderTests-1094159103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8dfca08b-1ba6-45f7-9cee-53b25e671739" returned: 0 in 0.684s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:51 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-aaf4b1bc-c05f-4119-901b-f59179057724 tempest-ProjectReaderTests-1094159103 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:43:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-aaf4b1bc-c05f-4119-901b-f59179057724 tempest-ProjectReaderTests-1094159103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:51 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-aaf4b1bc-c05f-4119-901b-f59179057724 tempest-ProjectReaderTests-1094159103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddf806b7-35cd-4b2a-b4d7-4210b63a3793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dfca08b-1ba6-45f7-9cee-53b25e671739', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:51 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-aaf4b1bc-c05f-4119-901b-f59179057724 tempest-ProjectReaderTests-1094159103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e93a2a13-f41e-416a-a884-84be24b1b792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:43:51 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-aaf4b1bc-c05f-4119-901b-f59179057724 tempest-ProjectReaderTests-1094159103 None] Volume volume-8dfca08b-1ba6-45f7-9cee-53b25e671739 (8dfca08b-1ba6-45f7-9cee-53b25e671739): created successfully Jul 11 04:43:51 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-aaf4b1bc-c05f-4119-901b-f59179057724 tempest-ProjectReaderTests-1094159103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e93a2a13-f41e-416a-a884-84be24b1b792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:43:51 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-aaf4b1bc-c05f-4119-901b-f59179057724 tempest-ProjectReaderTests-1094159103 None] Flow 'volume_create_manager' (06b9ed5a-8feb-4e18-b45b-78d60db69d66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:43:51 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-aaf4b1bc-c05f-4119-901b-f59179057724 tempest-ProjectReaderTests-1094159103 None] Created volume successfully. Jul 11 04:43:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-2fce02bd-1901-4b0a-b984-f45ff3333387 tempest-ProjectReaderTests-1094159103 None] Acquiring lock "cinder-8dfca08b-1ba6-45f7-9cee-53b25e671739-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:43:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-2fce02bd-1901-4b0a-b984-f45ff3333387 tempest-ProjectReaderTests-1094159103 None] Lock "cinder-8dfca08b-1ba6-45f7-9cee-53b25e671739-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:43:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-2fce02bd-1901-4b0a-b984-f45ff3333387 tempest-ProjectReaderTests-1094159103 None] Acquiring lock "cinder-quobyte-8dfca08b-1ba6-45f7-9cee-53b25e671739" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:43:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-2fce02bd-1901-4b0a-b984-f45ff3333387 tempest-ProjectReaderTests-1094159103 None] Lock "cinder-quobyte-8dfca08b-1ba6-45f7-9cee-53b25e671739" acquired by "delete_volume" :: waited 0.018s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:43:51 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a8674b-2d54-4fef-bbe1-cfd9cd3fa0f8]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:43:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2fce02bd-1901-4b0a-b984-f45ff3333387 tempest-ProjectReaderTests-1094159103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8dfca08b-1ba6-45f7-9cee-53b25e671739 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:51 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8dfca08b-1ba6-45f7-9cee-53b25e671739 Jul 11 04:43:51 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:52 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2fce02bd-1901-4b0a-b984-f45ff3333387 tempest-ProjectReaderTests-1094159103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8dfca08b-1ba6-45f7-9cee-53b25e671739" returned: 0 in 0.807s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2fce02bd-1901-4b0a-b984-f45ff3333387 tempest-ProjectReaderTests-1094159103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8dfca08b-1ba6-45f7-9cee-53b25e671739 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:52 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8dfca08b-1ba6-45f7-9cee-53b25e671739 Jul 11 04:43:52 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:53 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2fce02bd-1901-4b0a-b984-f45ff3333387 tempest-ProjectReaderTests-1094159103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8dfca08b-1ba6-45f7-9cee-53b25e671739" returned: 0 in 0.660s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:53 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-2fce02bd-1901-4b0a-b984-f45ff3333387 tempest-ProjectReaderTests-1094159103 None] Lock "cinder-quobyte-8dfca08b-1ba6-45f7-9cee-53b25e671739" released by "delete_volume" :: held 1.508s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:43:53 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-2fce02bd-1901-4b0a-b984-f45ff3333387 tempest-ProjectReaderTests-1094159103 None] Created reservations ['21b09cbb-1d74-4b34-a96d-80ce893c6c8c', 'c3df1ba0-9e15-40b0-9206-437a4f6a6f26', 'bdb9db58-94fc-4c2e-8e18-45923753f019', '6febcd75-684a-4239-83cc-864004ddd4c9'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:43:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2fce02bd-1901-4b0a-b984-f45ff3333387 tempest-ProjectReaderTests-1094159103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2fce02bd-1901-4b0a-b984-f45ff3333387 tempest-ProjectReaderTests-1094159103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:53 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2fce02bd-1901-4b0a-b984-f45ff3333387 tempest-ProjectReaderTests-1094159103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:43:53 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2fce02bd-1901-4b0a-b984-f45ff3333387 tempest-ProjectReaderTests-1094159103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:43:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2fce02bd-1901-4b0a-b984-f45ff3333387 tempest-ProjectReaderTests-1094159103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2fce02bd-1901-4b0a-b984-f45ff3333387 tempest-ProjectReaderTests-1094159103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:53 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:43:53 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:54 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2fce02bd-1901-4b0a-b984-f45ff3333387 tempest-ProjectReaderTests-1094159103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.646s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:54 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-2fce02bd-1901-4b0a-b984-f45ff3333387 tempest-ProjectReaderTests-1094159103 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:43:54 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-2fce02bd-1901-4b0a-b984-f45ff3333387 tempest-ProjectReaderTests-1094159103 None] Deleted volume successfully. Jul 11 04:43:54 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-2fce02bd-1901-4b0a-b984-f45ff3333387 tempest-ProjectReaderTests-1094159103 None] Lock "cinder-8dfca08b-1ba6-45f7-9cee-53b25e671739-delete_volume" released by "delete_volume" :: held 2.390s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:43:59 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:43:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:43:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:43:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:43:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:43:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:43:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:43:59 devstack sudo[105582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:43:59 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:43:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.797s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:43:59 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:43:59 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root Jul 11 04:43:59 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager._thread_info {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:43:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread count: 28 {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:43:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread info: [<_MainThread(MainThread, started 124675027595392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:44:00 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-33b9faf3-07b8-433e-9821-fabe3b0c3f01 tempest-SnapshotDependencyTests-1779045608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:44:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-33b9faf3-07b8-433e-9821-fabe3b0c3f01 tempest-SnapshotDependencyTests-1779045608 None] Flow 'volume_create_manager' (3a190152-792c-4871-8ed4-63b8197197cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:44:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-33b9faf3-07b8-433e-9821-fabe3b0c3f01 tempest-SnapshotDependencyTests-1779045608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06896a39-bcec-435b-b393-03515891a0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-33b9faf3-07b8-433e-9821-fabe3b0c3f01 tempest-SnapshotDependencyTests-1779045608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06896a39-bcec-435b-b393-03515891a0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:44:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2039074803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e800f363-ba81-4fb7-b89c-59a704a4dd4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0e552a73c9c45609fdd6c412e6fb30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:44:01Z,use_quota=True,user_id='2d349e363672448ba78eddd34cd922ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-33b9faf3-07b8-433e-9821-fabe3b0c3f01 tempest-SnapshotDependencyTests-1779045608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4b7e088-a681-4194-a79b-cdaa3a72d56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-33b9faf3-07b8-433e-9821-fabe3b0c3f01 tempest-SnapshotDependencyTests-1779045608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4b7e088-a681-4194-a79b-cdaa3a72d56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-33b9faf3-07b8-433e-9821-fabe3b0c3f01 tempest-SnapshotDependencyTests-1779045608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6a52106-46fb-4c25-a6d1-82377bcb705a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-33b9faf3-07b8-433e-9821-fabe3b0c3f01 tempest-SnapshotDependencyTests-1779045608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6a52106-46fb-4c25-a6d1-82377bcb705a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e800f363-ba81-4fb7-b89c-59a704a4dd4f', 'volume_name': 'volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-33b9faf3-07b8-433e-9821-fabe3b0c3f01 tempest-SnapshotDependencyTests-1779045608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf6d27c-f7e0-447c-a183-aee63cadd108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-33b9faf3-07b8-433e-9821-fabe3b0c3f01 tempest-SnapshotDependencyTests-1779045608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf6d27c-f7e0-447c-a183-aee63cadd108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-33b9faf3-07b8-433e-9821-fabe3b0c3f01 tempest-SnapshotDependencyTests-1779045608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edf6a144-d51c-4a94-9cf7-dc8f33e9d788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:01 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-33b9faf3-07b8-433e-9821-fabe3b0c3f01 tempest-SnapshotDependencyTests-1779045608 None] Volume e800f363-ba81-4fb7-b89c-59a704a4dd4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f', 'volume_size': 1} Jul 11 04:44:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-33b9faf3-07b8-433e-9821-fabe3b0c3f01 tempest-SnapshotDependencyTests-1779045608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:44:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-33b9faf3-07b8-433e-9821-fabe3b0c3f01 tempest-SnapshotDependencyTests-1779045608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:44:01 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-33b9faf3-07b8-433e-9821-fabe3b0c3f01 tempest-SnapshotDependencyTests-1779045608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:44:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2039074803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e800f363-ba81-4fb7-b89c-59a704a4dd4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0e552a73c9c45609fdd6c412e6fb30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:44:01Z,use_quota=True,user_id='2d349e363672448ba78eddd34cd922ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:44:01 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-33b9faf3-07b8-433e-9821-fabe3b0c3f01 tempest-SnapshotDependencyTests-1779045608 None] Creating volume e800f363-ba81-4fb7-b89c-59a704a4dd4f {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:44:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-33b9faf3-07b8-433e-9821-fabe3b0c3f01 tempest-SnapshotDependencyTests-1779045608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:44:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-33b9faf3-07b8-433e-9821-fabe3b0c3f01 tempest-SnapshotDependencyTests-1779045608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:44:01 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-33b9faf3-07b8-433e-9821-fabe3b0c3f01 tempest-SnapshotDependencyTests-1779045608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:44:01 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-33b9faf3-07b8-433e-9821-fabe3b0c3f01 tempest-SnapshotDependencyTests-1779045608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:44:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-33b9faf3-07b8-433e-9821-fabe3b0c3f01 tempest-SnapshotDependencyTests-1779045608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:44:01 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-33b9faf3-07b8-433e-9821-fabe3b0c3f01 tempest-SnapshotDependencyTests-1779045608 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:44:01 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-33b9faf3-07b8-433e-9821-fabe3b0c3f01 tempest-SnapshotDependencyTests-1779045608 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:44:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-33b9faf3-07b8-433e-9821-fabe3b0c3f01 tempest-SnapshotDependencyTests-1779045608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:01 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f 1073741824 Jul 11 04:44:01 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:01 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-33b9faf3-07b8-433e-9821-fabe3b0c3f01 tempest-SnapshotDependencyTests-1779045608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f 1073741824" returned: 0 in 0.795s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-33b9faf3-07b8-433e-9821-fabe3b0c3f01 tempest-SnapshotDependencyTests-1779045608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:01 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f Jul 11 04:44:01 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:02 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-33b9faf3-07b8-433e-9821-fabe3b0c3f01 tempest-SnapshotDependencyTests-1779045608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f" returned: 0 in 0.626s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:02 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-33b9faf3-07b8-433e-9821-fabe3b0c3f01 tempest-SnapshotDependencyTests-1779045608 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:44:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-33b9faf3-07b8-433e-9821-fabe3b0c3f01 tempest-SnapshotDependencyTests-1779045608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:44:02 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-33b9faf3-07b8-433e-9821-fabe3b0c3f01 tempest-SnapshotDependencyTests-1779045608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edf6a144-d51c-4a94-9cf7-dc8f33e9d788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:02 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-33b9faf3-07b8-433e-9821-fabe3b0c3f01 tempest-SnapshotDependencyTests-1779045608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e955cd42-f5fd-4061-9740-529a6d04991e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:02 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-33b9faf3-07b8-433e-9821-fabe3b0c3f01 tempest-SnapshotDependencyTests-1779045608 None] Volume volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f (e800f363-ba81-4fb7-b89c-59a704a4dd4f): created successfully Jul 11 04:44:02 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-33b9faf3-07b8-433e-9821-fabe3b0c3f01 tempest-SnapshotDependencyTests-1779045608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e955cd42-f5fd-4061-9740-529a6d04991e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:02 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-33b9faf3-07b8-433e-9821-fabe3b0c3f01 tempest-SnapshotDependencyTests-1779045608 None] Flow 'volume_create_manager' (3a190152-792c-4871-8ed4-63b8197197cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:44:02 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-33b9faf3-07b8-433e-9821-fabe3b0c3f01 tempest-SnapshotDependencyTests-1779045608 None] Created volume successfully. Jul 11 04:44:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-245634a7-0a61-4824-8f66-e6cfa5b7c445 tempest-SnapshotDependencyTests-1779045608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:44:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-245634a7-0a61-4824-8f66-e6cfa5b7c445 tempest-SnapshotDependencyTests-1779045608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:44:03 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-245634a7-0a61-4824-8f66-e6cfa5b7c445 tempest-SnapshotDependencyTests-1779045608 None] Creating offline snapshot 9097899d-64ac-4f4b-8eb9-e53f4e5a6dba of volume e800f363-ba81-4fb7-b89c-59a704a4dd4f {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:44:03 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f78782-059a-4ea4-829f-89645e2f3d6c]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:44:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-245634a7-0a61-4824-8f66-e6cfa5b7c445 tempest-SnapshotDependencyTests-1779045608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:03 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f Jul 11 04:44:03 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:03 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-245634a7-0a61-4824-8f66-e6cfa5b7c445 tempest-SnapshotDependencyTests-1779045608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f" returned: 0 in 0.741s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-245634a7-0a61-4824-8f66-e6cfa5b7c445 tempest-SnapshotDependencyTests-1779045608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f.9097899d-64ac-4f4b-8eb9-e53f4e5a6dba 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:03 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f.9097899d-64ac-4f4b-8eb9-e53f4e5a6dba 1G Jul 11 04:44:03 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:04 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-245634a7-0a61-4824-8f66-e6cfa5b7c445 tempest-SnapshotDependencyTests-1779045608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f.9097899d-64ac-4f4b-8eb9-e53f4e5a6dba 1G" returned: 0 in 0.795s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-245634a7-0a61-4824-8f66-e6cfa5b7c445 tempest-SnapshotDependencyTests-1779045608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f.9097899d-64ac-4f4b-8eb9-e53f4e5a6dba {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:04 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f.9097899d-64ac-4f4b-8eb9-e53f4e5a6dba Jul 11 04:44:04 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:05 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-245634a7-0a61-4824-8f66-e6cfa5b7c445 tempest-SnapshotDependencyTests-1779045608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f.9097899d-64ac-4f4b-8eb9-e53f4e5a6dba" returned: 0 in 0.684s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:05 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-245634a7-0a61-4824-8f66-e6cfa5b7c445 tempest-SnapshotDependencyTests-1779045608 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f.9097899d-64ac-4f4b-8eb9-e53f4e5a6dba is being set with open permissions: ugo+rw Jul 11 04:44:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-245634a7-0a61-4824-8f66-e6cfa5b7c445 tempest-SnapshotDependencyTests-1779045608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f.9097899d-64ac-4f4b-8eb9-e53f4e5a6dba {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:05 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f.9097899d-64ac-4f4b-8eb9-e53f4e5a6dba Jul 11 04:44:05 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:06 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-245634a7-0a61-4824-8f66-e6cfa5b7c445 tempest-SnapshotDependencyTests-1779045608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f.9097899d-64ac-4f4b-8eb9-e53f4e5a6dba" returned: 0 in 0.613s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-245634a7-0a61-4824-8f66-e6cfa5b7c445 tempest-SnapshotDependencyTests-1779045608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:06 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f.info Jul 11 04:44:06 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:06 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-245634a7-0a61-4824-8f66-e6cfa5b7c445 tempest-SnapshotDependencyTests-1779045608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f.info" returned: 0 in 0.657s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:06 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-245634a7-0a61-4824-8f66-e6cfa5b7c445 tempest-SnapshotDependencyTests-1779045608 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f.info is being set with open permissions: ugo+rw Jul 11 04:44:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-245634a7-0a61-4824-8f66-e6cfa5b7c445 tempest-SnapshotDependencyTests-1779045608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:06 devstack sudo[105617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f.info Jul 11 04:44:06 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:07 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-245634a7-0a61-4824-8f66-e6cfa5b7c445 tempest-SnapshotDependencyTests-1779045608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f.info" returned: 0 in 0.620s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-245634a7-0a61-4824-8f66-e6cfa5b7c445 tempest-SnapshotDependencyTests-1779045608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.191s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:44:07 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-245634a7-0a61-4824-8f66-e6cfa5b7c445 tempest-SnapshotDependencyTests-1779045608 None] Create snapshot completed successfully Jul 11 04:44:08 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:44:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Flow 'volume_create_manager' (7991db44-1444-495a-a63f-9d324afd47e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:44:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23a7fe21-3eeb-4ddc-a12e-294372f55e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23a7fe21-3eeb-4ddc-a12e-294372f55e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd1984e8-0a40-4b7f-ae1d-02db8299097a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0e552a73c9c45609fdd6c412e6fb30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9097899d-64ac-4f4b-8eb9-e53f4e5a6dba,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:44:09Z,use_quota=True,user_id='2d349e363672448ba78eddd34cd922ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f97b63b4-005d-444b-aed4-618d5b93230e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f97b63b4-005d-444b-aed4-618d5b93230e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9fffb99-f610-4579-aa8e-9d35fc311684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9fffb99-f610-4579-aa8e-9d35fc311684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fd1984e8-0a40-4b7f-ae1d-02db8299097a', 'volume_name': 'volume-fd1984e8-0a40-4b7f-ae1d-02db8299097a', 'volume_size': 1, 'snapshot_id': '9097899d-64ac-4f4b-8eb9-e53f4e5a6dba'}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:09 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66492efc-04f5-47a3-857f-9c0785920775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:09 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66492efc-04f5-47a3-857f-9c0785920775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:09 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d74a21b4-b218-41f7-8ec2-25bd1d5cecc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:09 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Volume fd1984e8-0a40-4b7f-ae1d-02db8299097a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fd1984e8-0a40-4b7f-ae1d-02db8299097a', 'volume_size': 1, 'snapshot_id': '9097899d-64ac-4f4b-8eb9-e53f4e5a6dba'} Jul 11 04:44:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:44:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:44:09 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Acquiring lock "cinder-quobyte-9097899d-64ac-4f4b-8eb9-e53f4e5a6dba-fd1984e8-0a40-4b7f-ae1d-02db8299097a" by "_create_volume_from_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:44:09 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Lock "cinder-quobyte-9097899d-64ac-4f4b-8eb9-e53f4e5a6dba-fd1984e8-0a40-4b7f-ae1d-02db8299097a" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:44:09 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Creating volume fd1984e8-0a40-4b7f-ae1d-02db8299097a from snapshot 9097899d-64ac-4f4b-8eb9-e53f4e5a6dba {{(pid=86964) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 04:44:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:44:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:44:09 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:44:09 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:44:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:44:09 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:44:09 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Acquiring lock "cinder-quobyte-fd1984e8-0a40-4b7f-ae1d-02db8299097a" by "_copy_volume_from_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:44:09 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Lock "cinder-quobyte-fd1984e8-0a40-4b7f-ae1d-02db8299097a" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:44:09 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] snapshot: 9097899d-64ac-4f4b-8eb9-e53f4e5a6dba, volume: fd1984e8-0a40-4b7f-ae1d-02db8299097a, {{(pid=86964) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 04:44:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:44:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:44:09 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:44:09 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:44:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:44:09 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[154dfbeb-7958-4f57-8d86-518072963f0c]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:44:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f.9097899d-64ac-4f4b-8eb9-e53f4e5a6dba {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:09 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f.9097899d-64ac-4f4b-8eb9-e53f4e5a6dba Jul 11 04:44:09 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:09 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f.9097899d-64ac-4f4b-8eb9-e53f4e5a6dba" returned: 0 in 0.720s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:09 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:44:09 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f {{(pid=86964) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 04:44:09 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Creating direct copy from snapshot {{(pid=86964) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 04:44:09 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[13296197-c08d-45d6-9899-aed39a0e3823]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:44:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:09 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f Jul 11 04:44:09 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:10 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f" returned: 0 in 0.756s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:10 devstack cinder-volume[86964]: DEBUG cinder.utils [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Path /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd1984e8-0a40-4b7f-ae1d-02db8299097a not found in is_blk_device check {{(pid=86964) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 04:44:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd1984e8-0a40-4b7f-ae1d-02db8299097a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:10 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd1984e8-0a40-4b7f-ae1d-02db8299097a Jul 11 04:44:10 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:14 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd1984e8-0a40-4b7f-ae1d-02db8299097a" returned: 0 in 4.313s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:14 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85ffc33-15ac-42c6-b0f1-2d8460196887]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:44:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:15 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f Jul 11 04:44:15 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:15 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f" returned: 0 in 0.912s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:15 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Image conversion details: src /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f, size 1024.00 MB, duration 4.31 sec, destination /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd1984e8-0a40-4b7f-ae1d-02db8299097a {{(pid=86964) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 04:44:15 devstack cinder-volume[86964]: INFO cinder.image.image_utils [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Converted 1024.00 MB image at 237.36 MB/s Jul 11 04:44:15 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd1984e8-0a40-4b7f-ae1d-02db8299097a is being set with open permissions: ugo+rw Jul 11 04:44:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd1984e8-0a40-4b7f-ae1d-02db8299097a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:15 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd1984e8-0a40-4b7f-ae1d-02db8299097a Jul 11 04:44:15 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:16 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd1984e8-0a40-4b7f-ae1d-02db8299097a" returned: 0 in 0.673s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:16 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Lock "cinder-quobyte-fd1984e8-0a40-4b7f-ae1d-02db8299097a" released by "_copy_volume_from_snapshot" :: held 7.464s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:44:16 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Lock "cinder-quobyte-9097899d-64ac-4f4b-8eb9-e53f4e5a6dba-fd1984e8-0a40-4b7f-ae1d-02db8299097a" released by "_create_volume_from_snapshot" :: held 7.492s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:44:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.507s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:44:16 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d74a21b4-b218-41f7-8ec2-25bd1d5cecc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd1984e8-0a40-4b7f-ae1d-02db8299097a', 'volume_size': 1, 'snapshot_id': '9097899d-64ac-4f4b-8eb9-e53f4e5a6dba'}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:16 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bd47bba-f286-4be7-a5bd-91ef9fef9826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:16 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Volume volume-fd1984e8-0a40-4b7f-ae1d-02db8299097a (fd1984e8-0a40-4b7f-ae1d-02db8299097a): created successfully Jul 11 04:44:16 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bd47bba-f286-4be7-a5bd-91ef9fef9826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:16 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Flow 'volume_create_manager' (7991db44-1444-495a-a63f-9d324afd47e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:44:16 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-56dad565-adbd-4cb9-a5c6-30a93da7f31c tempest-SnapshotDependencyTests-1779045608 None] Created volume successfully. Jul 11 04:44:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-cb0267b3-cbb4-42a2-87f2-b450caf9ebb9 tempest-SnapshotDependencyTests-1779045608 None] Acquiring lock "cinder-9097899d-64ac-4f4b-8eb9-e53f4e5a6dba-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:44:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-cb0267b3-cbb4-42a2-87f2-b450caf9ebb9 tempest-SnapshotDependencyTests-1779045608 None] Lock "cinder-9097899d-64ac-4f4b-8eb9-e53f4e5a6dba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:44:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-cb0267b3-cbb4-42a2-87f2-b450caf9ebb9 tempest-SnapshotDependencyTests-1779045608 None] Acquiring lock "cinder-quobyte-e800f363-ba81-4fb7-b89c-59a704a4dd4f" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:44:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-cb0267b3-cbb4-42a2-87f2-b450caf9ebb9 tempest-SnapshotDependencyTests-1779045608 None] Lock "cinder-quobyte-e800f363-ba81-4fb7-b89c-59a704a4dd4f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:44:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-cb0267b3-cbb4-42a2-87f2-b450caf9ebb9 tempest-SnapshotDependencyTests-1779045608 None] Acquiring lock "cinder-quobyte-9097899d-64ac-4f4b-8eb9-e53f4e5a6dba" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:44:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-cb0267b3-cbb4-42a2-87f2-b450caf9ebb9 tempest-SnapshotDependencyTests-1779045608 None] Lock "cinder-quobyte-9097899d-64ac-4f4b-8eb9-e53f4e5a6dba" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:44:17 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-cb0267b3-cbb4-42a2-87f2-b450caf9ebb9 tempest-SnapshotDependencyTests-1779045608 None] Deleting offline snapshot 9097899d-64ac-4f4b-8eb9-e53f4e5a6dba of volume e800f363-ba81-4fb7-b89c-59a704a4dd4f {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:44:17 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-cb0267b3-cbb4-42a2-87f2-b450caf9ebb9 tempest-SnapshotDependencyTests-1779045608 None] snapshot_file for this snap is: volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f.9097899d-64ac-4f4b-8eb9-e53f4e5a6dba {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:44:17 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ed9fc0-1a28-43e0-9055-00cdd1a447b2]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:44:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cb0267b3-cbb4-42a2-87f2-b450caf9ebb9 tempest-SnapshotDependencyTests-1779045608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f.9097899d-64ac-4f4b-8eb9-e53f4e5a6dba {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:17 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f.9097899d-64ac-4f4b-8eb9-e53f4e5a6dba Jul 11 04:44:17 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:18 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cb0267b3-cbb4-42a2-87f2-b450caf9ebb9 tempest-SnapshotDependencyTests-1779045608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f.9097899d-64ac-4f4b-8eb9-e53f4e5a6dba" returned: 0 in 0.717s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:18 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-cb0267b3-cbb4-42a2-87f2-b450caf9ebb9 tempest-SnapshotDependencyTests-1779045608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:44:18 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[147f6394-1921-41d8-a76a-31fbbe3b352f]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:44:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cb0267b3-cbb4-42a2-87f2-b450caf9ebb9 tempest-SnapshotDependencyTests-1779045608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:18 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f Jul 11 04:44:18 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:19 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cb0267b3-cbb4-42a2-87f2-b450caf9ebb9 tempest-SnapshotDependencyTests-1779045608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f" returned: 0 in 0.719s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cb0267b3-cbb4-42a2-87f2-b450caf9ebb9 tempest-SnapshotDependencyTests-1779045608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f.9097899d-64ac-4f4b-8eb9-e53f4e5a6dba {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:19 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f.9097899d-64ac-4f4b-8eb9-e53f4e5a6dba Jul 11 04:44:19 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:19 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cb0267b3-cbb4-42a2-87f2-b450caf9ebb9 tempest-SnapshotDependencyTests-1779045608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f.9097899d-64ac-4f4b-8eb9-e53f4e5a6dba" returned: 0 in 0.708s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cb0267b3-cbb4-42a2-87f2-b450caf9ebb9 tempest-SnapshotDependencyTests-1779045608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f.9097899d-64ac-4f4b-8eb9-e53f4e5a6dba {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:19 devstack sudo[105709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f.9097899d-64ac-4f4b-8eb9-e53f4e5a6dba Jul 11 04:44:19 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:20 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cb0267b3-cbb4-42a2-87f2-b450caf9ebb9 tempest-SnapshotDependencyTests-1779045608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f.9097899d-64ac-4f4b-8eb9-e53f4e5a6dba" returned: 0 in 0.642s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:20 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-cb0267b3-cbb4-42a2-87f2-b450caf9ebb9 tempest-SnapshotDependencyTests-1779045608 None] Lock "cinder-quobyte-9097899d-64ac-4f4b-8eb9-e53f4e5a6dba" released by "_delete_snapshot" :: held 2.874s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:44:20 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-cb0267b3-cbb4-42a2-87f2-b450caf9ebb9 tempest-SnapshotDependencyTests-1779045608 None] Lock "cinder-quobyte-e800f363-ba81-4fb7-b89c-59a704a4dd4f" released by "delete_snapshot" :: held 2.901s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:44:20 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-cb0267b3-cbb4-42a2-87f2-b450caf9ebb9 tempest-SnapshotDependencyTests-1779045608 None] Created reservations ['97cb32fe-7a2a-47d8-a578-394c705496fd', '35245a1f-2822-4c74-ba6f-537280dfbc2e', '94f9bf75-a505-41c9-a8ba-74b76a6861f5', '2f4a52f3-3a1b-4669-9746-8e14ecd7adb4'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:44:20 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-cb0267b3-cbb4-42a2-87f2-b450caf9ebb9 tempest-SnapshotDependencyTests-1779045608 None] Delete snapshot completed successfully. Jul 11 04:44:20 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-cb0267b3-cbb4-42a2-87f2-b450caf9ebb9 tempest-SnapshotDependencyTests-1779045608 None] Lock "cinder-9097899d-64ac-4f4b-8eb9-e53f4e5a6dba-delete_snapshot" released by "delete_snapshot" :: held 3.026s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:44:20 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-632d56dd-150c-4cfa-a53b-923d8b8b9531 tempest-SnapshotDependencyTests-1779045608 None] Acquiring lock "cinder-e800f363-ba81-4fb7-b89c-59a704a4dd4f-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:44:20 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-632d56dd-150c-4cfa-a53b-923d8b8b9531 tempest-SnapshotDependencyTests-1779045608 None] Lock "cinder-e800f363-ba81-4fb7-b89c-59a704a4dd4f-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:44:20 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-632d56dd-150c-4cfa-a53b-923d8b8b9531 tempest-SnapshotDependencyTests-1779045608 None] Acquiring lock "cinder-quobyte-e800f363-ba81-4fb7-b89c-59a704a4dd4f" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:44:20 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-632d56dd-150c-4cfa-a53b-923d8b8b9531 tempest-SnapshotDependencyTests-1779045608 None] Lock "cinder-quobyte-e800f363-ba81-4fb7-b89c-59a704a4dd4f" acquired by "delete_volume" :: waited 0.019s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:44:20 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[97bc3a5c-4468-4aeb-b221-43784dae04dc]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:44:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-632d56dd-150c-4cfa-a53b-923d8b8b9531 tempest-SnapshotDependencyTests-1779045608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:20 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f Jul 11 04:44:20 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:21 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-632d56dd-150c-4cfa-a53b-923d8b8b9531 tempest-SnapshotDependencyTests-1779045608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f" returned: 0 in 0.733s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-632d56dd-150c-4cfa-a53b-923d8b8b9531 tempest-SnapshotDependencyTests-1779045608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:21 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f Jul 11 04:44:21 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:22 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-632d56dd-150c-4cfa-a53b-923d8b8b9531 tempest-SnapshotDependencyTests-1779045608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-e800f363-ba81-4fb7-b89c-59a704a4dd4f" returned: 0 in 0.627s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:22 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-632d56dd-150c-4cfa-a53b-923d8b8b9531 tempest-SnapshotDependencyTests-1779045608 None] Lock "cinder-quobyte-e800f363-ba81-4fb7-b89c-59a704a4dd4f" released by "delete_volume" :: held 1.418s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:44:22 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-632d56dd-150c-4cfa-a53b-923d8b8b9531 tempest-SnapshotDependencyTests-1779045608 None] Created reservations ['f3f13510-9251-45f1-b810-101ce539374a', 'c30d3066-aaab-4277-a808-38000999bb70', '0fb25bbe-500b-41ce-8bb0-57e8e9c09db6', '45f61845-c7a8-4254-9b54-4e623b94237b'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:44:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-632d56dd-150c-4cfa-a53b-923d8b8b9531 tempest-SnapshotDependencyTests-1779045608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:44:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-632d56dd-150c-4cfa-a53b-923d8b8b9531 tempest-SnapshotDependencyTests-1779045608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:44:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-632d56dd-150c-4cfa-a53b-923d8b8b9531 tempest-SnapshotDependencyTests-1779045608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:44:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-632d56dd-150c-4cfa-a53b-923d8b8b9531 tempest-SnapshotDependencyTests-1779045608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:44:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-632d56dd-150c-4cfa-a53b-923d8b8b9531 tempest-SnapshotDependencyTests-1779045608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:44:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-632d56dd-150c-4cfa-a53b-923d8b8b9531 tempest-SnapshotDependencyTests-1779045608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:22 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:44:22 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:23 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b8f888c0-3f85-44f7-b5b8-dffd37fe45d4 tempest-SnapshotDependencyTests-1779045608 None] Acquiring lock "cinder-fd1984e8-0a40-4b7f-ae1d-02db8299097a-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:44:23 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b8f888c0-3f85-44f7-b5b8-dffd37fe45d4 tempest-SnapshotDependencyTests-1779045608 None] Lock "cinder-fd1984e8-0a40-4b7f-ae1d-02db8299097a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:44:23 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-632d56dd-150c-4cfa-a53b-923d8b8b9531 tempest-SnapshotDependencyTests-1779045608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.662s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:23 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-632d56dd-150c-4cfa-a53b-923d8b8b9531 tempest-SnapshotDependencyTests-1779045608 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:44:23 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-632d56dd-150c-4cfa-a53b-923d8b8b9531 tempest-SnapshotDependencyTests-1779045608 None] Deleted volume successfully. Jul 11 04:44:23 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b8f888c0-3f85-44f7-b5b8-dffd37fe45d4 tempest-SnapshotDependencyTests-1779045608 None] Acquiring lock "cinder-quobyte-fd1984e8-0a40-4b7f-ae1d-02db8299097a" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:44:23 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-632d56dd-150c-4cfa-a53b-923d8b8b9531 tempest-SnapshotDependencyTests-1779045608 None] Lock "cinder-e800f363-ba81-4fb7-b89c-59a704a4dd4f-delete_volume" released by "delete_volume" :: held 2.291s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:44:23 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b8f888c0-3f85-44f7-b5b8-dffd37fe45d4 tempest-SnapshotDependencyTests-1779045608 None] Lock "cinder-quobyte-fd1984e8-0a40-4b7f-ae1d-02db8299097a" acquired by "delete_volume" :: waited 0.016s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:44:23 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbad6d9-1226-403c-ac7e-9bd5532caee0]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:44:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b8f888c0-3f85-44f7-b5b8-dffd37fe45d4 tempest-SnapshotDependencyTests-1779045608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd1984e8-0a40-4b7f-ae1d-02db8299097a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:23 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd1984e8-0a40-4b7f-ae1d-02db8299097a Jul 11 04:44:23 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:23 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b8f888c0-3f85-44f7-b5b8-dffd37fe45d4 tempest-SnapshotDependencyTests-1779045608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd1984e8-0a40-4b7f-ae1d-02db8299097a" returned: 0 in 0.725s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b8f888c0-3f85-44f7-b5b8-dffd37fe45d4 tempest-SnapshotDependencyTests-1779045608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd1984e8-0a40-4b7f-ae1d-02db8299097a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:23 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd1984e8-0a40-4b7f-ae1d-02db8299097a Jul 11 04:44:23 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:24 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b8f888c0-3f85-44f7-b5b8-dffd37fe45d4 tempest-SnapshotDependencyTests-1779045608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd1984e8-0a40-4b7f-ae1d-02db8299097a" returned: 0 in 0.619s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:24 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b8f888c0-3f85-44f7-b5b8-dffd37fe45d4 tempest-SnapshotDependencyTests-1779045608 None] Lock "cinder-quobyte-fd1984e8-0a40-4b7f-ae1d-02db8299097a" released by "delete_volume" :: held 1.382s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:44:24 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-b8f888c0-3f85-44f7-b5b8-dffd37fe45d4 tempest-SnapshotDependencyTests-1779045608 None] Created reservations ['c12cff40-8b7b-4cd3-937f-f6a000098be8', 'df44cdbe-80c2-448a-8150-21dd260a266e', 'd8200c04-92bd-4393-9c2c-a14bcd387c5f', 'edc03c48-4ae3-452c-8049-5ff1ac6835af'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:44:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b8f888c0-3f85-44f7-b5b8-dffd37fe45d4 tempest-SnapshotDependencyTests-1779045608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:44:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b8f888c0-3f85-44f7-b5b8-dffd37fe45d4 tempest-SnapshotDependencyTests-1779045608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:44:24 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b8f888c0-3f85-44f7-b5b8-dffd37fe45d4 tempest-SnapshotDependencyTests-1779045608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:44:24 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b8f888c0-3f85-44f7-b5b8-dffd37fe45d4 tempest-SnapshotDependencyTests-1779045608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:44:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b8f888c0-3f85-44f7-b5b8-dffd37fe45d4 tempest-SnapshotDependencyTests-1779045608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:44:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b8f888c0-3f85-44f7-b5b8-dffd37fe45d4 tempest-SnapshotDependencyTests-1779045608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:24 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:44:24 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:25 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b8f888c0-3f85-44f7-b5b8-dffd37fe45d4 tempest-SnapshotDependencyTests-1779045608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.613s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:25 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-b8f888c0-3f85-44f7-b5b8-dffd37fe45d4 tempest-SnapshotDependencyTests-1779045608 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:44:25 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-b8f888c0-3f85-44f7-b5b8-dffd37fe45d4 tempest-SnapshotDependencyTests-1779045608 None] Deleted volume successfully. Jul 11 04:44:25 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b8f888c0-3f85-44f7-b5b8-dffd37fe45d4 tempest-SnapshotDependencyTests-1779045608 None] Lock "cinder-fd1984e8-0a40-4b7f-ae1d-02db8299097a-delete_volume" released by "delete_volume" :: held 2.195s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:44:34 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=72,cinder:INSERT=27,cinder:UPDATE=113,cinder:DELETE=9 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:44:35 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=73,cinder:INSERT=26,cinder:UPDATE=105,cinder:DELETE=8 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:44:43 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dcfc0ae-4ed1-4f3c-ab4e-754eda2db94f tempest-CreateVolumesFromSnapshotTest-469897697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:44:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0dcfc0ae-4ed1-4f3c-ab4e-754eda2db94f tempest-CreateVolumesFromSnapshotTest-469897697 None] Flow 'volume_create_manager' (eaca668c-b7f3-4dc7-873b-d098311db5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:44:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0dcfc0ae-4ed1-4f3c-ab4e-754eda2db94f tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7722cb4e-073a-44a6-b051-773f886fec90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0dcfc0ae-4ed1-4f3c-ab4e-754eda2db94f tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7722cb4e-073a-44a6-b051-773f886fec90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:44:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1789704225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45e42e77-7def-4a6f-b84c-a677dcc8bbda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3674310985ed4178a2da2b95ec0adb67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:44:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:44:43Z,use_quota=True,user_id='a9770df9eb0d417c8e5e8c4d78e3316d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0dcfc0ae-4ed1-4f3c-ab4e-754eda2db94f tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7642eefc-bcfe-4a12-addf-2f0d46dafb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0dcfc0ae-4ed1-4f3c-ab4e-754eda2db94f tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7642eefc-bcfe-4a12-addf-2f0d46dafb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0dcfc0ae-4ed1-4f3c-ab4e-754eda2db94f tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ece3574-b7a4-4fc7-b05e-6b1027871d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0dcfc0ae-4ed1-4f3c-ab4e-754eda2db94f tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ece3574-b7a4-4fc7-b05e-6b1027871d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45e42e77-7def-4a6f-b84c-a677dcc8bbda', 'volume_name': 'volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0dcfc0ae-4ed1-4f3c-ab4e-754eda2db94f tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67bc025c-1eb7-4c07-9add-9b361e04bce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0dcfc0ae-4ed1-4f3c-ab4e-754eda2db94f tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67bc025c-1eb7-4c07-9add-9b361e04bce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0dcfc0ae-4ed1-4f3c-ab4e-754eda2db94f tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f6514f2-b11a-4225-9133-0c6aa14c1ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:43 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-0dcfc0ae-4ed1-4f3c-ab4e-754eda2db94f tempest-CreateVolumesFromSnapshotTest-469897697 None] Volume 45e42e77-7def-4a6f-b84c-a677dcc8bbda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda', 'volume_size': 1} Jul 11 04:44:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-0dcfc0ae-4ed1-4f3c-ab4e-754eda2db94f tempest-CreateVolumesFromSnapshotTest-469897697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:44:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-0dcfc0ae-4ed1-4f3c-ab4e-754eda2db94f tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:44:43 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-0dcfc0ae-4ed1-4f3c-ab4e-754eda2db94f tempest-CreateVolumesFromSnapshotTest-469897697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:44:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1789704225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45e42e77-7def-4a6f-b84c-a677dcc8bbda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3674310985ed4178a2da2b95ec0adb67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:44:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:44:43Z,use_quota=True,user_id='a9770df9eb0d417c8e5e8c4d78e3316d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:44:43 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-0dcfc0ae-4ed1-4f3c-ab4e-754eda2db94f tempest-CreateVolumesFromSnapshotTest-469897697 None] Creating volume 45e42e77-7def-4a6f-b84c-a677dcc8bbda {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:44:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-0dcfc0ae-4ed1-4f3c-ab4e-754eda2db94f tempest-CreateVolumesFromSnapshotTest-469897697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:44:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-0dcfc0ae-4ed1-4f3c-ab4e-754eda2db94f tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:44:43 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-0dcfc0ae-4ed1-4f3c-ab4e-754eda2db94f tempest-CreateVolumesFromSnapshotTest-469897697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:44:43 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-0dcfc0ae-4ed1-4f3c-ab4e-754eda2db94f tempest-CreateVolumesFromSnapshotTest-469897697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:44:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-0dcfc0ae-4ed1-4f3c-ab4e-754eda2db94f tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:44:43 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-0dcfc0ae-4ed1-4f3c-ab4e-754eda2db94f tempest-CreateVolumesFromSnapshotTest-469897697 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:44:43 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-0dcfc0ae-4ed1-4f3c-ab4e-754eda2db94f tempest-CreateVolumesFromSnapshotTest-469897697 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:44:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-0dcfc0ae-4ed1-4f3c-ab4e-754eda2db94f tempest-CreateVolumesFromSnapshotTest-469897697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:43 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda 1073741824 Jul 11 04:44:43 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:43 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-31bcfd65-ea44-43aa-8317-e690af6e6e03 tempest-CreateVolumesFromImageTest-1045884161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:44:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31bcfd65-ea44-43aa-8317-e690af6e6e03 tempest-CreateVolumesFromImageTest-1045884161 None] Flow 'volume_create_manager' (d1e4f431-125c-4225-b5c6-10a5af6fbbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:44:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31bcfd65-ea44-43aa-8317-e690af6e6e03 tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88adf1ac-c672-4ab1-a9ec-ff1379c0afbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31bcfd65-ea44-43aa-8317-e690af6e6e03 tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88adf1ac-c672-4ab1-a9ec-ff1379c0afbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:44:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-235152693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff66446c-a262-4c52-ac6e-657e0f338f6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b1a969256c4a828fc515bca28512c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:44:44Z,use_quota=True,user_id='4f37298b4f87495aa4b8d66d0a759907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31bcfd65-ea44-43aa-8317-e690af6e6e03 tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a90e2087-5458-425d-94c3-e6119f13c7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31bcfd65-ea44-43aa-8317-e690af6e6e03 tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a90e2087-5458-425d-94c3-e6119f13c7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31bcfd65-ea44-43aa-8317-e690af6e6e03 tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e48153-ed79-4082-bec7-ddd34cf24e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31bcfd65-ea44-43aa-8317-e690af6e6e03 tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e48153-ed79-4082-bec7-ddd34cf24e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff66446c-a262-4c52-ac6e-657e0f338f6c', 'volume_name': 'volume-ff66446c-a262-4c52-ac6e-657e0f338f6c', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31bcfd65-ea44-43aa-8317-e690af6e6e03 tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3165dd1c-8566-47c8-8ab1-60e0210f0c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31bcfd65-ea44-43aa-8317-e690af6e6e03 tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3165dd1c-8566-47c8-8ab1-60e0210f0c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31bcfd65-ea44-43aa-8317-e690af6e6e03 tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (164f3fca-2d1a-4e1d-9df6-36cbde46a1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:43 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-31bcfd65-ea44-43aa-8317-e690af6e6e03 tempest-CreateVolumesFromImageTest-1045884161 None] Volume ff66446c-a262-4c52-ac6e-657e0f338f6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff66446c-a262-4c52-ac6e-657e0f338f6c', 'volume_size': 1} Jul 11 04:44:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-31bcfd65-ea44-43aa-8317-e690af6e6e03 tempest-CreateVolumesFromImageTest-1045884161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:44:44 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ff68449-414c-4adf-aa94-21a9ab1461fc tempest-CreateVolumesFromImageTest-1045884161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:44:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3ff68449-414c-4adf-aa94-21a9ab1461fc tempest-CreateVolumesFromImageTest-1045884161 None] Flow 'volume_create_manager' (0032e95d-d5fe-42c9-8297-a76aef714124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:44:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3ff68449-414c-4adf-aa94-21a9ab1461fc tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ef79af1-c934-40be-8d08-f853950435e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3ff68449-414c-4adf-aa94-21a9ab1461fc tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ef79af1-c934-40be-8d08-f853950435e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:44:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-525626465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff8396e6-27a8-476d-b72b-33e0dd762713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b1a969256c4a828fc515bca28512c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:44:44Z,use_quota=True,user_id='4f37298b4f87495aa4b8d66d0a759907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3ff68449-414c-4adf-aa94-21a9ab1461fc tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d32e018-4277-4207-9d19-7f8616deeb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3ff68449-414c-4adf-aa94-21a9ab1461fc tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d32e018-4277-4207-9d19-7f8616deeb97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3ff68449-414c-4adf-aa94-21a9ab1461fc tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01dd9700-ec90-44d1-a39e-b61047e74f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3ff68449-414c-4adf-aa94-21a9ab1461fc tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01dd9700-ec90-44d1-a39e-b61047e74f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff8396e6-27a8-476d-b72b-33e0dd762713', 'volume_name': 'volume-ff8396e6-27a8-476d-b72b-33e0dd762713', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3ff68449-414c-4adf-aa94-21a9ab1461fc tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52ca0419-d587-4a13-aa05-fbba8e23b9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3ff68449-414c-4adf-aa94-21a9ab1461fc tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52ca0419-d587-4a13-aa05-fbba8e23b9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3ff68449-414c-4adf-aa94-21a9ab1461fc tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb1c1d87-f432-4060-adc8-07715cbc95a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:44 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-3ff68449-414c-4adf-aa94-21a9ab1461fc tempest-CreateVolumesFromImageTest-1045884161 None] Volume ff8396e6-27a8-476d-b72b-33e0dd762713: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff8396e6-27a8-476d-b72b-33e0dd762713', 'volume_size': 1} Jul 11 04:44:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3ff68449-414c-4adf-aa94-21a9ab1461fc tempest-CreateVolumesFromImageTest-1045884161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:44:44 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-7649cddc-a9ee-4990-8f8c-65c05d1c0bb2 tempest-CreateVolumesFromImageTest-1045884161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:44:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7649cddc-a9ee-4990-8f8c-65c05d1c0bb2 tempest-CreateVolumesFromImageTest-1045884161 None] Flow 'volume_create_manager' (31e01cff-177a-4cf7-a874-22af1e0bf1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:44:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7649cddc-a9ee-4990-8f8c-65c05d1c0bb2 tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b94287a9-9632-4a60-aa31-c34ef5fafa75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7649cddc-a9ee-4990-8f8c-65c05d1c0bb2 tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b94287a9-9632-4a60-aa31-c34ef5fafa75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1071165076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed915e19-8502-4078-82d4-5751d0035f69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b1a969256c4a828fc515bca28512c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:44:45Z,use_quota=True,user_id='4f37298b4f87495aa4b8d66d0a759907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7649cddc-a9ee-4990-8f8c-65c05d1c0bb2 tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24a6a56f-3831-4740-ab73-9ed4e874fc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7649cddc-a9ee-4990-8f8c-65c05d1c0bb2 tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24a6a56f-3831-4740-ab73-9ed4e874fc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7649cddc-a9ee-4990-8f8c-65c05d1c0bb2 tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1836f537-6a49-43eb-a4a8-846adf1b1af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7649cddc-a9ee-4990-8f8c-65c05d1c0bb2 tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1836f537-6a49-43eb-a4a8-846adf1b1af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed915e19-8502-4078-82d4-5751d0035f69', 'volume_name': 'volume-ed915e19-8502-4078-82d4-5751d0035f69', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7649cddc-a9ee-4990-8f8c-65c05d1c0bb2 tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60b961ec-1eaf-49d4-bf87-61eb1f14d347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7649cddc-a9ee-4990-8f8c-65c05d1c0bb2 tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60b961ec-1eaf-49d4-bf87-61eb1f14d347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:44 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7649cddc-a9ee-4990-8f8c-65c05d1c0bb2 tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (015f29a5-c7df-4c33-9408-fb9c1cfe42c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:44 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-7649cddc-a9ee-4990-8f8c-65c05d1c0bb2 tempest-CreateVolumesFromImageTest-1045884161 None] Volume ed915e19-8502-4078-82d4-5751d0035f69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed915e19-8502-4078-82d4-5751d0035f69', 'volume_size': 1} Jul 11 04:44:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7649cddc-a9ee-4990-8f8c-65c05d1c0bb2 tempest-CreateVolumesFromImageTest-1045884161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:44:44 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-0dcfc0ae-4ed1-4f3c-ab4e-754eda2db94f tempest-CreateVolumesFromSnapshotTest-469897697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda 1073741824" returned: 0 in 1.128s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-0dcfc0ae-4ed1-4f3c-ab4e-754eda2db94f tempest-CreateVolumesFromSnapshotTest-469897697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:44 devstack sudo[105790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda Jul 11 04:44:44 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-70c88d9a-8ab7-45ec-8728-e30deabf62db tempest-CreateVolumesFromImageTest-1045884161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-70c88d9a-8ab7-45ec-8728-e30deabf62db tempest-CreateVolumesFromImageTest-1045884161 None] Flow 'volume_create_manager' (93889635-248b-43e7-b902-f1b181685db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-70c88d9a-8ab7-45ec-8728-e30deabf62db tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9ce5a20-cc75-4a25-9283-c98b386fce44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-70c88d9a-8ab7-45ec-8728-e30deabf62db tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9ce5a20-cc75-4a25-9283-c98b386fce44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:44:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-242933949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9295b5de-4519-4b84-8882-2e9a88594061,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b1a969256c4a828fc515bca28512c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:44:45Z,use_quota=True,user_id='4f37298b4f87495aa4b8d66d0a759907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-70c88d9a-8ab7-45ec-8728-e30deabf62db tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (128af02b-60d1-4c33-8830-d0c3ad731992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-70c88d9a-8ab7-45ec-8728-e30deabf62db tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (128af02b-60d1-4c33-8830-d0c3ad731992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-70c88d9a-8ab7-45ec-8728-e30deabf62db tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fe7426c-0ec4-42db-85f2-2ddb7c0b84b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-70c88d9a-8ab7-45ec-8728-e30deabf62db tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fe7426c-0ec4-42db-85f2-2ddb7c0b84b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9295b5de-4519-4b84-8882-2e9a88594061', 'volume_name': 'volume-9295b5de-4519-4b84-8882-2e9a88594061', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-70c88d9a-8ab7-45ec-8728-e30deabf62db tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b8286f7-b18e-4e37-b575-f3f63ab7efcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-70c88d9a-8ab7-45ec-8728-e30deabf62db tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b8286f7-b18e-4e37-b575-f3f63ab7efcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-70c88d9a-8ab7-45ec-8728-e30deabf62db tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dbd39c7-b0f5-43bf-9f1a-3a8fa7593e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:45 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-70c88d9a-8ab7-45ec-8728-e30deabf62db tempest-CreateVolumesFromImageTest-1045884161 None] Volume 9295b5de-4519-4b84-8882-2e9a88594061: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9295b5de-4519-4b84-8882-2e9a88594061', 'volume_size': 1} Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-70c88d9a-8ab7-45ec-8728-e30deabf62db tempest-CreateVolumesFromImageTest-1045884161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:44:45 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-0dcfc0ae-4ed1-4f3c-ab4e-754eda2db94f tempest-CreateVolumesFromSnapshotTest-469897697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda" returned: 0 in 0.764s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-0dcfc0ae-4ed1-4f3c-ab4e-754eda2db94f tempest-CreateVolumesFromSnapshotTest-469897697 None] <== create_volume: return (1951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-0dcfc0ae-4ed1-4f3c-ab4e-754eda2db94f tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.952s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-31bcfd65-ea44-43aa-8317-e690af6e6e03 tempest-CreateVolumesFromImageTest-1045884161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.740s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-31bcfd65-ea44-43aa-8317-e690af6e6e03 tempest-CreateVolumesFromImageTest-1045884161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:44:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-235152693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff66446c-a262-4c52-ac6e-657e0f338f6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b1a969256c4a828fc515bca28512c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:44:44Z,use_quota=True,user_id='4f37298b4f87495aa4b8d66d0a759907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-31bcfd65-ea44-43aa-8317-e690af6e6e03 tempest-CreateVolumesFromImageTest-1045884161 None] Creating volume ff66446c-a262-4c52-ac6e-657e0f338f6c {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-31bcfd65-ea44-43aa-8317-e690af6e6e03 tempest-CreateVolumesFromImageTest-1045884161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-31bcfd65-ea44-43aa-8317-e690af6e6e03 tempest-CreateVolumesFromImageTest-1045884161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-31bcfd65-ea44-43aa-8317-e690af6e6e03 tempest-CreateVolumesFromImageTest-1045884161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-31bcfd65-ea44-43aa-8317-e690af6e6e03 tempest-CreateVolumesFromImageTest-1045884161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-31bcfd65-ea44-43aa-8317-e690af6e6e03 tempest-CreateVolumesFromImageTest-1045884161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-31bcfd65-ea44-43aa-8317-e690af6e6e03 tempest-CreateVolumesFromImageTest-1045884161 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:44:45 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-31bcfd65-ea44-43aa-8317-e690af6e6e03 tempest-CreateVolumesFromImageTest-1045884161 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-31bcfd65-ea44-43aa-8317-e690af6e6e03 tempest-CreateVolumesFromImageTest-1045884161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ff66446c-a262-4c52-ac6e-657e0f338f6c 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:45 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ff66446c-a262-4c52-ac6e-657e0f338f6c 1073741824 Jul 11 04:44:45 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0dcfc0ae-4ed1-4f3c-ab4e-754eda2db94f tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f6514f2-b11a-4225-9133-0c6aa14c1ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0dcfc0ae-4ed1-4f3c-ab4e-754eda2db94f tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (420c0414-9c72-4151-8152-a2699134391f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:45 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-0dcfc0ae-4ed1-4f3c-ab4e-754eda2db94f tempest-CreateVolumesFromSnapshotTest-469897697 None] Volume volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda (45e42e77-7def-4a6f-b84c-a677dcc8bbda): created successfully Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0dcfc0ae-4ed1-4f3c-ab4e-754eda2db94f tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (420c0414-9c72-4151-8152-a2699134391f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0dcfc0ae-4ed1-4f3c-ab4e-754eda2db94f tempest-CreateVolumesFromSnapshotTest-469897697 None] Flow 'volume_create_manager' (eaca668c-b7f3-4dc7-873b-d098311db5c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-726218ef-ed1a-4c86-aa16-763970738ba4 tempest-CreateVolumesFromImageTest-1045884161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-726218ef-ed1a-4c86-aa16-763970738ba4 tempest-CreateVolumesFromImageTest-1045884161 None] Flow 'volume_create_manager' (d4e5bf8b-b13a-48d7-8b53-c05e0dc0dad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-726218ef-ed1a-4c86-aa16-763970738ba4 tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6721bc56-3865-4bcd-8e63-de0532e4253d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:45 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-0dcfc0ae-4ed1-4f3c-ab4e-754eda2db94f tempest-CreateVolumesFromSnapshotTest-469897697 None] Created volume successfully. Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-726218ef-ed1a-4c86-aa16-763970738ba4 tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6721bc56-3865-4bcd-8e63-de0532e4253d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:44:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2748110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67d29009-643b-4197-bc54-eb85d146377f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b1a969256c4a828fc515bca28512c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:44:46Z,use_quota=True,user_id='4f37298b4f87495aa4b8d66d0a759907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-726218ef-ed1a-4c86-aa16-763970738ba4 tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7abac8e0-620f-421e-9ae4-1d645ee9567f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-726218ef-ed1a-4c86-aa16-763970738ba4 tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7abac8e0-620f-421e-9ae4-1d645ee9567f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-726218ef-ed1a-4c86-aa16-763970738ba4 tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57ccd777-2269-45d4-b10b-73c9771cb5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-726218ef-ed1a-4c86-aa16-763970738ba4 tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57ccd777-2269-45d4-b10b-73c9771cb5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67d29009-643b-4197-bc54-eb85d146377f', 'volume_name': 'volume-67d29009-643b-4197-bc54-eb85d146377f', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-726218ef-ed1a-4c86-aa16-763970738ba4 tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae68c0b-4175-483d-b083-672b3fb10b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-726218ef-ed1a-4c86-aa16-763970738ba4 tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae68c0b-4175-483d-b083-672b3fb10b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-726218ef-ed1a-4c86-aa16-763970738ba4 tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ba2de0-fd1e-4535-9067-de39264e5a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:45 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-726218ef-ed1a-4c86-aa16-763970738ba4 tempest-CreateVolumesFromImageTest-1045884161 None] Volume 67d29009-643b-4197-bc54-eb85d146377f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67d29009-643b-4197-bc54-eb85d146377f', 'volume_size': 1} Jul 11 04:44:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-726218ef-ed1a-4c86-aa16-763970738ba4 tempest-CreateVolumesFromImageTest-1045884161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:44:46 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-31bcfd65-ea44-43aa-8317-e690af6e6e03 tempest-CreateVolumesFromImageTest-1045884161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ff66446c-a262-4c52-ac6e-657e0f338f6c 1073741824" returned: 0 in 1.066s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-31bcfd65-ea44-43aa-8317-e690af6e6e03 tempest-CreateVolumesFromImageTest-1045884161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ff66446c-a262-4c52-ac6e-657e0f338f6c {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:46 devstack sudo[105800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ff66446c-a262-4c52-ac6e-657e0f338f6c Jul 11 04:44:46 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-220172ad-0095-4469-a509-cbee0a0763e2 tempest-CreateVolumesFromSnapshotTest-469897697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:44:47 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-31bcfd65-ea44-43aa-8317-e690af6e6e03 tempest-CreateVolumesFromImageTest-1045884161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ff66446c-a262-4c52-ac6e-657e0f338f6c" returned: 0 in 0.769s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:47 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-31bcfd65-ea44-43aa-8317-e690af6e6e03 tempest-CreateVolumesFromImageTest-1045884161 None] <== create_volume: return (1889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:44:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-31bcfd65-ea44-43aa-8317-e690af6e6e03 tempest-CreateVolumesFromImageTest-1045884161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.892s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:44:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3ff68449-414c-4adf-aa94-21a9ab1461fc tempest-CreateVolumesFromImageTest-1045884161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.286s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:44:47 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-3ff68449-414c-4adf-aa94-21a9ab1461fc tempest-CreateVolumesFromImageTest-1045884161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:44:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-525626465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff8396e6-27a8-476d-b72b-33e0dd762713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b1a969256c4a828fc515bca28512c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:44:44Z,use_quota=True,user_id='4f37298b4f87495aa4b8d66d0a759907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:44:47 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-3ff68449-414c-4adf-aa94-21a9ab1461fc tempest-CreateVolumesFromImageTest-1045884161 None] Creating volume ff8396e6-27a8-476d-b72b-33e0dd762713 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:44:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3ff68449-414c-4adf-aa94-21a9ab1461fc tempest-CreateVolumesFromImageTest-1045884161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:44:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3ff68449-414c-4adf-aa94-21a9ab1461fc tempest-CreateVolumesFromImageTest-1045884161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:44:47 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-3ff68449-414c-4adf-aa94-21a9ab1461fc tempest-CreateVolumesFromImageTest-1045884161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:44:47 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-3ff68449-414c-4adf-aa94-21a9ab1461fc tempest-CreateVolumesFromImageTest-1045884161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:44:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3ff68449-414c-4adf-aa94-21a9ab1461fc tempest-CreateVolumesFromImageTest-1045884161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:44:47 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-3ff68449-414c-4adf-aa94-21a9ab1461fc tempest-CreateVolumesFromImageTest-1045884161 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:44:47 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-3ff68449-414c-4adf-aa94-21a9ab1461fc tempest-CreateVolumesFromImageTest-1045884161 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:44:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3ff68449-414c-4adf-aa94-21a9ab1461fc tempest-CreateVolumesFromImageTest-1045884161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ff8396e6-27a8-476d-b72b-33e0dd762713 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:47 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31bcfd65-ea44-43aa-8317-e690af6e6e03 tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (164f3fca-2d1a-4e1d-9df6-36cbde46a1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff66446c-a262-4c52-ac6e-657e0f338f6c', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:47 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31bcfd65-ea44-43aa-8317-e690af6e6e03 tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b0bd522-b282-44fc-8eaa-20c9fee5322a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:47 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ff8396e6-27a8-476d-b72b-33e0dd762713 1073741824 Jul 11 04:44:47 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:47 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-31bcfd65-ea44-43aa-8317-e690af6e6e03 tempest-CreateVolumesFromImageTest-1045884161 None] Volume volume-ff66446c-a262-4c52-ac6e-657e0f338f6c (ff66446c-a262-4c52-ac6e-657e0f338f6c): created successfully Jul 11 04:44:47 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31bcfd65-ea44-43aa-8317-e690af6e6e03 tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b0bd522-b282-44fc-8eaa-20c9fee5322a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:47 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-31bcfd65-ea44-43aa-8317-e690af6e6e03 tempest-CreateVolumesFromImageTest-1045884161 None] Flow 'volume_create_manager' (d1e4f431-125c-4225-b5c6-10a5af6fbbca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:44:47 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-31bcfd65-ea44-43aa-8317-e690af6e6e03 tempest-CreateVolumesFromImageTest-1045884161 None] Created volume successfully. Jul 11 04:44:48 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:44:48 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Flow 'volume_create_manager' (a35a5884-20be-4c40-998b-56440d1effa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:44:48 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9caef82b-038a-4e3b-926d-6272f1d48ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:48 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9caef82b-038a-4e3b-926d-6272f1d48ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:44:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f040d668-6eab-4a0f-aae6-7400da201fd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e8c47d22e1e4b748bbed21a12bf959c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:44:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:44:48Z,use_quota=True,user_id='a37402ada2354485989fd398a6bae6db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2aac9c8d-9597-4805-970c-4ceb3daa9520),volume_type_id=2aac9c8d-9597-4805-970c-4ceb3daa9520)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:48 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d2606d8-f3b0-434f-bc73-216e314f151a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:48 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d2606d8-f3b0-434f-bc73-216e314f151a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:48 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90bc9fa8-da9c-4309-9cd5-42366bbadc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:48 devstack cinder-volume[86964]: DEBUG cinder.image.glance [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Creating Keystone auth plugin from conf {{(pid=86964) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 04:44:48 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3ff68449-414c-4adf-aa94-21a9ab1461fc tempest-CreateVolumesFromImageTest-1045884161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ff8396e6-27a8-476d-b72b-33e0dd762713 1073741824" returned: 0 in 0.972s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3ff68449-414c-4adf-aa94-21a9ab1461fc tempest-CreateVolumesFromImageTest-1045884161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ff8396e6-27a8-476d-b72b-33e0dd762713 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:48 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ff8396e6-27a8-476d-b72b-33e0dd762713 Jul 11 04:44:48 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:48 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90bc9fa8-da9c-4309-9cd5-42366bbadc16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f040d668-6eab-4a0f-aae6-7400da201fd1', 'volume_name': 'volume-f040d668-6eab-4a0f-aae6-7400da201fd1', 'volume_size': 1, 'image_id': 'ff7c4674-18e2-443f-9b29-69c93cb18a60', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ff7c4674-18e2-443f-9b29-69c93cb18a60', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1bab48c0aaba8ca5c29067e2bb6b582a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4e8c47d22e1e4b748bbed21a12bf959c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '548897437e986a836a8a30cda15126175050b9ea57147ea0360a698657576eba4314d33ae706e084f8d29dc98ee27d629e0ac7683f50457c28c7ba8792c02e36', 'id': 'ff7c4674-18e2-443f-9b29-69c93cb18a60', 'created_at': datetime.datetime(2026, 7, 11, 2, 44, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 44, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ff7c4674-18e2-443f-9b29-69c93cb18a60/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:48 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3dd0880-1fa4-4425-81eb-752021016662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:48 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3dd0880-1fa4-4425-81eb-752021016662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:48 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c284fb60-4021-4f7b-8b0c-a02e0e339b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:48 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Volume f040d668-6eab-4a0f-aae6-7400da201fd1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f040d668-6eab-4a0f-aae6-7400da201fd1', 'volume_size': 1, 'image_id': 'ff7c4674-18e2-443f-9b29-69c93cb18a60', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ff7c4674-18e2-443f-9b29-69c93cb18a60', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1bab48c0aaba8ca5c29067e2bb6b582a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4e8c47d22e1e4b748bbed21a12bf959c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '548897437e986a836a8a30cda15126175050b9ea57147ea0360a698657576eba4314d33ae706e084f8d29dc98ee27d629e0ac7683f50457c28c7ba8792c02e36', 'id': 'ff7c4674-18e2-443f-9b29-69c93cb18a60', 'created_at': datetime.datetime(2026, 7, 11, 2, 44, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 44, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ff7c4674-18e2-443f-9b29-69c93cb18a60/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 11 04:44:48 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Trying to clone f040d668-6eab-4a0f-aae6-7400da201fd1 from image ff7c4674-18e2-443f-9b29-69c93cb18a60 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ff7c4674-18e2-443f-9b29-69c93cb18a60', 'metadata': {}}]). {{(pid=86964) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 04:44:48 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ff7c4674-18e2-443f-9b29-69c93cb18a60_oqk2d9dedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86964) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 11 04:44:48 devstack cinder-volume[86964]: INFO cinder.image.image_utils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Image download 0.00 MB at 0.00 MB/s Jul 11 04:44:48 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed0c4be-85c8-4fd6-84c8-66b4117e1ef8]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:44:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff7c4674-18e2-443f-9b29-69c93cb18a60_oqk2d9dedevstack@QuobyteHD {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:48 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff7c4674-18e2-443f-9b29-69c93cb18a60_oqk2d9dedevstack@QuobyteHD Jul 11 04:44:48 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:49 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3ff68449-414c-4adf-aa94-21a9ab1461fc tempest-CreateVolumesFromImageTest-1045884161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ff8396e6-27a8-476d-b72b-33e0dd762713" returned: 0 in 0.764s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-3ff68449-414c-4adf-aa94-21a9ab1461fc tempest-CreateVolumesFromImageTest-1045884161 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:44:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3ff68449-414c-4adf-aa94-21a9ab1461fc tempest-CreateVolumesFromImageTest-1045884161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.788s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:44:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7649cddc-a9ee-4990-8f8c-65c05d1c0bb2 tempest-CreateVolumesFromImageTest-1045884161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.532s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:44:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7649cddc-a9ee-4990-8f8c-65c05d1c0bb2 tempest-CreateVolumesFromImageTest-1045884161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1071165076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed915e19-8502-4078-82d4-5751d0035f69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b1a969256c4a828fc515bca28512c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:44:45Z,use_quota=True,user_id='4f37298b4f87495aa4b8d66d0a759907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:44:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-7649cddc-a9ee-4990-8f8c-65c05d1c0bb2 tempest-CreateVolumesFromImageTest-1045884161 None] Creating volume ed915e19-8502-4078-82d4-5751d0035f69 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:44:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7649cddc-a9ee-4990-8f8c-65c05d1c0bb2 tempest-CreateVolumesFromImageTest-1045884161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:44:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7649cddc-a9ee-4990-8f8c-65c05d1c0bb2 tempest-CreateVolumesFromImageTest-1045884161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:44:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7649cddc-a9ee-4990-8f8c-65c05d1c0bb2 tempest-CreateVolumesFromImageTest-1045884161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:44:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7649cddc-a9ee-4990-8f8c-65c05d1c0bb2 tempest-CreateVolumesFromImageTest-1045884161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:44:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7649cddc-a9ee-4990-8f8c-65c05d1c0bb2 tempest-CreateVolumesFromImageTest-1045884161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:44:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7649cddc-a9ee-4990-8f8c-65c05d1c0bb2 tempest-CreateVolumesFromImageTest-1045884161 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:44:49 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-7649cddc-a9ee-4990-8f8c-65c05d1c0bb2 tempest-CreateVolumesFromImageTest-1045884161 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:44:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7649cddc-a9ee-4990-8f8c-65c05d1c0bb2 tempest-CreateVolumesFromImageTest-1045884161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ed915e19-8502-4078-82d4-5751d0035f69 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:49 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3ff68449-414c-4adf-aa94-21a9ab1461fc tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb1c1d87-f432-4060-adc8-07715cbc95a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff8396e6-27a8-476d-b72b-33e0dd762713', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:49 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ed915e19-8502-4078-82d4-5751d0035f69 1073741824 Jul 11 04:44:49 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:49 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3ff68449-414c-4adf-aa94-21a9ab1461fc tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29f6f113-a6c0-4861-8854-6563e1cdc017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:49 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-3ff68449-414c-4adf-aa94-21a9ab1461fc tempest-CreateVolumesFromImageTest-1045884161 None] Volume volume-ff8396e6-27a8-476d-b72b-33e0dd762713 (ff8396e6-27a8-476d-b72b-33e0dd762713): created successfully Jul 11 04:44:49 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3ff68449-414c-4adf-aa94-21a9ab1461fc tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29f6f113-a6c0-4861-8854-6563e1cdc017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:49 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3ff68449-414c-4adf-aa94-21a9ab1461fc tempest-CreateVolumesFromImageTest-1045884161 None] Flow 'volume_create_manager' (0032e95d-d5fe-42c9-8297-a76aef714124) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:44:49 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-3ff68449-414c-4adf-aa94-21a9ab1461fc tempest-CreateVolumesFromImageTest-1045884161 None] Created volume successfully. Jul 11 04:44:49 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff7c4674-18e2-443f-9b29-69c93cb18a60_oqk2d9dedevstack@QuobyteHD" returned: 0 in 0.783s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff7c4674-18e2-443f-9b29-69c93cb18a60_oqk2d9dedevstack@QuobyteHD {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:49 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff7c4674-18e2-443f-9b29-69c93cb18a60_oqk2d9dedevstack@QuobyteHD Jul 11 04:44:49 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:49 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff5ef96b-2fa0-4bd3-a914-b1397de569d3 tempest-ProjectReaderTests-787132287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:44:49 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ff5ef96b-2fa0-4bd3-a914-b1397de569d3 tempest-ProjectReaderTests-787132287 None] Flow 'volume_create_manager' (e309d80f-82ab-4384-8d04-0debdae009e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:44:49 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ff5ef96b-2fa0-4bd3-a914-b1397de569d3 tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71041bff-397d-4c5c-b228-6374f7f136c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:49 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ff5ef96b-2fa0-4bd3-a914-b1397de569d3 tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71041bff-397d-4c5c-b228-6374f7f136c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-591070017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99206423-1e47-40d7-96b7-49c8ae6f75c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36dcca031e5d4245aed8aadd7b6f88e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:44:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:44:50Z,use_quota=True,user_id='ee6e4107301b44a98a0fdd41aead55f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:50 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ff5ef96b-2fa0-4bd3-a914-b1397de569d3 tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acfc5b1c-9d5b-4f1d-be3b-6c7ce7efe41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:50 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ff5ef96b-2fa0-4bd3-a914-b1397de569d3 tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acfc5b1c-9d5b-4f1d-be3b-6c7ce7efe41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:50 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ff5ef96b-2fa0-4bd3-a914-b1397de569d3 tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a97afad-b4e2-467d-98c6-32ababf6e3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:50 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ff5ef96b-2fa0-4bd3-a914-b1397de569d3 tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a97afad-b4e2-467d-98c6-32ababf6e3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99206423-1e47-40d7-96b7-49c8ae6f75c5', 'volume_name': 'volume-99206423-1e47-40d7-96b7-49c8ae6f75c5', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:50 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ff5ef96b-2fa0-4bd3-a914-b1397de569d3 tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f36e4e7f-101b-4a5e-a3e4-b8c422a4c5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:50 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ff5ef96b-2fa0-4bd3-a914-b1397de569d3 tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f36e4e7f-101b-4a5e-a3e4-b8c422a4c5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:50 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ff5ef96b-2fa0-4bd3-a914-b1397de569d3 tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec2282c-83e4-48e3-85c1-d22ecd86e214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:50 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-ff5ef96b-2fa0-4bd3-a914-b1397de569d3 tempest-ProjectReaderTests-787132287 None] Volume 99206423-1e47-40d7-96b7-49c8ae6f75c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99206423-1e47-40d7-96b7-49c8ae6f75c5', 'volume_size': 1} Jul 11 04:44:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ff5ef96b-2fa0-4bd3-a914-b1397de569d3 tempest-ProjectReaderTests-787132287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:44:50 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7649cddc-a9ee-4990-8f8c-65c05d1c0bb2 tempest-CreateVolumesFromImageTest-1045884161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ed915e19-8502-4078-82d4-5751d0035f69 1073741824" returned: 0 in 0.909s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7649cddc-a9ee-4990-8f8c-65c05d1c0bb2 tempest-CreateVolumesFromImageTest-1045884161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ed915e19-8502-4078-82d4-5751d0035f69 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:50 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ed915e19-8502-4078-82d4-5751d0035f69 Jul 11 04:44:50 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:50 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff7c4674-18e2-443f-9b29-69c93cb18a60_oqk2d9dedevstack@QuobyteHD" returned: 1 in 0.794s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff7c4674-18e2-443f-9b29-69c93cb18a60_oqk2d9dedevstack@QuobyteHD' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:44:50 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Temporary image ff7c4674-18e2-443f-9b29-69c93cb18a60 is fetched for user a37402ada2354485989fd398a6bae6db. {{(pid=86964) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 11 04:44:50 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ff6bd9-0650-4638-a101-660638d6aa42]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:44:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff7c4674-18e2-443f-9b29-69c93cb18a60_oqk2d9dedevstack@QuobyteHD {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:50 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff7c4674-18e2-443f-9b29-69c93cb18a60_oqk2d9dedevstack@QuobyteHD Jul 11 04:44:50 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:50 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7649cddc-a9ee-4990-8f8c-65c05d1c0bb2 tempest-CreateVolumesFromImageTest-1045884161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ed915e19-8502-4078-82d4-5751d0035f69" returned: 0 in 0.645s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:50 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7649cddc-a9ee-4990-8f8c-65c05d1c0bb2 tempest-CreateVolumesFromImageTest-1045884161 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:44:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7649cddc-a9ee-4990-8f8c-65c05d1c0bb2 tempest-CreateVolumesFromImageTest-1045884161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:44:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-70c88d9a-8ab7-45ec-8728-e30deabf62db tempest-CreateVolumesFromImageTest-1045884161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.576s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:44:50 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-70c88d9a-8ab7-45ec-8728-e30deabf62db tempest-CreateVolumesFromImageTest-1045884161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:44:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-242933949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9295b5de-4519-4b84-8882-2e9a88594061,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b1a969256c4a828fc515bca28512c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:44:45Z,use_quota=True,user_id='4f37298b4f87495aa4b8d66d0a759907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:44:50 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-70c88d9a-8ab7-45ec-8728-e30deabf62db tempest-CreateVolumesFromImageTest-1045884161 None] Creating volume 9295b5de-4519-4b84-8882-2e9a88594061 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:44:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-70c88d9a-8ab7-45ec-8728-e30deabf62db tempest-CreateVolumesFromImageTest-1045884161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:44:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-70c88d9a-8ab7-45ec-8728-e30deabf62db tempest-CreateVolumesFromImageTest-1045884161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:44:50 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-70c88d9a-8ab7-45ec-8728-e30deabf62db tempest-CreateVolumesFromImageTest-1045884161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:44:50 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-70c88d9a-8ab7-45ec-8728-e30deabf62db tempest-CreateVolumesFromImageTest-1045884161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:44:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-70c88d9a-8ab7-45ec-8728-e30deabf62db tempest-CreateVolumesFromImageTest-1045884161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:44:50 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-70c88d9a-8ab7-45ec-8728-e30deabf62db tempest-CreateVolumesFromImageTest-1045884161 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:44:50 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-70c88d9a-8ab7-45ec-8728-e30deabf62db tempest-CreateVolumesFromImageTest-1045884161 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:44:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-70c88d9a-8ab7-45ec-8728-e30deabf62db tempest-CreateVolumesFromImageTest-1045884161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9295b5de-4519-4b84-8882-2e9a88594061 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:50 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9295b5de-4519-4b84-8882-2e9a88594061 1073741824 Jul 11 04:44:50 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:50 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7649cddc-a9ee-4990-8f8c-65c05d1c0bb2 tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (015f29a5-c7df-4c33-9408-fb9c1cfe42c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed915e19-8502-4078-82d4-5751d0035f69', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:50 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7649cddc-a9ee-4990-8f8c-65c05d1c0bb2 tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef30e88-63f9-4296-b41a-efb2540722ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:50 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-7649cddc-a9ee-4990-8f8c-65c05d1c0bb2 tempest-CreateVolumesFromImageTest-1045884161 None] Volume volume-ed915e19-8502-4078-82d4-5751d0035f69 (ed915e19-8502-4078-82d4-5751d0035f69): created successfully Jul 11 04:44:50 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7649cddc-a9ee-4990-8f8c-65c05d1c0bb2 tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef30e88-63f9-4296-b41a-efb2540722ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:50 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7649cddc-a9ee-4990-8f8c-65c05d1c0bb2 tempest-CreateVolumesFromImageTest-1045884161 None] Flow 'volume_create_manager' (31e01cff-177a-4cf7-a874-22af1e0bf1e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:44:50 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-7649cddc-a9ee-4990-8f8c-65c05d1c0bb2 tempest-CreateVolumesFromImageTest-1045884161 None] Created volume successfully. Jul 11 04:44:51 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff7c4674-18e2-443f-9b29-69c93cb18a60_oqk2d9dedevstack@QuobyteHD" returned: 0 in 0.732s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff7c4674-18e2-443f-9b29-69c93cb18a60_oqk2d9dedevstack@QuobyteHD {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:51 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff7c4674-18e2-443f-9b29-69c93cb18a60_oqk2d9dedevstack@QuobyteHD Jul 11 04:44:51 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:51 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-70c88d9a-8ab7-45ec-8728-e30deabf62db tempest-CreateVolumesFromImageTest-1045884161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9295b5de-4519-4b84-8882-2e9a88594061 1073741824" returned: 0 in 0.819s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-70c88d9a-8ab7-45ec-8728-e30deabf62db tempest-CreateVolumesFromImageTest-1045884161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9295b5de-4519-4b84-8882-2e9a88594061 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:51 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9295b5de-4519-4b84-8882-2e9a88594061 Jul 11 04:44:51 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:51 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff7c4674-18e2-443f-9b29-69c93cb18a60_oqk2d9dedevstack@QuobyteHD" returned: 1 in 0.711s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff7c4674-18e2-443f-9b29-69c93cb18a60_oqk2d9dedevstack@QuobyteHD' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:44:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:44:52 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-70c88d9a-8ab7-45ec-8728-e30deabf62db tempest-CreateVolumesFromImageTest-1045884161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9295b5de-4519-4b84-8882-2e9a88594061" returned: 0 in 0.646s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:52 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-70c88d9a-8ab7-45ec-8728-e30deabf62db tempest-CreateVolumesFromImageTest-1045884161 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:44:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-70c88d9a-8ab7-45ec-8728-e30deabf62db tempest-CreateVolumesFromImageTest-1045884161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:44:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-726218ef-ed1a-4c86-aa16-763970738ba4 tempest-CreateVolumesFromImageTest-1045884161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.589s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:44:52 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-726218ef-ed1a-4c86-aa16-763970738ba4 tempest-CreateVolumesFromImageTest-1045884161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:44:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2748110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67d29009-643b-4197-bc54-eb85d146377f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b1a969256c4a828fc515bca28512c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:44:46Z,use_quota=True,user_id='4f37298b4f87495aa4b8d66d0a759907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:44:52 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-726218ef-ed1a-4c86-aa16-763970738ba4 tempest-CreateVolumesFromImageTest-1045884161 None] Creating volume 67d29009-643b-4197-bc54-eb85d146377f {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:44:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-726218ef-ed1a-4c86-aa16-763970738ba4 tempest-CreateVolumesFromImageTest-1045884161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:44:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-726218ef-ed1a-4c86-aa16-763970738ba4 tempest-CreateVolumesFromImageTest-1045884161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:44:52 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-726218ef-ed1a-4c86-aa16-763970738ba4 tempest-CreateVolumesFromImageTest-1045884161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:44:52 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-726218ef-ed1a-4c86-aa16-763970738ba4 tempest-CreateVolumesFromImageTest-1045884161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:44:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-726218ef-ed1a-4c86-aa16-763970738ba4 tempest-CreateVolumesFromImageTest-1045884161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:44:52 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-726218ef-ed1a-4c86-aa16-763970738ba4 tempest-CreateVolumesFromImageTest-1045884161 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:44:52 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-726218ef-ed1a-4c86-aa16-763970738ba4 tempest-CreateVolumesFromImageTest-1045884161 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:44:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-726218ef-ed1a-4c86-aa16-763970738ba4 tempest-CreateVolumesFromImageTest-1045884161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-67d29009-643b-4197-bc54-eb85d146377f 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:52 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-70c88d9a-8ab7-45ec-8728-e30deabf62db tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dbd39c7-b0f5-43bf-9f1a-3a8fa7593e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9295b5de-4519-4b84-8882-2e9a88594061', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:52 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-70c88d9a-8ab7-45ec-8728-e30deabf62db tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (334b65a0-a0c9-4a21-a42c-2605f1e8642c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:52 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-67d29009-643b-4197-bc54-eb85d146377f 1073741824 Jul 11 04:44:52 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:52 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-70c88d9a-8ab7-45ec-8728-e30deabf62db tempest-CreateVolumesFromImageTest-1045884161 None] Volume volume-9295b5de-4519-4b84-8882-2e9a88594061 (9295b5de-4519-4b84-8882-2e9a88594061): created successfully Jul 11 04:44:52 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-70c88d9a-8ab7-45ec-8728-e30deabf62db tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (334b65a0-a0c9-4a21-a42c-2605f1e8642c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:52 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-70c88d9a-8ab7-45ec-8728-e30deabf62db tempest-CreateVolumesFromImageTest-1045884161 None] Flow 'volume_create_manager' (93889635-248b-43e7-b902-f1b181685db7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:44:52 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-70c88d9a-8ab7-45ec-8728-e30deabf62db tempest-CreateVolumesFromImageTest-1045884161 None] Created volume successfully. Jul 11 04:44:53 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-726218ef-ed1a-4c86-aa16-763970738ba4 tempest-CreateVolumesFromImageTest-1045884161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-67d29009-643b-4197-bc54-eb85d146377f 1073741824" returned: 0 in 0.814s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-726218ef-ed1a-4c86-aa16-763970738ba4 tempest-CreateVolumesFromImageTest-1045884161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-67d29009-643b-4197-bc54-eb85d146377f {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:53 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-67d29009-643b-4197-bc54-eb85d146377f Jul 11 04:44:53 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:53 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-726218ef-ed1a-4c86-aa16-763970738ba4 tempest-CreateVolumesFromImageTest-1045884161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-67d29009-643b-4197-bc54-eb85d146377f" returned: 0 in 0.646s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:53 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-726218ef-ed1a-4c86-aa16-763970738ba4 tempest-CreateVolumesFromImageTest-1045884161 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:44:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-726218ef-ed1a-4c86-aa16-763970738ba4 tempest-CreateVolumesFromImageTest-1045884161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.499s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:44:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-220172ad-0095-4469-a509-cbee0a0763e2 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.968s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:44:53 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-726218ef-ed1a-4c86-aa16-763970738ba4 tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ba2de0-fd1e-4535-9067-de39264e5a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67d29009-643b-4197-bc54-eb85d146377f', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:53 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-726218ef-ed1a-4c86-aa16-763970738ba4 tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (074ff36c-6963-4e0c-80d1-0d20bd8a6191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:44:53 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-220172ad-0095-4469-a509-cbee0a0763e2 tempest-CreateVolumesFromSnapshotTest-469897697 None] Creating offline snapshot 68fdb5dd-e29c-440d-88cb-8ec9054a6f05 of volume 45e42e77-7def-4a6f-b84c-a677dcc8bbda {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:44:53 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-726218ef-ed1a-4c86-aa16-763970738ba4 tempest-CreateVolumesFromImageTest-1045884161 None] Volume volume-67d29009-643b-4197-bc54-eb85d146377f (67d29009-643b-4197-bc54-eb85d146377f): created successfully Jul 11 04:44:53 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-726218ef-ed1a-4c86-aa16-763970738ba4 tempest-CreateVolumesFromImageTest-1045884161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (074ff36c-6963-4e0c-80d1-0d20bd8a6191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:44:53 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-726218ef-ed1a-4c86-aa16-763970738ba4 tempest-CreateVolumesFromImageTest-1045884161 None] Flow 'volume_create_manager' (d4e5bf8b-b13a-48d7-8b53-c05e0dc0dad9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:44:53 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7db0b2-cb94-459d-afaf-acf7d112acfd]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:44:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-220172ad-0095-4469-a509-cbee0a0763e2 tempest-CreateVolumesFromSnapshotTest-469897697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:53 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-726218ef-ed1a-4c86-aa16-763970738ba4 tempest-CreateVolumesFromImageTest-1045884161 None] Created volume successfully. Jul 11 04:44:54 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda Jul 11 04:44:54 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:54 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-bfada672-b6c1-4b6f-a3fc-09e393bb67cd tempest-CreateVolumesFromImageTest-1045884161 None] Acquiring lock "cinder-67d29009-643b-4197-bc54-eb85d146377f-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:44:54 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-bfada672-b6c1-4b6f-a3fc-09e393bb67cd tempest-CreateVolumesFromImageTest-1045884161 None] Lock "cinder-67d29009-643b-4197-bc54-eb85d146377f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:44:54 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-bfada672-b6c1-4b6f-a3fc-09e393bb67cd tempest-CreateVolumesFromImageTest-1045884161 None] Acquiring lock "cinder-quobyte-67d29009-643b-4197-bc54-eb85d146377f" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:44:54 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-bfada672-b6c1-4b6f-a3fc-09e393bb67cd tempest-CreateVolumesFromImageTest-1045884161 None] Lock "cinder-quobyte-67d29009-643b-4197-bc54-eb85d146377f" acquired by "delete_volume" :: waited 0.016s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:44:54 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[a441f249-5fa0-4fc9-a905-ff0104435202]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:44:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bfada672-b6c1-4b6f-a3fc-09e393bb67cd tempest-CreateVolumesFromImageTest-1045884161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-67d29009-643b-4197-bc54-eb85d146377f {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:54 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-67d29009-643b-4197-bc54-eb85d146377f Jul 11 04:44:54 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:54 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-220172ad-0095-4469-a509-cbee0a0763e2 tempest-CreateVolumesFromSnapshotTest-469897697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda" returned: 0 in 0.750s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-220172ad-0095-4469-a509-cbee0a0763e2 tempest-CreateVolumesFromSnapshotTest-469897697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda.68fdb5dd-e29c-440d-88cb-8ec9054a6f05 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:54 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda.68fdb5dd-e29c-440d-88cb-8ec9054a6f05 1G Jul 11 04:44:54 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:55 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bfada672-b6c1-4b6f-a3fc-09e393bb67cd tempest-CreateVolumesFromImageTest-1045884161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-67d29009-643b-4197-bc54-eb85d146377f" returned: 0 in 0.768s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bfada672-b6c1-4b6f-a3fc-09e393bb67cd tempest-CreateVolumesFromImageTest-1045884161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-67d29009-643b-4197-bc54-eb85d146377f {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:55 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-67d29009-643b-4197-bc54-eb85d146377f Jul 11 04:44:55 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:55 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-220172ad-0095-4469-a509-cbee0a0763e2 tempest-CreateVolumesFromSnapshotTest-469897697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda.68fdb5dd-e29c-440d-88cb-8ec9054a6f05 1G" returned: 0 in 0.773s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-220172ad-0095-4469-a509-cbee0a0763e2 tempest-CreateVolumesFromSnapshotTest-469897697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda.68fdb5dd-e29c-440d-88cb-8ec9054a6f05 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:55 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda.68fdb5dd-e29c-440d-88cb-8ec9054a6f05 Jul 11 04:44:55 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:55 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bfada672-b6c1-4b6f-a3fc-09e393bb67cd tempest-CreateVolumesFromImageTest-1045884161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-67d29009-643b-4197-bc54-eb85d146377f" returned: 0 in 0.657s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:55 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-bfada672-b6c1-4b6f-a3fc-09e393bb67cd tempest-CreateVolumesFromImageTest-1045884161 None] Lock "cinder-quobyte-67d29009-643b-4197-bc54-eb85d146377f" released by "delete_volume" :: held 1.463s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:44:55 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-bfada672-b6c1-4b6f-a3fc-09e393bb67cd tempest-CreateVolumesFromImageTest-1045884161 None] Created reservations ['3f15725b-d1bd-445f-8494-721ce3f053a5', '6ff3ebac-9a03-48e6-bfde-a8c843aa4f75', '6f1df810-f1c5-4703-8026-a2431faa7793', 'bce0d68a-350d-49c2-a9a5-6d5827bbbbf8'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:44:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-bfada672-b6c1-4b6f-a3fc-09e393bb67cd tempest-CreateVolumesFromImageTest-1045884161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:44:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-bfada672-b6c1-4b6f-a3fc-09e393bb67cd tempest-CreateVolumesFromImageTest-1045884161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:44:56 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-bfada672-b6c1-4b6f-a3fc-09e393bb67cd tempest-CreateVolumesFromImageTest-1045884161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:44:56 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-bfada672-b6c1-4b6f-a3fc-09e393bb67cd tempest-CreateVolumesFromImageTest-1045884161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:44:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-bfada672-b6c1-4b6f-a3fc-09e393bb67cd tempest-CreateVolumesFromImageTest-1045884161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:44:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bfada672-b6c1-4b6f-a3fc-09e393bb67cd tempest-CreateVolumesFromImageTest-1045884161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:56 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:44:56 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:56 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-220172ad-0095-4469-a509-cbee0a0763e2 tempest-CreateVolumesFromSnapshotTest-469897697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda.68fdb5dd-e29c-440d-88cb-8ec9054a6f05" returned: 0 in 0.726s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:56 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-220172ad-0095-4469-a509-cbee0a0763e2 tempest-CreateVolumesFromSnapshotTest-469897697 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda.68fdb5dd-e29c-440d-88cb-8ec9054a6f05 is being set with open permissions: ugo+rw Jul 11 04:44:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-220172ad-0095-4469-a509-cbee0a0763e2 tempest-CreateVolumesFromSnapshotTest-469897697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda.68fdb5dd-e29c-440d-88cb-8ec9054a6f05 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:56 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda.68fdb5dd-e29c-440d-88cb-8ec9054a6f05 Jul 11 04:44:56 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:56 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c2f01762-a486-4319-b077-238d3af61fb7 tempest-CreateVolumesFromImageTest-1045884161 None] Acquiring lock "cinder-9295b5de-4519-4b84-8882-2e9a88594061-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:44:56 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c2f01762-a486-4319-b077-238d3af61fb7 tempest-CreateVolumesFromImageTest-1045884161 None] Lock "cinder-9295b5de-4519-4b84-8882-2e9a88594061-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:44:56 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c2f01762-a486-4319-b077-238d3af61fb7 tempest-CreateVolumesFromImageTest-1045884161 None] Acquiring lock "cinder-quobyte-9295b5de-4519-4b84-8882-2e9a88594061" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:44:56 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:56 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c2f01762-a486-4319-b077-238d3af61fb7 tempest-CreateVolumesFromImageTest-1045884161 None] Lock "cinder-quobyte-9295b5de-4519-4b84-8882-2e9a88594061" acquired by "delete_volume" :: waited 0.017s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:44:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bfada672-b6c1-4b6f-a3fc-09e393bb67cd tempest-CreateVolumesFromImageTest-1045884161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.680s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:56 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-bfada672-b6c1-4b6f-a3fc-09e393bb67cd tempest-CreateVolumesFromImageTest-1045884161 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:44:56 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-bfada672-b6c1-4b6f-a3fc-09e393bb67cd tempest-CreateVolumesFromImageTest-1045884161 None] Deleted volume successfully. Jul 11 04:44:56 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a050fc-a818-4f03-bd38-8548d507f1d6]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:44:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c2f01762-a486-4319-b077-238d3af61fb7 tempest-CreateVolumesFromImageTest-1045884161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9295b5de-4519-4b84-8882-2e9a88594061 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:56 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-bfada672-b6c1-4b6f-a3fc-09e393bb67cd tempest-CreateVolumesFromImageTest-1045884161 None] Lock "cinder-67d29009-643b-4197-bc54-eb85d146377f-delete_volume" released by "delete_volume" :: held 2.356s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:44:56 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9295b5de-4519-4b84-8882-2e9a88594061 Jul 11 04:44:56 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:56 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-220172ad-0095-4469-a509-cbee0a0763e2 tempest-CreateVolumesFromSnapshotTest-469897697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda.68fdb5dd-e29c-440d-88cb-8ec9054a6f05" returned: 0 in 0.693s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-220172ad-0095-4469-a509-cbee0a0763e2 tempest-CreateVolumesFromSnapshotTest-469897697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:56 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda.info Jul 11 04:44:56 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:57 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c2f01762-a486-4319-b077-238d3af61fb7 tempest-CreateVolumesFromImageTest-1045884161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9295b5de-4519-4b84-8882-2e9a88594061" returned: 0 in 0.804s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c2f01762-a486-4319-b077-238d3af61fb7 tempest-CreateVolumesFromImageTest-1045884161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9295b5de-4519-4b84-8882-2e9a88594061 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:57 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-220172ad-0095-4469-a509-cbee0a0763e2 tempest-CreateVolumesFromSnapshotTest-469897697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda.info" returned: 0 in 0.667s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:57 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-220172ad-0095-4469-a509-cbee0a0763e2 tempest-CreateVolumesFromSnapshotTest-469897697 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda.info is being set with open permissions: ugo+rw Jul 11 04:44:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-220172ad-0095-4469-a509-cbee0a0763e2 tempest-CreateVolumesFromSnapshotTest-469897697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:57 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9295b5de-4519-4b84-8882-2e9a88594061 Jul 11 04:44:57 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:57 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda.info Jul 11 04:44:57 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:58 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:58 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c2f01762-a486-4319-b077-238d3af61fb7 tempest-CreateVolumesFromImageTest-1045884161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9295b5de-4519-4b84-8882-2e9a88594061" returned: 0 in 0.649s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-220172ad-0095-4469-a509-cbee0a0763e2 tempest-CreateVolumesFromSnapshotTest-469897697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda.info" returned: 0 in 0.642s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-220172ad-0095-4469-a509-cbee0a0763e2 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.368s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:44:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ff5ef96b-2fa0-4bd3-a914-b1397de569d3 tempest-ProjectReaderTests-787132287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.234s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:44:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ff5ef96b-2fa0-4bd3-a914-b1397de569d3 tempest-ProjectReaderTests-787132287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-591070017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99206423-1e47-40d7-96b7-49c8ae6f75c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36dcca031e5d4245aed8aadd7b6f88e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:44:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:44:50Z,use_quota=True,user_id='ee6e4107301b44a98a0fdd41aead55f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:44:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-ff5ef96b-2fa0-4bd3-a914-b1397de569d3 tempest-ProjectReaderTests-787132287 None] Creating volume 99206423-1e47-40d7-96b7-49c8ae6f75c5 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:44:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ff5ef96b-2fa0-4bd3-a914-b1397de569d3 tempest-ProjectReaderTests-787132287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:44:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ff5ef96b-2fa0-4bd3-a914-b1397de569d3 tempest-ProjectReaderTests-787132287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:44:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ff5ef96b-2fa0-4bd3-a914-b1397de569d3 tempest-ProjectReaderTests-787132287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:44:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ff5ef96b-2fa0-4bd3-a914-b1397de569d3 tempest-ProjectReaderTests-787132287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:44:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ff5ef96b-2fa0-4bd3-a914-b1397de569d3 tempest-ProjectReaderTests-787132287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:44:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ff5ef96b-2fa0-4bd3-a914-b1397de569d3 tempest-ProjectReaderTests-787132287 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:44:58 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-ff5ef96b-2fa0-4bd3-a914-b1397de569d3 tempest-ProjectReaderTests-787132287 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:44:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ff5ef96b-2fa0-4bd3-a914-b1397de569d3 tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:58 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c2f01762-a486-4319-b077-238d3af61fb7 tempest-CreateVolumesFromImageTest-1045884161 None] Lock "cinder-quobyte-9295b5de-4519-4b84-8882-2e9a88594061" released by "delete_volume" :: held 1.561s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:44:58 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5 1073741824 Jul 11 04:44:58 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:58 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-220172ad-0095-4469-a509-cbee0a0763e2 tempest-CreateVolumesFromSnapshotTest-469897697 None] Create snapshot completed successfully Jul 11 04:44:58 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-c2f01762-a486-4319-b077-238d3af61fb7 tempest-CreateVolumesFromImageTest-1045884161 None] Created reservations ['0c6f79c3-20b3-41ae-95e9-fe0c7407a10a', '9de8912b-14bd-4752-bace-2989dcbc79fd', '96c1784f-5500-465c-999e-3201726e95f0', 'bfdd4dc4-b5bc-4e3a-98d1-fc341a9e0139'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:44:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c2f01762-a486-4319-b077-238d3af61fb7 tempest-CreateVolumesFromImageTest-1045884161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:44:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c2f01762-a486-4319-b077-238d3af61fb7 tempest-CreateVolumesFromImageTest-1045884161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:44:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c2f01762-a486-4319-b077-238d3af61fb7 tempest-CreateVolumesFromImageTest-1045884161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:44:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c2f01762-a486-4319-b077-238d3af61fb7 tempest-CreateVolumesFromImageTest-1045884161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:44:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c2f01762-a486-4319-b077-238d3af61fb7 tempest-CreateVolumesFromImageTest-1045884161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:44:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c2f01762-a486-4319-b077-238d3af61fb7 tempest-CreateVolumesFromImageTest-1045884161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:58 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:44:58 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:58 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d5c3eef5-dd0a-445c-81f1-6fbd8768e9b2 tempest-CreateVolumesFromImageTest-1045884161 None] Acquiring lock "cinder-ed915e19-8502-4078-82d4-5751d0035f69-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:44:58 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d5c3eef5-dd0a-445c-81f1-6fbd8768e9b2 tempest-CreateVolumesFromImageTest-1045884161 None] Lock "cinder-ed915e19-8502-4078-82d4-5751d0035f69-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:44:58 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d5c3eef5-dd0a-445c-81f1-6fbd8768e9b2 tempest-CreateVolumesFromImageTest-1045884161 None] Acquiring lock "cinder-quobyte-ed915e19-8502-4078-82d4-5751d0035f69" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:44:59 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d5c3eef5-dd0a-445c-81f1-6fbd8768e9b2 tempest-CreateVolumesFromImageTest-1045884161 None] Lock "cinder-quobyte-ed915e19-8502-4078-82d4-5751d0035f69" acquired by "delete_volume" :: waited 0.023s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:44:59 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee0ad6e-b223-4e48-8230-bdb4f479ed63]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:44:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d5c3eef5-dd0a-445c-81f1-6fbd8768e9b2 tempest-CreateVolumesFromImageTest-1045884161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ed915e19-8502-4078-82d4-5751d0035f69 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:59 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c2f01762-a486-4319-b077-238d3af61fb7 tempest-CreateVolumesFromImageTest-1045884161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.708s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:59 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-c2f01762-a486-4319-b077-238d3af61fb7 tempest-CreateVolumesFromImageTest-1045884161 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:44:59 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-c2f01762-a486-4319-b077-238d3af61fb7 tempest-CreateVolumesFromImageTest-1045884161 None] Deleted volume successfully. Jul 11 04:44:59 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c2f01762-a486-4319-b077-238d3af61fb7 tempest-CreateVolumesFromImageTest-1045884161 None] Lock "cinder-9295b5de-4519-4b84-8882-2e9a88594061-delete_volume" released by "delete_volume" :: held 2.468s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:44:59 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ed915e19-8502-4078-82d4-5751d0035f69 Jul 11 04:44:59 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:59 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:44:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:44:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:44:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:44:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:44:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:44:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:59 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ff5ef96b-2fa0-4bd3-a914-b1397de569d3 tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5 1073741824" returned: 0 in 0.915s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:59 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:44:59 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ff5ef96b-2fa0-4bd3-a914-b1397de569d3 tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:59 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5 Jul 11 04:44:59 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:44:59 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Jul 11 04:44:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d5c3eef5-dd0a-445c-81f1-6fbd8768e9b2 tempest-CreateVolumesFromImageTest-1045884161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ed915e19-8502-4078-82d4-5751d0035f69" returned: 0 in 0.954s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:44:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d5c3eef5-dd0a-445c-81f1-6fbd8768e9b2 tempest-CreateVolumesFromImageTest-1045884161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ed915e19-8502-4078-82d4-5751d0035f69 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:44:59 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.845s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager._thread_info {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread count: 28 {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:45:00 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ed915e19-8502-4078-82d4-5751d0035f69 Jul 11 04:45:00 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread info: [<_MainThread(MainThread, started 124675027595392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:45:00 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ff5ef96b-2fa0-4bd3-a914-b1397de569d3 tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5" returned: 0 in 0.842s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ff5ef96b-2fa0-4bd3-a914-b1397de569d3 tempest-ProjectReaderTests-787132287 None] <== create_volume: return (1803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ff5ef96b-2fa0-4bd3-a914-b1397de569d3 tempest-ProjectReaderTests-787132287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.173s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:44:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f040d668-6eab-4a0f-aae6-7400da201fd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e8c47d22e1e4b748bbed21a12bf959c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:44:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:44:48Z,use_quota=True,user_id='a37402ada2354485989fd398a6bae6db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2aac9c8d-9597-4805-970c-4ceb3daa9520),volume_type_id=2aac9c8d-9597-4805-970c-4ceb3daa9520)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Creating volume f040d668-6eab-4a0f-aae6-7400da201fd1 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:45:00 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f040d668-6eab-4a0f-aae6-7400da201fd1 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:00 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f040d668-6eab-4a0f-aae6-7400da201fd1 1073741824 Jul 11 04:45:00 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ff5ef96b-2fa0-4bd3-a914-b1397de569d3 tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec2282c-83e4-48e3-85c1-d22ecd86e214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99206423-1e47-40d7-96b7-49c8ae6f75c5', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ff5ef96b-2fa0-4bd3-a914-b1397de569d3 tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d2bb095-6c82-4696-9bfd-cf79ff789027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-74479e99-2835-49f5-aae5-125654a56742 tempest-CreateVolumesFromSnapshotTest-469897697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-74479e99-2835-49f5-aae5-125654a56742 tempest-CreateVolumesFromSnapshotTest-469897697 None] Flow 'volume_create_manager' (8e7b8322-35c2-4419-b6c1-0a4565063ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-74479e99-2835-49f5-aae5-125654a56742 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (056bd999-f60c-497f-ad68-0cf66dda8763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:00 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-ff5ef96b-2fa0-4bd3-a914-b1397de569d3 tempest-ProjectReaderTests-787132287 None] Volume volume-99206423-1e47-40d7-96b7-49c8ae6f75c5 (99206423-1e47-40d7-96b7-49c8ae6f75c5): created successfully Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ff5ef96b-2fa0-4bd3-a914-b1397de569d3 tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d2bb095-6c82-4696-9bfd-cf79ff789027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ff5ef96b-2fa0-4bd3-a914-b1397de569d3 tempest-ProjectReaderTests-787132287 None] Flow 'volume_create_manager' (e309d80f-82ab-4384-8d04-0debdae009e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-74479e99-2835-49f5-aae5-125654a56742 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (056bd999-f60c-497f-ad68-0cf66dda8763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-871717926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4feb22d7-7ae6-419e-a30f-48646a76ca70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3674310985ed4178a2da2b95ec0adb67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:45:00Z,use_quota=True,user_id='a9770df9eb0d417c8e5e8c4d78e3316d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-74479e99-2835-49f5-aae5-125654a56742 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d37c1aec-6a28-4cd6-9782-e879fc572c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-74479e99-2835-49f5-aae5-125654a56742 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d37c1aec-6a28-4cd6-9782-e879fc572c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-74479e99-2835-49f5-aae5-125654a56742 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecbdc891-ad99-4ba2-ba6a-afc8c05a9d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-74479e99-2835-49f5-aae5-125654a56742 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecbdc891-ad99-4ba2-ba6a-afc8c05a9d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4feb22d7-7ae6-419e-a30f-48646a76ca70', 'volume_name': 'volume-4feb22d7-7ae6-419e-a30f-48646a76ca70', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-74479e99-2835-49f5-aae5-125654a56742 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (771b8c3f-445a-474f-8649-198eeb57a9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-74479e99-2835-49f5-aae5-125654a56742 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (771b8c3f-445a-474f-8649-198eeb57a9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-74479e99-2835-49f5-aae5-125654a56742 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b1eb87-2295-4593-a8a8-ca9bb653d442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:00 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-74479e99-2835-49f5-aae5-125654a56742 tempest-CreateVolumesFromSnapshotTest-469897697 None] Volume 4feb22d7-7ae6-419e-a30f-48646a76ca70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4feb22d7-7ae6-419e-a30f-48646a76ca70', 'volume_size': 1} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-74479e99-2835-49f5-aae5-125654a56742 tempest-CreateVolumesFromSnapshotTest-469897697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:00 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-ff5ef96b-2fa0-4bd3-a914-b1397de569d3 tempest-ProjectReaderTests-787132287 None] Created volume successfully. Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9e7846f-caee-4814-b877-dfabb42eadb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c9e7846f-caee-4814-b877-dfabb42eadb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Flow 'volume_create_manager' (522debec-0a78-4c8d-a059-8563a35b1d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c9e7846f-caee-4814-b877-dfabb42eadb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2aac48b-b4e3-4a86-826b-72071c418db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c9e7846f-caee-4814-b877-dfabb42eadb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2aac48b-b4e3-4a86-826b-72071c418db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2032724563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=344306c5-45b6-4844-b99c-fb5be87b538b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3674310985ed4178a2da2b95ec0adb67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:45:00Z,use_quota=True,user_id='a9770df9eb0d417c8e5e8c4d78e3316d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c9e7846f-caee-4814-b877-dfabb42eadb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f0f064f-c393-4cb9-ab64-ae1fba581903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c9e7846f-caee-4814-b877-dfabb42eadb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f0f064f-c393-4cb9-ab64-ae1fba581903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c9e7846f-caee-4814-b877-dfabb42eadb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7146bbc-eba6-4838-b5d9-2f9b0aa99dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c9e7846f-caee-4814-b877-dfabb42eadb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7146bbc-eba6-4838-b5d9-2f9b0aa99dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '344306c5-45b6-4844-b99c-fb5be87b538b', 'volume_name': 'volume-344306c5-45b6-4844-b99c-fb5be87b538b', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c9e7846f-caee-4814-b877-dfabb42eadb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36876939-dbc8-4311-83c1-87bc1f647402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c9e7846f-caee-4814-b877-dfabb42eadb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36876939-dbc8-4311-83c1-87bc1f647402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c9e7846f-caee-4814-b877-dfabb42eadb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6f709e7-89da-4447-81c2-e7618b65fc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:00 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-c9e7846f-caee-4814-b877-dfabb42eadb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Volume 344306c5-45b6-4844-b99c-fb5be87b538b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-344306c5-45b6-4844-b99c-fb5be87b538b', 'volume_size': 1} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c9e7846f-caee-4814-b877-dfabb42eadb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6ce83b8-7b63-443d-9ddc-3c7ddc832a64 tempest-CreateVolumesFromSnapshotTest-469897697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:45:00 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b6ce83b8-7b63-443d-9ddc-3c7ddc832a64 tempest-CreateVolumesFromSnapshotTest-469897697 None] Flow 'volume_create_manager' (dd3eb306-1db6-4839-bfd0-ff7b1a3f8d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:45:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b6ce83b8-7b63-443d-9ddc-3c7ddc832a64 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2db6a02-8186-4d92-8c0b-e40f113e0a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d5c3eef5-dd0a-445c-81f1-6fbd8768e9b2 tempest-CreateVolumesFromImageTest-1045884161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ed915e19-8502-4078-82d4-5751d0035f69" returned: 0 in 1.016s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b6ce83b8-7b63-443d-9ddc-3c7ddc832a64 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2db6a02-8186-4d92-8c0b-e40f113e0a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2068819495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6387afdd-91e2-453d-be97-e9cc5e29e90b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3674310985ed4178a2da2b95ec0adb67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:45:01Z,use_quota=True,user_id='a9770df9eb0d417c8e5e8c4d78e3316d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b6ce83b8-7b63-443d-9ddc-3c7ddc832a64 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccfc7abc-68e7-4b89-a5a9-5f7874e7e9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b6ce83b8-7b63-443d-9ddc-3c7ddc832a64 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccfc7abc-68e7-4b89-a5a9-5f7874e7e9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b6ce83b8-7b63-443d-9ddc-3c7ddc832a64 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6d5d45b-2cd2-49e6-abec-a336da2fe7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b6ce83b8-7b63-443d-9ddc-3c7ddc832a64 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6d5d45b-2cd2-49e6-abec-a336da2fe7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6387afdd-91e2-453d-be97-e9cc5e29e90b', 'volume_name': 'volume-6387afdd-91e2-453d-be97-e9cc5e29e90b', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b6ce83b8-7b63-443d-9ddc-3c7ddc832a64 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ddce774-1fc2-4167-9fe4-e404a02da23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b6ce83b8-7b63-443d-9ddc-3c7ddc832a64 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ddce774-1fc2-4167-9fe4-e404a02da23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b6ce83b8-7b63-443d-9ddc-3c7ddc832a64 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b5788d5-20ac-4e41-83c5-6aca536c4a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:01 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-b6ce83b8-7b63-443d-9ddc-3c7ddc832a64 tempest-CreateVolumesFromSnapshotTest-469897697 None] Volume 6387afdd-91e2-453d-be97-e9cc5e29e90b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6387afdd-91e2-453d-be97-e9cc5e29e90b', 'volume_size': 1} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b6ce83b8-7b63-443d-9ddc-3c7ddc832a64 tempest-CreateVolumesFromSnapshotTest-469897697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d5c3eef5-dd0a-445c-81f1-6fbd8768e9b2 tempest-CreateVolumesFromImageTest-1045884161 None] Lock "cinder-quobyte-ed915e19-8502-4078-82d4-5751d0035f69" released by "delete_volume" :: held 2.076s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e95a7f86-f17e-4dba-b78d-42106995a9dc tempest-ProjectReaderTests-787132287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:01 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f040d668-6eab-4a0f-aae6-7400da201fd1 1073741824" returned: 0 in 1.017s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-d5c3eef5-dd0a-445c-81f1-6fbd8768e9b2 tempest-CreateVolumesFromImageTest-1045884161 None] Created reservations ['eb79eeb5-dcd2-4f84-98a9-e66bd26f0de2', '13eaa520-b20d-419a-95bb-9908385b2e2c', '4c0b2618-4874-44f4-85f8-a9a6b76ada02', '52d68c07-76df-4ba5-ad1a-62389e2d2696'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f040d668-6eab-4a0f-aae6-7400da201fd1 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:01 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f040d668-6eab-4a0f-aae6-7400da201fd1 Jul 11 04:45:01 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d5c3eef5-dd0a-445c-81f1-6fbd8768e9b2 tempest-CreateVolumesFromImageTest-1045884161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d5c3eef5-dd0a-445c-81f1-6fbd8768e9b2 tempest-CreateVolumesFromImageTest-1045884161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-d5c3eef5-dd0a-445c-81f1-6fbd8768e9b2 tempest-CreateVolumesFromImageTest-1045884161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-d5c3eef5-dd0a-445c-81f1-6fbd8768e9b2 tempest-CreateVolumesFromImageTest-1045884161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d5c3eef5-dd0a-445c-81f1-6fbd8768e9b2 tempest-CreateVolumesFromImageTest-1045884161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d5c3eef5-dd0a-445c-81f1-6fbd8768e9b2 tempest-CreateVolumesFromImageTest-1045884161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:01 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:45:01 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-565703f3-acb9-4d1d-9e84-49093db67482 tempest-CreateVolumesFromSnapshotTest-469897697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-565703f3-acb9-4d1d-9e84-49093db67482 tempest-CreateVolumesFromSnapshotTest-469897697 None] Flow 'volume_create_manager' (504b3e41-a39b-47e6-8bd5-deea008be75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-565703f3-acb9-4d1d-9e84-49093db67482 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (315105c9-6f2d-4075-a3c7-d3e3613f8f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-565703f3-acb9-4d1d-9e84-49093db67482 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (315105c9-6f2d-4075-a3c7-d3e3613f8f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1925116515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e3fcd2c-0c17-4d49-9062-c6691e499351,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3674310985ed4178a2da2b95ec0adb67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:45:01Z,use_quota=True,user_id='a9770df9eb0d417c8e5e8c4d78e3316d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-565703f3-acb9-4d1d-9e84-49093db67482 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5693b2ad-9c9c-4e4d-8944-bdba8c397014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-565703f3-acb9-4d1d-9e84-49093db67482 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5693b2ad-9c9c-4e4d-8944-bdba8c397014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-565703f3-acb9-4d1d-9e84-49093db67482 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d857ab8-55f8-404a-9511-d8bf7d53dfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-565703f3-acb9-4d1d-9e84-49093db67482 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d857ab8-55f8-404a-9511-d8bf7d53dfc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e3fcd2c-0c17-4d49-9062-c6691e499351', 'volume_name': 'volume-9e3fcd2c-0c17-4d49-9062-c6691e499351', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-565703f3-acb9-4d1d-9e84-49093db67482 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cad2a52-ca5f-4b78-9485-b79b397426cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-565703f3-acb9-4d1d-9e84-49093db67482 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cad2a52-ca5f-4b78-9485-b79b397426cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-565703f3-acb9-4d1d-9e84-49093db67482 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35b8864e-ed1b-42d0-b0d2-82946b0daacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:01 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-565703f3-acb9-4d1d-9e84-49093db67482 tempest-CreateVolumesFromSnapshotTest-469897697 None] Volume 9e3fcd2c-0c17-4d49-9062-c6691e499351: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e3fcd2c-0c17-4d49-9062-c6691e499351', 'volume_size': 1} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-565703f3-acb9-4d1d-9e84-49093db67482 tempest-CreateVolumesFromSnapshotTest-469897697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-463b35c5-49b3-4d5d-93b2-4862d60b226e tempest-CreateVolumesFromSnapshotTest-469897697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-463b35c5-49b3-4d5d-93b2-4862d60b226e tempest-CreateVolumesFromSnapshotTest-469897697 None] Flow 'volume_create_manager' (682363f9-a3f9-423d-9d4b-720d3c711329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-463b35c5-49b3-4d5d-93b2-4862d60b226e tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (405fdf26-734a-488d-8313-2e63c2ba270e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-463b35c5-49b3-4d5d-93b2-4862d60b226e tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (405fdf26-734a-488d-8313-2e63c2ba270e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-745958029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f2ce532-4aec-45fd-98bd-46b6f8201033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3674310985ed4178a2da2b95ec0adb67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:45:02Z,use_quota=True,user_id='a9770df9eb0d417c8e5e8c4d78e3316d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-463b35c5-49b3-4d5d-93b2-4862d60b226e tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce2080e-60a1-418f-8d1a-7d95e47d9e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-463b35c5-49b3-4d5d-93b2-4862d60b226e tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce2080e-60a1-418f-8d1a-7d95e47d9e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-463b35c5-49b3-4d5d-93b2-4862d60b226e tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fecb7d6-d4b2-4631-868b-ac75c34b0024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-463b35c5-49b3-4d5d-93b2-4862d60b226e tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fecb7d6-d4b2-4631-868b-ac75c34b0024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f2ce532-4aec-45fd-98bd-46b6f8201033', 'volume_name': 'volume-6f2ce532-4aec-45fd-98bd-46b6f8201033', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-463b35c5-49b3-4d5d-93b2-4862d60b226e tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47c5d24b-ed5f-463c-aa2b-30b4a2d183f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-463b35c5-49b3-4d5d-93b2-4862d60b226e tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47c5d24b-ed5f-463c-aa2b-30b4a2d183f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-463b35c5-49b3-4d5d-93b2-4862d60b226e tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6e54938-0bdc-4851-a5de-491aef317dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:01 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-463b35c5-49b3-4d5d-93b2-4862d60b226e tempest-CreateVolumesFromSnapshotTest-469897697 None] Volume 6f2ce532-4aec-45fd-98bd-46b6f8201033: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f2ce532-4aec-45fd-98bd-46b6f8201033', 'volume_size': 1} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-463b35c5-49b3-4d5d-93b2-4862d60b226e tempest-CreateVolumesFromSnapshotTest-469897697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:01 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f040d668-6eab-4a0f-aae6-7400da201fd1" returned: 0 in 0.798s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] <== create_volume: return (1879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.882s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-74479e99-2835-49f5-aae5-125654a56742 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.649s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-74479e99-2835-49f5-aae5-125654a56742 tempest-CreateVolumesFromSnapshotTest-469897697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-871717926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4feb22d7-7ae6-419e-a30f-48646a76ca70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3674310985ed4178a2da2b95ec0adb67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:45:00Z,use_quota=True,user_id='a9770df9eb0d417c8e5e8c4d78e3316d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-74479e99-2835-49f5-aae5-125654a56742 tempest-CreateVolumesFromSnapshotTest-469897697 None] Creating volume 4feb22d7-7ae6-419e-a30f-48646a76ca70 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-74479e99-2835-49f5-aae5-125654a56742 tempest-CreateVolumesFromSnapshotTest-469897697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-74479e99-2835-49f5-aae5-125654a56742 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-74479e99-2835-49f5-aae5-125654a56742 tempest-CreateVolumesFromSnapshotTest-469897697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-74479e99-2835-49f5-aae5-125654a56742 tempest-CreateVolumesFromSnapshotTest-469897697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-74479e99-2835-49f5-aae5-125654a56742 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-74479e99-2835-49f5-aae5-125654a56742 tempest-CreateVolumesFromSnapshotTest-469897697 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:45:01 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-74479e99-2835-49f5-aae5-125654a56742 tempest-CreateVolumesFromSnapshotTest-469897697 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-74479e99-2835-49f5-aae5-125654a56742 tempest-CreateVolumesFromSnapshotTest-469897697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4feb22d7-7ae6-419e-a30f-48646a76ca70 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:01 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d5c3eef5-dd0a-445c-81f1-6fbd8768e9b2 tempest-CreateVolumesFromImageTest-1045884161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.743s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:01 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-d5c3eef5-dd0a-445c-81f1-6fbd8768e9b2 tempest-CreateVolumesFromImageTest-1045884161 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:45:02 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4feb22d7-7ae6-419e-a30f-48646a76ca70 1073741824 Jul 11 04:45:02 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:02 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-d5c3eef5-dd0a-445c-81f1-6fbd8768e9b2 tempest-CreateVolumesFromImageTest-1045884161 None] Deleted volume successfully. Jul 11 04:45:02 devstack cinder-volume[86964]: DEBUG cinder.volume.volume_utils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Attempting download of ff7c4674-18e2-443f-9b29-69c93cb18a60 ((None, [{'url': 'file:///opt/stack/data/glance/images/ff7c4674-18e2-443f-9b29-69c93cb18a60', 'metadata': {}}])) to volume f040d668-6eab-4a0f-aae6-7400da201fd1. {{(pid=86964) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 04:45:02 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d5c3eef5-dd0a-445c-81f1-6fbd8768e9b2 tempest-CreateVolumesFromImageTest-1045884161 None] Lock "cinder-ed915e19-8502-4078-82d4-5751d0035f69-delete_volume" released by "delete_volume" :: held 3.157s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:02 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf3f791-5edd-480a-ab85-47c8e25efb85]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ff7c4674-18e2-443f-9b29-69c93cb18a60_x1vex27v {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:02 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ff7c4674-18e2-443f-9b29-69c93cb18a60_x1vex27v Jul 11 04:45:02 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:02 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-2777b80e-698b-4d11-bfa4-32d8cb067a2e tempest-CreateVolumesFromImageTest-1045884161 None] Acquiring lock "cinder-ff8396e6-27a8-476d-b72b-33e0dd762713-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:02 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-2777b80e-698b-4d11-bfa4-32d8cb067a2e tempest-CreateVolumesFromImageTest-1045884161 None] Lock "cinder-ff8396e6-27a8-476d-b72b-33e0dd762713-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:02 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-2777b80e-698b-4d11-bfa4-32d8cb067a2e tempest-CreateVolumesFromImageTest-1045884161 None] Acquiring lock "cinder-quobyte-ff8396e6-27a8-476d-b72b-33e0dd762713" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:02 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-2777b80e-698b-4d11-bfa4-32d8cb067a2e tempest-CreateVolumesFromImageTest-1045884161 None] Lock "cinder-quobyte-ff8396e6-27a8-476d-b72b-33e0dd762713" acquired by "delete_volume" :: waited 0.020s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:02 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[87990b1d-27b7-4a79-9997-9db0a0061ee2]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2777b80e-698b-4d11-bfa4-32d8cb067a2e tempest-CreateVolumesFromImageTest-1045884161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ff8396e6-27a8-476d-b72b-33e0dd762713 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:02 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ff8396e6-27a8-476d-b72b-33e0dd762713 Jul 11 04:45:02 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:02 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:02 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-74479e99-2835-49f5-aae5-125654a56742 tempest-CreateVolumesFromSnapshotTest-469897697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4feb22d7-7ae6-419e-a30f-48646a76ca70 1073741824" returned: 0 in 0.890s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ff7c4674-18e2-443f-9b29-69c93cb18a60_x1vex27v" returned: 0 in 0.798s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff7c4674-18e2-443f-9b29-69c93cb18a60_x1vex27v {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-74479e99-2835-49f5-aae5-125654a56742 tempest-CreateVolumesFromSnapshotTest-469897697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4feb22d7-7ae6-419e-a30f-48646a76ca70 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:02 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4feb22d7-7ae6-419e-a30f-48646a76ca70 Jul 11 04:45:02 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:02 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff7c4674-18e2-443f-9b29-69c93cb18a60_x1vex27v Jul 11 04:45:02 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:03 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2777b80e-698b-4d11-bfa4-32d8cb067a2e tempest-CreateVolumesFromImageTest-1045884161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ff8396e6-27a8-476d-b72b-33e0dd762713" returned: 0 in 0.813s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2777b80e-698b-4d11-bfa4-32d8cb067a2e tempest-CreateVolumesFromImageTest-1045884161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ff8396e6-27a8-476d-b72b-33e0dd762713 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:03 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ff8396e6-27a8-476d-b72b-33e0dd762713 Jul 11 04:45:03 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:03 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff7c4674-18e2-443f-9b29-69c93cb18a60_x1vex27v" returned: 1 in 0.720s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff7c4674-18e2-443f-9b29-69c93cb18a60_x1vex27v' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:45:03 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed53c9cd-da78-4d00-b9ce-d12a72eb2c07]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff7c4674-18e2-443f-9b29-69c93cb18a60_oqk2d9dedevstack@QuobyteHD {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:03 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-74479e99-2835-49f5-aae5-125654a56742 tempest-CreateVolumesFromSnapshotTest-469897697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4feb22d7-7ae6-419e-a30f-48646a76ca70" returned: 0 in 0.750s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:03 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-74479e99-2835-49f5-aae5-125654a56742 tempest-CreateVolumesFromSnapshotTest-469897697 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:45:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-74479e99-2835-49f5-aae5-125654a56742 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c9e7846f-caee-4814-b877-dfabb42eadb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.088s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:03 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c9e7846f-caee-4814-b877-dfabb42eadb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2032724563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=344306c5-45b6-4844-b99c-fb5be87b538b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3674310985ed4178a2da2b95ec0adb67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:45:00Z,use_quota=True,user_id='a9770df9eb0d417c8e5e8c4d78e3316d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:45:03 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-c9e7846f-caee-4814-b877-dfabb42eadb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Creating volume 344306c5-45b6-4844-b99c-fb5be87b538b {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:45:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c9e7846f-caee-4814-b877-dfabb42eadb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c9e7846f-caee-4814-b877-dfabb42eadb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:03 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c9e7846f-caee-4814-b877-dfabb42eadb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:45:03 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c9e7846f-caee-4814-b877-dfabb42eadb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:45:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c9e7846f-caee-4814-b877-dfabb42eadb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:03 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c9e7846f-caee-4814-b877-dfabb42eadb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:45:03 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-c9e7846f-caee-4814-b877-dfabb42eadb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:45:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c9e7846f-caee-4814-b877-dfabb42eadb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-344306c5-45b6-4844-b99c-fb5be87b538b 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:03 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff7c4674-18e2-443f-9b29-69c93cb18a60_oqk2d9dedevstack@QuobyteHD Jul 11 04:45:03 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:03 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-344306c5-45b6-4844-b99c-fb5be87b538b 1073741824 Jul 11 04:45:03 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:03 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-74479e99-2835-49f5-aae5-125654a56742 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b1eb87-2295-4593-a8a8-ca9bb653d442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4feb22d7-7ae6-419e-a30f-48646a76ca70', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:03 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-74479e99-2835-49f5-aae5-125654a56742 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eabee74a-554e-4ba2-9fea-bd176885abfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:03 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-74479e99-2835-49f5-aae5-125654a56742 tempest-CreateVolumesFromSnapshotTest-469897697 None] Volume volume-4feb22d7-7ae6-419e-a30f-48646a76ca70 (4feb22d7-7ae6-419e-a30f-48646a76ca70): created successfully Jul 11 04:45:03 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-74479e99-2835-49f5-aae5-125654a56742 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eabee74a-554e-4ba2-9fea-bd176885abfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:03 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-74479e99-2835-49f5-aae5-125654a56742 tempest-CreateVolumesFromSnapshotTest-469897697 None] Flow 'volume_create_manager' (8e7b8322-35c2-4419-b6c1-0a4565063ca0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:45:03 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-74479e99-2835-49f5-aae5-125654a56742 tempest-CreateVolumesFromSnapshotTest-469897697 None] Created volume successfully. Jul 11 04:45:03 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2777b80e-698b-4d11-bfa4-32d8cb067a2e tempest-CreateVolumesFromImageTest-1045884161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ff8396e6-27a8-476d-b72b-33e0dd762713" returned: 0 in 0.682s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:03 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-2777b80e-698b-4d11-bfa4-32d8cb067a2e tempest-CreateVolumesFromImageTest-1045884161 None] Lock "cinder-quobyte-ff8396e6-27a8-476d-b72b-33e0dd762713" released by "delete_volume" :: held 1.542s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:03 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-2777b80e-698b-4d11-bfa4-32d8cb067a2e tempest-CreateVolumesFromImageTest-1045884161 None] Created reservations ['dbccf889-e38e-4895-94b5-fe57ea9bd310', '620e66c2-3fbd-44f9-a1d5-2adf2438db3f', 'b0649861-d15c-4be7-b408-377b736991b3', 'b447ae4e-e03c-4b51-b26f-282e85d48320'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:45:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2777b80e-698b-4d11-bfa4-32d8cb067a2e tempest-CreateVolumesFromImageTest-1045884161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2777b80e-698b-4d11-bfa4-32d8cb067a2e tempest-CreateVolumesFromImageTest-1045884161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:03 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2777b80e-698b-4d11-bfa4-32d8cb067a2e tempest-CreateVolumesFromImageTest-1045884161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:45:04 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2777b80e-698b-4d11-bfa4-32d8cb067a2e tempest-CreateVolumesFromImageTest-1045884161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:45:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2777b80e-698b-4d11-bfa4-32d8cb067a2e tempest-CreateVolumesFromImageTest-1045884161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2777b80e-698b-4d11-bfa4-32d8cb067a2e tempest-CreateVolumesFromImageTest-1045884161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:04 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:45:04 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:04 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff7c4674-18e2-443f-9b29-69c93cb18a60_oqk2d9dedevstack@QuobyteHD" returned: 0 in 0.778s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff7c4674-18e2-443f-9b29-69c93cb18a60_oqk2d9dedevstack@QuobyteHD {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:04 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff7c4674-18e2-443f-9b29-69c93cb18a60_oqk2d9dedevstack@QuobyteHD Jul 11 04:45:04 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:04 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-694929a0-d106-4db2-ae38-57c08443ceb0 tempest-CreateVolumesFromImageTest-1045884161 None] Acquiring lock "cinder-ff66446c-a262-4c52-ac6e-657e0f338f6c-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:04 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-694929a0-d106-4db2-ae38-57c08443ceb0 tempest-CreateVolumesFromImageTest-1045884161 None] Lock "cinder-ff66446c-a262-4c52-ac6e-657e0f338f6c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:04 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-694929a0-d106-4db2-ae38-57c08443ceb0 tempest-CreateVolumesFromImageTest-1045884161 None] Acquiring lock "cinder-quobyte-ff66446c-a262-4c52-ac6e-657e0f338f6c" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:04 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-694929a0-d106-4db2-ae38-57c08443ceb0 tempest-CreateVolumesFromImageTest-1045884161 None] Lock "cinder-quobyte-ff66446c-a262-4c52-ac6e-657e0f338f6c" acquired by "delete_volume" :: waited 0.030s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:04 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa811450-26ca-404b-a112-e13df970b022]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-694929a0-d106-4db2-ae38-57c08443ceb0 tempest-CreateVolumesFromImageTest-1045884161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ff66446c-a262-4c52-ac6e-657e0f338f6c {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:04 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c9e7846f-caee-4814-b877-dfabb42eadb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-344306c5-45b6-4844-b99c-fb5be87b538b 1073741824" returned: 0 in 1.000s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c9e7846f-caee-4814-b877-dfabb42eadb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-344306c5-45b6-4844-b99c-fb5be87b538b {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:04 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-344306c5-45b6-4844-b99c-fb5be87b538b Jul 11 04:45:04 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:04 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2777b80e-698b-4d11-bfa4-32d8cb067a2e tempest-CreateVolumesFromImageTest-1045884161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.758s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:04 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-2777b80e-698b-4d11-bfa4-32d8cb067a2e tempest-CreateVolumesFromImageTest-1045884161 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:45:04 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-2777b80e-698b-4d11-bfa4-32d8cb067a2e tempest-CreateVolumesFromImageTest-1045884161 None] Deleted volume successfully. Jul 11 04:45:04 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ff66446c-a262-4c52-ac6e-657e0f338f6c Jul 11 04:45:04 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:04 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-2777b80e-698b-4d11-bfa4-32d8cb067a2e tempest-CreateVolumesFromImageTest-1045884161 None] Lock "cinder-ff8396e6-27a8-476d-b72b-33e0dd762713-delete_volume" released by "delete_volume" :: held 2.518s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:05 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff7c4674-18e2-443f-9b29-69c93cb18a60_oqk2d9dedevstack@QuobyteHD" returned: 1 in 0.863s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff7c4674-18e2-443f-9b29-69c93cb18a60_oqk2d9dedevstack@QuobyteHD' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:45:05 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] ff7c4674-18e2-443f-9b29-69c93cb18a60 was raw, converting to raw {{(pid=86964) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 11 04:45:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ff7c4674-18e2-443f-9b29-69c93cb18a60_oqk2d9dedevstack@QuobyteHD /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f040d668-6eab-4a0f-aae6-7400da201fd1 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:05 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ff7c4674-18e2-443f-9b29-69c93cb18a60_oqk2d9dedevstack@QuobyteHD /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f040d668-6eab-4a0f-aae6-7400da201fd1 Jul 11 04:45:05 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:05 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c9e7846f-caee-4814-b877-dfabb42eadb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-344306c5-45b6-4844-b99c-fb5be87b538b" returned: 0 in 0.709s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:05 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c9e7846f-caee-4814-b877-dfabb42eadb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] <== create_volume: return (1763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:45:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c9e7846f-caee-4814-b877-dfabb42eadb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.769s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b6ce83b8-7b63-443d-9ddc-3c7ddc832a64 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.366s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:05 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b6ce83b8-7b63-443d-9ddc-3c7ddc832a64 tempest-CreateVolumesFromSnapshotTest-469897697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2068819495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6387afdd-91e2-453d-be97-e9cc5e29e90b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3674310985ed4178a2da2b95ec0adb67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:45:01Z,use_quota=True,user_id='a9770df9eb0d417c8e5e8c4d78e3316d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:45:05 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-b6ce83b8-7b63-443d-9ddc-3c7ddc832a64 tempest-CreateVolumesFromSnapshotTest-469897697 None] Creating volume 6387afdd-91e2-453d-be97-e9cc5e29e90b {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:45:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b6ce83b8-7b63-443d-9ddc-3c7ddc832a64 tempest-CreateVolumesFromSnapshotTest-469897697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b6ce83b8-7b63-443d-9ddc-3c7ddc832a64 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:05 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b6ce83b8-7b63-443d-9ddc-3c7ddc832a64 tempest-CreateVolumesFromSnapshotTest-469897697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:45:05 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b6ce83b8-7b63-443d-9ddc-3c7ddc832a64 tempest-CreateVolumesFromSnapshotTest-469897697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:45:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b6ce83b8-7b63-443d-9ddc-3c7ddc832a64 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:05 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b6ce83b8-7b63-443d-9ddc-3c7ddc832a64 tempest-CreateVolumesFromSnapshotTest-469897697 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:45:05 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-b6ce83b8-7b63-443d-9ddc-3c7ddc832a64 tempest-CreateVolumesFromSnapshotTest-469897697 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:45:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b6ce83b8-7b63-443d-9ddc-3c7ddc832a64 tempest-CreateVolumesFromSnapshotTest-469897697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6387afdd-91e2-453d-be97-e9cc5e29e90b 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:05 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c9e7846f-caee-4814-b877-dfabb42eadb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6f709e7-89da-4447-81c2-e7618b65fc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-344306c5-45b6-4844-b99c-fb5be87b538b', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:05 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6387afdd-91e2-453d-be97-e9cc5e29e90b 1073741824 Jul 11 04:45:05 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:05 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c9e7846f-caee-4814-b877-dfabb42eadb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (486b90c1-1b4b-4f5a-a0e0-3ca375624b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:05 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:05 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-c9e7846f-caee-4814-b877-dfabb42eadb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Volume volume-344306c5-45b6-4844-b99c-fb5be87b538b (344306c5-45b6-4844-b99c-fb5be87b538b): created successfully Jul 11 04:45:05 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c9e7846f-caee-4814-b877-dfabb42eadb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (486b90c1-1b4b-4f5a-a0e0-3ca375624b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:05 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c9e7846f-caee-4814-b877-dfabb42eadb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Flow 'volume_create_manager' (522debec-0a78-4c8d-a059-8563a35b1d38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:45:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-694929a0-d106-4db2-ae38-57c08443ceb0 tempest-CreateVolumesFromImageTest-1045884161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ff66446c-a262-4c52-ac6e-657e0f338f6c" returned: 0 in 0.868s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-694929a0-d106-4db2-ae38-57c08443ceb0 tempest-CreateVolumesFromImageTest-1045884161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ff66446c-a262-4c52-ac6e-657e0f338f6c {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:05 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-c9e7846f-caee-4814-b877-dfabb42eadb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Created volume successfully. Jul 11 04:45:05 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ff66446c-a262-4c52-ac6e-657e0f338f6c Jul 11 04:45:05 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:06 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ff7c4674-18e2-443f-9b29-69c93cb18a60_oqk2d9dedevstack@QuobyteHD /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f040d668-6eab-4a0f-aae6-7400da201fd1" returned: 0 in 0.889s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:06 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ff7c4674-18e2-443f-9b29-69c93cb18a60_oqk2d9dedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f040d668-6eab-4a0f-aae6-7400da201fd1 {{(pid=86964) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 04:45:06 devstack cinder-volume[86964]: INFO cinder.image.image_utils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Converted 0.00 MB image at 0.00 MB/s Jul 11 04:45:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f040d668-6eab-4a0f-aae6-7400da201fd1 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:06 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f040d668-6eab-4a0f-aae6-7400da201fd1 1G Jul 11 04:45:06 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:06 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-694929a0-d106-4db2-ae38-57c08443ceb0 tempest-CreateVolumesFromImageTest-1045884161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ff66446c-a262-4c52-ac6e-657e0f338f6c" returned: 0 in 0.770s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:06 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-694929a0-d106-4db2-ae38-57c08443ceb0 tempest-CreateVolumesFromImageTest-1045884161 None] Lock "cinder-quobyte-ff66446c-a262-4c52-ac6e-657e0f338f6c" released by "delete_volume" :: held 1.696s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:06 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b6ce83b8-7b63-443d-9ddc-3c7ddc832a64 tempest-CreateVolumesFromSnapshotTest-469897697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6387afdd-91e2-453d-be97-e9cc5e29e90b 1073741824" returned: 0 in 0.862s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b6ce83b8-7b63-443d-9ddc-3c7ddc832a64 tempest-CreateVolumesFromSnapshotTest-469897697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6387afdd-91e2-453d-be97-e9cc5e29e90b {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:06 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-694929a0-d106-4db2-ae38-57c08443ceb0 tempest-CreateVolumesFromImageTest-1045884161 None] Created reservations ['11f268f4-2576-457b-ade1-28d36cd1896b', '0334bd85-6b78-4b4b-8a74-f01120359b3d', '6ac8e71b-ace1-4e4f-9eb5-62efa26127ce', '4038e13c-da8d-40c3-8498-2a6f08d1b5e1'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:45:06 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6387afdd-91e2-453d-be97-e9cc5e29e90b Jul 11 04:45:06 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-694929a0-d106-4db2-ae38-57c08443ceb0 tempest-CreateVolumesFromImageTest-1045884161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-694929a0-d106-4db2-ae38-57c08443ceb0 tempest-CreateVolumesFromImageTest-1045884161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-694929a0-d106-4db2-ae38-57c08443ceb0 tempest-CreateVolumesFromImageTest-1045884161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:45:06 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-694929a0-d106-4db2-ae38-57c08443ceb0 tempest-CreateVolumesFromImageTest-1045884161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:45:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-694929a0-d106-4db2-ae38-57c08443ceb0 tempest-CreateVolumesFromImageTest-1045884161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-694929a0-d106-4db2-ae38-57c08443ceb0 tempest-CreateVolumesFromImageTest-1045884161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:06 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:45:06 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:06 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f040d668-6eab-4a0f-aae6-7400da201fd1 1G" returned: 0 in 0.752s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:06 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e44e0c9-df36-4e1b-82fa-a8fda7f29b47]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f040d668-6eab-4a0f-aae6-7400da201fd1 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:07 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b6ce83b8-7b63-443d-9ddc-3c7ddc832a64 tempest-CreateVolumesFromSnapshotTest-469897697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6387afdd-91e2-453d-be97-e9cc5e29e90b" returned: 0 in 0.689s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:07 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b6ce83b8-7b63-443d-9ddc-3c7ddc832a64 tempest-CreateVolumesFromSnapshotTest-469897697 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:45:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b6ce83b8-7b63-443d-9ddc-3c7ddc832a64 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e95a7f86-f17e-4dba-b78d-42106995a9dc tempest-ProjectReaderTests-787132287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.975s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:07 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f040d668-6eab-4a0f-aae6-7400da201fd1 Jul 11 04:45:07 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:07 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-e95a7f86-f17e-4dba-b78d-42106995a9dc tempest-ProjectReaderTests-787132287 None] Creating offline snapshot ecad0ab6-e142-47c6-a501-68c82e644333 of volume 99206423-1e47-40d7-96b7-49c8ae6f75c5 {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:45:07 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b6ce83b8-7b63-443d-9ddc-3c7ddc832a64 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b5788d5-20ac-4e41-83c5-6aca536c4a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6387afdd-91e2-453d-be97-e9cc5e29e90b', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:07 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b6ce83b8-7b63-443d-9ddc-3c7ddc832a64 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce692dd7-95ec-4d59-8531-a216a7c076d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:07 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f4b11b-4eae-4978-8670-e28c1ef19961]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e95a7f86-f17e-4dba-b78d-42106995a9dc tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:07 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-b6ce83b8-7b63-443d-9ddc-3c7ddc832a64 tempest-CreateVolumesFromSnapshotTest-469897697 None] Volume volume-6387afdd-91e2-453d-be97-e9cc5e29e90b (6387afdd-91e2-453d-be97-e9cc5e29e90b): created successfully Jul 11 04:45:07 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b6ce83b8-7b63-443d-9ddc-3c7ddc832a64 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce692dd7-95ec-4d59-8531-a216a7c076d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:07 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b6ce83b8-7b63-443d-9ddc-3c7ddc832a64 tempest-CreateVolumesFromSnapshotTest-469897697 None] Flow 'volume_create_manager' (dd3eb306-1db6-4839-bfd0-ff7b1a3f8d8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:45:07 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-b6ce83b8-7b63-443d-9ddc-3c7ddc832a64 tempest-CreateVolumesFromSnapshotTest-469897697 None] Created volume successfully. Jul 11 04:45:07 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-694929a0-d106-4db2-ae38-57c08443ceb0 tempest-CreateVolumesFromImageTest-1045884161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.781s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:07 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-694929a0-d106-4db2-ae38-57c08443ceb0 tempest-CreateVolumesFromImageTest-1045884161 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:45:07 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-694929a0-d106-4db2-ae38-57c08443ceb0 tempest-CreateVolumesFromImageTest-1045884161 None] Deleted volume successfully. Jul 11 04:45:07 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5 Jul 11 04:45:07 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-694929a0-d106-4db2-ae38-57c08443ceb0 tempest-CreateVolumesFromImageTest-1045884161 None] Lock "cinder-ff66446c-a262-4c52-ac6e-657e0f338f6c-delete_volume" released by "delete_volume" :: held 2.745s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:07 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:07 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f040d668-6eab-4a0f-aae6-7400da201fd1" returned: 0 in 0.901s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f040d668-6eab-4a0f-aae6-7400da201fd1 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:07 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f040d668-6eab-4a0f-aae6-7400da201fd1 Jul 11 04:45:07 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:08 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e95a7f86-f17e-4dba-b78d-42106995a9dc tempest-ProjectReaderTests-787132287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5" returned: 0 in 0.894s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e95a7f86-f17e-4dba-b78d-42106995a9dc tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5.ecad0ab6-e142-47c6-a501-68c82e644333 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:08 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5.ecad0ab6-e142-47c6-a501-68c82e644333 1G Jul 11 04:45:08 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:08 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f040d668-6eab-4a0f-aae6-7400da201fd1" returned: 1 in 0.839s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f040d668-6eab-4a0f-aae6-7400da201fd1' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:45:08 devstack cinder-volume[86964]: DEBUG cinder.volume.volume_utils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Downloaded image ff7c4674-18e2-443f-9b29-69c93cb18a60 ((None, [{'url': 'file:///opt/stack/data/glance/images/ff7c4674-18e2-443f-9b29-69c93cb18a60', 'metadata': {}}])) to volume f040d668-6eab-4a0f-aae6-7400da201fd1 successfully. {{(pid=86964) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 04:45:08 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Temporary image ff7c4674-18e2-443f-9b29-69c93cb18a60 for user a37402ada2354485989fd398a6bae6db is deleted. {{(pid=86964) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 11 04:45:08 devstack cinder-volume[86964]: DEBUG cinder.volume.volume_utils [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Marking volume f040d668-6eab-4a0f-aae6-7400da201fd1 as bootable. {{(pid=86964) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 04:45:08 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Copying metadata from image ff7c4674-18e2-443f-9b29-69c93cb18a60 to f040d668-6eab-4a0f-aae6-7400da201fd1. {{(pid=86964) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 04:45:08 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Creating volume glance metadata for volume f040d668-6eab-4a0f-aae6-7400da201fd1 backed by image ff7c4674-18e2-443f-9b29-69c93cb18a60 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ff7c4674-18e2-443f-9b29-69c93cb18a60', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '1bab48c0aaba8ca5c29067e2bb6b582a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86964) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 04:45:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c284fb60-4021-4f7b-8b0c-a02e0e339b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f040d668-6eab-4a0f-aae6-7400da201fd1', 'volume_size': 1, 'image_id': 'ff7c4674-18e2-443f-9b29-69c93cb18a60', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ff7c4674-18e2-443f-9b29-69c93cb18a60', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1bab48c0aaba8ca5c29067e2bb6b582a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4e8c47d22e1e4b748bbed21a12bf959c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '548897437e986a836a8a30cda15126175050b9ea57147ea0360a698657576eba4314d33ae706e084f8d29dc98ee27d629e0ac7683f50457c28c7ba8792c02e36', 'id': 'ff7c4674-18e2-443f-9b29-69c93cb18a60', 'created_at': datetime.datetime(2026, 7, 11, 2, 44, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 44, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ff7c4674-18e2-443f-9b29-69c93cb18a60/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89affe90-5beb-46b6-81ea-582e7ad45a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:08 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Volume volume-f040d668-6eab-4a0f-aae6-7400da201fd1 (f040d668-6eab-4a0f-aae6-7400da201fd1): created successfully Jul 11 04:45:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89affe90-5beb-46b6-81ea-582e7ad45a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Flow 'volume_create_manager' (a35a5884-20be-4c40-998b-56440d1effa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:45:08 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-17e93d7c-9570-442e-93cc-4782f881f68c tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Created volume successfully. Jul 11 04:45:08 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e95a7f86-f17e-4dba-b78d-42106995a9dc tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5.ecad0ab6-e142-47c6-a501-68c82e644333 1G" returned: 0 in 0.968s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e95a7f86-f17e-4dba-b78d-42106995a9dc tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99206423-1e47-40d7-96b7-49c8ae6f75c5 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5.ecad0ab6-e142-47c6-a501-68c82e644333 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:09 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99206423-1e47-40d7-96b7-49c8ae6f75c5 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5.ecad0ab6-e142-47c6-a501-68c82e644333 Jul 11 04:45:09 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:09 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-2b2eae6b-0922-4392-891b-5b18ba02f23f tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Acquiring lock "cinder-f040d668-6eab-4a0f-aae6-7400da201fd1-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:09 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-2b2eae6b-0922-4392-891b-5b18ba02f23f tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Lock "cinder-f040d668-6eab-4a0f-aae6-7400da201fd1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:09 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-2b2eae6b-0922-4392-891b-5b18ba02f23f tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Acquiring lock "cinder-quobyte-f040d668-6eab-4a0f-aae6-7400da201fd1" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:09 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-2b2eae6b-0922-4392-891b-5b18ba02f23f tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Lock "cinder-quobyte-f040d668-6eab-4a0f-aae6-7400da201fd1" acquired by "delete_volume" :: waited 0.027s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:09 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[68db964f-b035-454c-9600-4cc6afbecea3]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2b2eae6b-0922-4392-891b-5b18ba02f23f tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f040d668-6eab-4a0f-aae6-7400da201fd1 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:09 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e95a7f86-f17e-4dba-b78d-42106995a9dc tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99206423-1e47-40d7-96b7-49c8ae6f75c5 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5.ecad0ab6-e142-47c6-a501-68c82e644333" returned: 0 in 0.788s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:09 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-e95a7f86-f17e-4dba-b78d-42106995a9dc tempest-ProjectReaderTests-787132287 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5.ecad0ab6-e142-47c6-a501-68c82e644333 is being set with open permissions: ugo+rw Jul 11 04:45:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e95a7f86-f17e-4dba-b78d-42106995a9dc tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5.ecad0ab6-e142-47c6-a501-68c82e644333 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:09 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5.ecad0ab6-e142-47c6-a501-68c82e644333 Jul 11 04:45:09 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:09 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f040d668-6eab-4a0f-aae6-7400da201fd1 Jul 11 04:45:09 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:10 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5eac56d-1f04-4868-83c4-e36d1f913908 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:45:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c5eac56d-1f04-4868-83c4-e36d1f913908 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Flow 'volume_create_manager' (6ee8eca8-8e5a-496a-b958-893d8be8006b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:45:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c5eac56d-1f04-4868-83c4-e36d1f913908 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42dc02fe-905f-4b4c-9867-1f6f051dfb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c5eac56d-1f04-4868-83c4-e36d1f913908 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42dc02fe-905f-4b4c-9867-1f6f051dfb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:45:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1139624311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=424d5fd7-7189-428b-b5de-9cd253035a83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41933e9eac842fc98c37003c26e8b14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:45:10Z,use_quota=True,user_id='b382014fe726416599d9531d4e7788ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c5eac56d-1f04-4868-83c4-e36d1f913908 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93a0068b-690c-408c-970a-6e6240d0c1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c5eac56d-1f04-4868-83c4-e36d1f913908 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93a0068b-690c-408c-970a-6e6240d0c1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c5eac56d-1f04-4868-83c4-e36d1f913908 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab0caa2c-8f7e-4279-b046-ebe2bdd2ccc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c5eac56d-1f04-4868-83c4-e36d1f913908 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab0caa2c-8f7e-4279-b046-ebe2bdd2ccc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '424d5fd7-7189-428b-b5de-9cd253035a83', 'volume_name': 'volume-424d5fd7-7189-428b-b5de-9cd253035a83', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c5eac56d-1f04-4868-83c4-e36d1f913908 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f83cd1ca-dbc7-416c-8543-43654b48cc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c5eac56d-1f04-4868-83c4-e36d1f913908 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f83cd1ca-dbc7-416c-8543-43654b48cc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c5eac56d-1f04-4868-83c4-e36d1f913908 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f233b53-1a30-4911-ac4f-9315a31b89db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:10 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-c5eac56d-1f04-4868-83c4-e36d1f913908 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Volume 424d5fd7-7189-428b-b5de-9cd253035a83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-424d5fd7-7189-428b-b5de-9cd253035a83', 'volume_size': 1} Jul 11 04:45:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c5eac56d-1f04-4868-83c4-e36d1f913908 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:10 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e95a7f86-f17e-4dba-b78d-42106995a9dc tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5.ecad0ab6-e142-47c6-a501-68c82e644333" returned: 0 in 0.718s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:10 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2b2eae6b-0922-4392-891b-5b18ba02f23f tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f040d668-6eab-4a0f-aae6-7400da201fd1" returned: 0 in 0.807s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2b2eae6b-0922-4392-891b-5b18ba02f23f tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f040d668-6eab-4a0f-aae6-7400da201fd1 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e95a7f86-f17e-4dba-b78d-42106995a9dc tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:10 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5.info Jul 11 04:45:10 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:10 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f040d668-6eab-4a0f-aae6-7400da201fd1 Jul 11 04:45:10 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:11 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e95a7f86-f17e-4dba-b78d-42106995a9dc tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5.info" returned: 0 in 0.665s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:11 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-e95a7f86-f17e-4dba-b78d-42106995a9dc tempest-ProjectReaderTests-787132287 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5.info is being set with open permissions: ugo+rw Jul 11 04:45:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e95a7f86-f17e-4dba-b78d-42106995a9dc tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:11 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5.info Jul 11 04:45:11 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:11 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2b2eae6b-0922-4392-891b-5b18ba02f23f tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f040d668-6eab-4a0f-aae6-7400da201fd1" returned: 1 in 0.761s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2b2eae6b-0922-4392-891b-5b18ba02f23f tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f040d668-6eab-4a0f-aae6-7400da201fd1' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:45:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2b2eae6b-0922-4392-891b-5b18ba02f23f tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f040d668-6eab-4a0f-aae6-7400da201fd1 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:11 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f040d668-6eab-4a0f-aae6-7400da201fd1 Jul 11 04:45:11 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:11 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e95a7f86-f17e-4dba-b78d-42106995a9dc tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5.info" returned: 0 in 0.645s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e95a7f86-f17e-4dba-b78d-42106995a9dc tempest-ProjectReaderTests-787132287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.801s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-565703f3-acb9-4d1d-9e84-49093db67482 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.412s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:11 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-565703f3-acb9-4d1d-9e84-49093db67482 tempest-CreateVolumesFromSnapshotTest-469897697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1925116515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e3fcd2c-0c17-4d49-9062-c6691e499351,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3674310985ed4178a2da2b95ec0adb67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:45:01Z,use_quota=True,user_id='a9770df9eb0d417c8e5e8c4d78e3316d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:45:11 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-565703f3-acb9-4d1d-9e84-49093db67482 tempest-CreateVolumesFromSnapshotTest-469897697 None] Creating volume 9e3fcd2c-0c17-4d49-9062-c6691e499351 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:45:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-565703f3-acb9-4d1d-9e84-49093db67482 tempest-CreateVolumesFromSnapshotTest-469897697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-565703f3-acb9-4d1d-9e84-49093db67482 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:11 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-565703f3-acb9-4d1d-9e84-49093db67482 tempest-CreateVolumesFromSnapshotTest-469897697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:45:11 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-565703f3-acb9-4d1d-9e84-49093db67482 tempest-CreateVolumesFromSnapshotTest-469897697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:45:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-565703f3-acb9-4d1d-9e84-49093db67482 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:11 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-565703f3-acb9-4d1d-9e84-49093db67482 tempest-CreateVolumesFromSnapshotTest-469897697 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:45:11 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-565703f3-acb9-4d1d-9e84-49093db67482 tempest-CreateVolumesFromSnapshotTest-469897697 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:45:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-565703f3-acb9-4d1d-9e84-49093db67482 tempest-CreateVolumesFromSnapshotTest-469897697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9e3fcd2c-0c17-4d49-9062-c6691e499351 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:11 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9e3fcd2c-0c17-4d49-9062-c6691e499351 1073741824 Jul 11 04:45:11 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:11 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-e95a7f86-f17e-4dba-b78d-42106995a9dc tempest-ProjectReaderTests-787132287 None] Create snapshot completed successfully Jul 11 04:45:11 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2b2eae6b-0922-4392-891b-5b18ba02f23f tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-f040d668-6eab-4a0f-aae6-7400da201fd1" returned: 0 in 0.675s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:11 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-2b2eae6b-0922-4392-891b-5b18ba02f23f tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Lock "cinder-quobyte-f040d668-6eab-4a0f-aae6-7400da201fd1" released by "delete_volume" :: held 2.304s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:12 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-2b2eae6b-0922-4392-891b-5b18ba02f23f tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Created reservations ['27d49fb7-e4c0-4fdb-a0d7-b56efe16078e', '49cc0159-a8b6-4bf2-b3c1-cf19b5b875c0', '324f44b9-9963-4ab6-adad-0ba94ef7fe04', '536bbcbb-5f6d-4a72-9942-74ccd7df5c57'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:45:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2b2eae6b-0922-4392-891b-5b18ba02f23f tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2b2eae6b-0922-4392-891b-5b18ba02f23f tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:12 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2b2eae6b-0922-4392-891b-5b18ba02f23f tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:45:12 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2b2eae6b-0922-4392-891b-5b18ba02f23f tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:45:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2b2eae6b-0922-4392-891b-5b18ba02f23f tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2b2eae6b-0922-4392-891b-5b18ba02f23f tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:12 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:45:12 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:12 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-27bb5299-d44f-4440-a671-ee53254c6eae tempest-ProjectReaderTests-787132287 None] Acquiring lock "cinder-ecad0ab6-e142-47c6-a501-68c82e644333-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:12 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-27bb5299-d44f-4440-a671-ee53254c6eae tempest-ProjectReaderTests-787132287 None] Lock "cinder-ecad0ab6-e142-47c6-a501-68c82e644333-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:12 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-27bb5299-d44f-4440-a671-ee53254c6eae tempest-ProjectReaderTests-787132287 None] Acquiring lock "cinder-quobyte-99206423-1e47-40d7-96b7-49c8ae6f75c5" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:12 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-27bb5299-d44f-4440-a671-ee53254c6eae tempest-ProjectReaderTests-787132287 None] Lock "cinder-quobyte-99206423-1e47-40d7-96b7-49c8ae6f75c5" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:12 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-27bb5299-d44f-4440-a671-ee53254c6eae tempest-ProjectReaderTests-787132287 None] Acquiring lock "cinder-quobyte-ecad0ab6-e142-47c6-a501-68c82e644333" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:12 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-27bb5299-d44f-4440-a671-ee53254c6eae tempest-ProjectReaderTests-787132287 None] Lock "cinder-quobyte-ecad0ab6-e142-47c6-a501-68c82e644333" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:12 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-27bb5299-d44f-4440-a671-ee53254c6eae tempest-ProjectReaderTests-787132287 None] Deleting offline snapshot ecad0ab6-e142-47c6-a501-68c82e644333 of volume 99206423-1e47-40d7-96b7-49c8ae6f75c5 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:45:12 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-27bb5299-d44f-4440-a671-ee53254c6eae tempest-ProjectReaderTests-787132287 None] snapshot_file for this snap is: volume-99206423-1e47-40d7-96b7-49c8ae6f75c5.ecad0ab6-e142-47c6-a501-68c82e644333 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:45:12 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1a908d-f394-402d-ab12-11b5d2d10719]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-27bb5299-d44f-4440-a671-ee53254c6eae tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5.ecad0ab6-e142-47c6-a501-68c82e644333 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:12 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-565703f3-acb9-4d1d-9e84-49093db67482 tempest-CreateVolumesFromSnapshotTest-469897697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9e3fcd2c-0c17-4d49-9062-c6691e499351 1073741824" returned: 0 in 0.906s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:12 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2b2eae6b-0922-4392-891b-5b18ba02f23f tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.716s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:12 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-2b2eae6b-0922-4392-891b-5b18ba02f23f tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:45:12 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-2b2eae6b-0922-4392-891b-5b18ba02f23f tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Deleted volume successfully. Jul 11 04:45:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-565703f3-acb9-4d1d-9e84-49093db67482 tempest-CreateVolumesFromSnapshotTest-469897697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9e3fcd2c-0c17-4d49-9062-c6691e499351 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:12 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-2b2eae6b-0922-4392-891b-5b18ba02f23f tempest-VolumeAndVolumeTypeFromImageTest-1045525374 None] Lock "cinder-f040d668-6eab-4a0f-aae6-7400da201fd1-delete_volume" released by "delete_volume" :: held 3.272s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:12 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9e3fcd2c-0c17-4d49-9062-c6691e499351 Jul 11 04:45:12 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:12 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5.ecad0ab6-e142-47c6-a501-68c82e644333 Jul 11 04:45:12 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:13 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-565703f3-acb9-4d1d-9e84-49093db67482 tempest-CreateVolumesFromSnapshotTest-469897697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9e3fcd2c-0c17-4d49-9062-c6691e499351" returned: 0 in 0.737s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:13 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-565703f3-acb9-4d1d-9e84-49093db67482 tempest-CreateVolumesFromSnapshotTest-469897697 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:45:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-565703f3-acb9-4d1d-9e84-49093db67482 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-463b35c5-49b3-4d5d-93b2-4862d60b226e tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.800s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:13 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-463b35c5-49b3-4d5d-93b2-4862d60b226e tempest-CreateVolumesFromSnapshotTest-469897697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-745958029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f2ce532-4aec-45fd-98bd-46b6f8201033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3674310985ed4178a2da2b95ec0adb67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:45:02Z,use_quota=True,user_id='a9770df9eb0d417c8e5e8c4d78e3316d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:45:13 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-463b35c5-49b3-4d5d-93b2-4862d60b226e tempest-CreateVolumesFromSnapshotTest-469897697 None] Creating volume 6f2ce532-4aec-45fd-98bd-46b6f8201033 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:45:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-463b35c5-49b3-4d5d-93b2-4862d60b226e tempest-CreateVolumesFromSnapshotTest-469897697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-463b35c5-49b3-4d5d-93b2-4862d60b226e tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:13 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-463b35c5-49b3-4d5d-93b2-4862d60b226e tempest-CreateVolumesFromSnapshotTest-469897697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:45:13 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-463b35c5-49b3-4d5d-93b2-4862d60b226e tempest-CreateVolumesFromSnapshotTest-469897697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:45:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-463b35c5-49b3-4d5d-93b2-4862d60b226e tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:13 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-463b35c5-49b3-4d5d-93b2-4862d60b226e tempest-CreateVolumesFromSnapshotTest-469897697 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:45:13 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-463b35c5-49b3-4d5d-93b2-4862d60b226e tempest-CreateVolumesFromSnapshotTest-469897697 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:45:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-463b35c5-49b3-4d5d-93b2-4862d60b226e tempest-CreateVolumesFromSnapshotTest-469897697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6f2ce532-4aec-45fd-98bd-46b6f8201033 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-565703f3-acb9-4d1d-9e84-49093db67482 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35b8864e-ed1b-42d0-b0d2-82946b0daacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e3fcd2c-0c17-4d49-9062-c6691e499351', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-565703f3-acb9-4d1d-9e84-49093db67482 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d9b1926-b25c-40ba-94be-5d8db52e51f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:13 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6f2ce532-4aec-45fd-98bd-46b6f8201033 1073741824 Jul 11 04:45:13 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:13 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-565703f3-acb9-4d1d-9e84-49093db67482 tempest-CreateVolumesFromSnapshotTest-469897697 None] Volume volume-9e3fcd2c-0c17-4d49-9062-c6691e499351 (9e3fcd2c-0c17-4d49-9062-c6691e499351): created successfully Jul 11 04:45:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-565703f3-acb9-4d1d-9e84-49093db67482 tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d9b1926-b25c-40ba-94be-5d8db52e51f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:13 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-565703f3-acb9-4d1d-9e84-49093db67482 tempest-CreateVolumesFromSnapshotTest-469897697 None] Flow 'volume_create_manager' (504b3e41-a39b-47e6-8bd5-deea008be75a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:45:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-27bb5299-d44f-4440-a671-ee53254c6eae tempest-ProjectReaderTests-787132287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5.ecad0ab6-e142-47c6-a501-68c82e644333" returned: 0 in 0.926s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:13 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-27bb5299-d44f-4440-a671-ee53254c6eae tempest-ProjectReaderTests-787132287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99206423-1e47-40d7-96b7-49c8ae6f75c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:45:13 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-565703f3-acb9-4d1d-9e84-49093db67482 tempest-CreateVolumesFromSnapshotTest-469897697 None] Created volume successfully. Jul 11 04:45:13 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91fde0b-4356-4727-a690-a2b0ba30bf6f]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-27bb5299-d44f-4440-a671-ee53254c6eae tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:13 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5 Jul 11 04:45:13 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:14 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-463b35c5-49b3-4d5d-93b2-4862d60b226e tempest-CreateVolumesFromSnapshotTest-469897697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6f2ce532-4aec-45fd-98bd-46b6f8201033 1073741824" returned: 0 in 0.989s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-463b35c5-49b3-4d5d-93b2-4862d60b226e tempest-CreateVolumesFromSnapshotTest-469897697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6f2ce532-4aec-45fd-98bd-46b6f8201033 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:14 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-27bb5299-d44f-4440-a671-ee53254c6eae tempest-ProjectReaderTests-787132287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5" returned: 0 in 0.903s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-27bb5299-d44f-4440-a671-ee53254c6eae tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5.ecad0ab6-e142-47c6-a501-68c82e644333 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:14 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6f2ce532-4aec-45fd-98bd-46b6f8201033 Jul 11 04:45:14 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:14 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5.ecad0ab6-e142-47c6-a501-68c82e644333 Jul 11 04:45:14 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:15 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-463b35c5-49b3-4d5d-93b2-4862d60b226e tempest-CreateVolumesFromSnapshotTest-469897697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6f2ce532-4aec-45fd-98bd-46b6f8201033" returned: 0 in 0.754s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:15 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-463b35c5-49b3-4d5d-93b2-4862d60b226e tempest-CreateVolumesFromSnapshotTest-469897697 None] <== create_volume: return (1808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:45:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-463b35c5-49b3-4d5d-93b2-4862d60b226e tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.811s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c5eac56d-1f04-4868-83c4-e36d1f913908 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.298s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:15 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c5eac56d-1f04-4868-83c4-e36d1f913908 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:45:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1139624311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=424d5fd7-7189-428b-b5de-9cd253035a83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41933e9eac842fc98c37003c26e8b14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:45:10Z,use_quota=True,user_id='b382014fe726416599d9531d4e7788ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:45:15 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-c5eac56d-1f04-4868-83c4-e36d1f913908 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Creating volume 424d5fd7-7189-428b-b5de-9cd253035a83 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:45:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c5eac56d-1f04-4868-83c4-e36d1f913908 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c5eac56d-1f04-4868-83c4-e36d1f913908 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:15 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c5eac56d-1f04-4868-83c4-e36d1f913908 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:45:15 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c5eac56d-1f04-4868-83c4-e36d1f913908 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:45:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c5eac56d-1f04-4868-83c4-e36d1f913908 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:15 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c5eac56d-1f04-4868-83c4-e36d1f913908 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:45:15 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-c5eac56d-1f04-4868-83c4-e36d1f913908 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:45:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c5eac56d-1f04-4868-83c4-e36d1f913908 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-424d5fd7-7189-428b-b5de-9cd253035a83 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:15 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-463b35c5-49b3-4d5d-93b2-4862d60b226e tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6e54938-0bdc-4851-a5de-491aef317dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f2ce532-4aec-45fd-98bd-46b6f8201033', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:15 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-463b35c5-49b3-4d5d-93b2-4862d60b226e tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe49268d-4441-4d65-837b-2b2d2a1462a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:15 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-424d5fd7-7189-428b-b5de-9cd253035a83 1073741824 Jul 11 04:45:15 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:15 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-463b35c5-49b3-4d5d-93b2-4862d60b226e tempest-CreateVolumesFromSnapshotTest-469897697 None] Volume volume-6f2ce532-4aec-45fd-98bd-46b6f8201033 (6f2ce532-4aec-45fd-98bd-46b6f8201033): created successfully Jul 11 04:45:15 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-463b35c5-49b3-4d5d-93b2-4862d60b226e tempest-CreateVolumesFromSnapshotTest-469897697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe49268d-4441-4d65-837b-2b2d2a1462a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:15 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-463b35c5-49b3-4d5d-93b2-4862d60b226e tempest-CreateVolumesFromSnapshotTest-469897697 None] Flow 'volume_create_manager' (682363f9-a3f9-423d-9d4b-720d3c711329) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:45:15 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-463b35c5-49b3-4d5d-93b2-4862d60b226e tempest-CreateVolumesFromSnapshotTest-469897697 None] Created volume successfully. Jul 11 04:45:15 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-27bb5299-d44f-4440-a671-ee53254c6eae tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5.ecad0ab6-e142-47c6-a501-68c82e644333" returned: 0 in 0.973s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-27bb5299-d44f-4440-a671-ee53254c6eae tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5.ecad0ab6-e142-47c6-a501-68c82e644333 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:15 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5.ecad0ab6-e142-47c6-a501-68c82e644333 Jul 11 04:45:15 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:16 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fe927fd0-e651-421c-bd7e-1cdc1f85b3c1 tempest-CreateVolumesFromSnapshotTest-469897697 None] Acquiring lock "cinder-6f2ce532-4aec-45fd-98bd-46b6f8201033-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:16 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fe927fd0-e651-421c-bd7e-1cdc1f85b3c1 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "cinder-6f2ce532-4aec-45fd-98bd-46b6f8201033-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:16 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fe927fd0-e651-421c-bd7e-1cdc1f85b3c1 tempest-CreateVolumesFromSnapshotTest-469897697 None] Acquiring lock "cinder-quobyte-6f2ce532-4aec-45fd-98bd-46b6f8201033" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:16 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fe927fd0-e651-421c-bd7e-1cdc1f85b3c1 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "cinder-quobyte-6f2ce532-4aec-45fd-98bd-46b6f8201033" acquired by "delete_volume" :: waited 0.028s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:16 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[5114b9bb-f391-440d-a10b-9ebb83efe782]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fe927fd0-e651-421c-bd7e-1cdc1f85b3c1 tempest-CreateVolumesFromSnapshotTest-469897697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6f2ce532-4aec-45fd-98bd-46b6f8201033 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:16 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6f2ce532-4aec-45fd-98bd-46b6f8201033 Jul 11 04:45:16 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:16 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c5eac56d-1f04-4868-83c4-e36d1f913908 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-424d5fd7-7189-428b-b5de-9cd253035a83 1073741824" returned: 0 in 1.012s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:16 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c5eac56d-1f04-4868-83c4-e36d1f913908 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-424d5fd7-7189-428b-b5de-9cd253035a83 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-27bb5299-d44f-4440-a671-ee53254c6eae tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5.ecad0ab6-e142-47c6-a501-68c82e644333" returned: 0 in 0.848s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:16 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-424d5fd7-7189-428b-b5de-9cd253035a83 Jul 11 04:45:16 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:16 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-27bb5299-d44f-4440-a671-ee53254c6eae tempest-ProjectReaderTests-787132287 None] Lock "cinder-quobyte-ecad0ab6-e142-47c6-a501-68c82e644333" released by "_delete_snapshot" :: held 3.793s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:16 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-27bb5299-d44f-4440-a671-ee53254c6eae tempest-ProjectReaderTests-787132287 None] Lock "cinder-quobyte-99206423-1e47-40d7-96b7-49c8ae6f75c5" released by "delete_snapshot" :: held 3.819s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:16 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-27bb5299-d44f-4440-a671-ee53254c6eae tempest-ProjectReaderTests-787132287 None] Created reservations ['ce8918a0-be1a-405c-ace0-ec9501f0bf01', '4b194caa-c28f-4239-a171-221320531f0d', '09a42730-fe59-473e-b728-ef42b70a6809', '642a45d5-ffea-49fa-a826-9ab975b601c0'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:45:16 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-27bb5299-d44f-4440-a671-ee53254c6eae tempest-ProjectReaderTests-787132287 None] Delete snapshot completed successfully. Jul 11 04:45:16 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-27bb5299-d44f-4440-a671-ee53254c6eae tempest-ProjectReaderTests-787132287 None] Lock "cinder-ecad0ab6-e142-47c6-a501-68c82e644333-delete_snapshot" released by "delete_snapshot" :: held 4.010s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ce3f2f8b-d244-4624-9c76-fd7fd77e1bfc tempest-ProjectReaderTests-787132287 None] Acquiring lock "cinder-99206423-1e47-40d7-96b7-49c8ae6f75c5-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ce3f2f8b-d244-4624-9c76-fd7fd77e1bfc tempest-ProjectReaderTests-787132287 None] Lock "cinder-99206423-1e47-40d7-96b7-49c8ae6f75c5-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:17 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fe927fd0-e651-421c-bd7e-1cdc1f85b3c1 tempest-CreateVolumesFromSnapshotTest-469897697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6f2ce532-4aec-45fd-98bd-46b6f8201033" returned: 0 in 0.962s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ce3f2f8b-d244-4624-9c76-fd7fd77e1bfc tempest-ProjectReaderTests-787132287 None] Acquiring lock "cinder-quobyte-99206423-1e47-40d7-96b7-49c8ae6f75c5" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fe927fd0-e651-421c-bd7e-1cdc1f85b3c1 tempest-CreateVolumesFromSnapshotTest-469897697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6f2ce532-4aec-45fd-98bd-46b6f8201033 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ce3f2f8b-d244-4624-9c76-fd7fd77e1bfc tempest-ProjectReaderTests-787132287 None] Lock "cinder-quobyte-99206423-1e47-40d7-96b7-49c8ae6f75c5" acquired by "delete_volume" :: waited 0.038s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:17 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6f2ce532-4aec-45fd-98bd-46b6f8201033 Jul 11 04:45:17 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:17 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbd1d3d-0d52-4094-a135-6d8019ebf57d]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ce3f2f8b-d244-4624-9c76-fd7fd77e1bfc tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:17 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c5eac56d-1f04-4868-83c4-e36d1f913908 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-424d5fd7-7189-428b-b5de-9cd253035a83" returned: 0 in 0.836s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:17 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c5eac56d-1f04-4868-83c4-e36d1f913908 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] <== create_volume: return (1903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:45:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c5eac56d-1f04-4868-83c4-e36d1f913908 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.906s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:17 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c5eac56d-1f04-4868-83c4-e36d1f913908 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f233b53-1a30-4911-ac4f-9315a31b89db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-424d5fd7-7189-428b-b5de-9cd253035a83', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:17 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5 Jul 11 04:45:17 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:17 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c5eac56d-1f04-4868-83c4-e36d1f913908 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcbdbe4e-7ef8-434a-84a2-a14f8031b7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:17 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-c5eac56d-1f04-4868-83c4-e36d1f913908 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Volume volume-424d5fd7-7189-428b-b5de-9cd253035a83 (424d5fd7-7189-428b-b5de-9cd253035a83): created successfully Jul 11 04:45:17 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c5eac56d-1f04-4868-83c4-e36d1f913908 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcbdbe4e-7ef8-434a-84a2-a14f8031b7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:17 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c5eac56d-1f04-4868-83c4-e36d1f913908 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Flow 'volume_create_manager' (6ee8eca8-8e5a-496a-b958-893d8be8006b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:45:17 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-c5eac56d-1f04-4868-83c4-e36d1f913908 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Created volume successfully. Jul 11 04:45:17 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fe927fd0-e651-421c-bd7e-1cdc1f85b3c1 tempest-CreateVolumesFromSnapshotTest-469897697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6f2ce532-4aec-45fd-98bd-46b6f8201033" returned: 0 in 0.832s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fe927fd0-e651-421c-bd7e-1cdc1f85b3c1 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "cinder-quobyte-6f2ce532-4aec-45fd-98bd-46b6f8201033" released by "delete_volume" :: held 1.843s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-fe927fd0-e651-421c-bd7e-1cdc1f85b3c1 tempest-CreateVolumesFromSnapshotTest-469897697 None] Created reservations ['ccb8b7cf-763b-4d3d-9f89-2b392154a500', 'ce0d933e-812f-46a0-87c2-5318961d0b96', '29136ae6-926d-4c6d-9b48-e661ff2a5cf3', 'a4af2166-b392-4ae9-8be6-7c76fc89c53c'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fe927fd0-e651-421c-bd7e-1cdc1f85b3c1 tempest-CreateVolumesFromSnapshotTest-469897697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fe927fd0-e651-421c-bd7e-1cdc1f85b3c1 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-fe927fd0-e651-421c-bd7e-1cdc1f85b3c1 tempest-CreateVolumesFromSnapshotTest-469897697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-fe927fd0-e651-421c-bd7e-1cdc1f85b3c1 tempest-CreateVolumesFromSnapshotTest-469897697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fe927fd0-e651-421c-bd7e-1cdc1f85b3c1 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fe927fd0-e651-421c-bd7e-1cdc1f85b3c1 tempest-CreateVolumesFromSnapshotTest-469897697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:18 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:45:18 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:18 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ce3f2f8b-d244-4624-9c76-fd7fd77e1bfc tempest-ProjectReaderTests-787132287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5" returned: 0 in 1.084s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ce3f2f8b-d244-4624-9c76-fd7fd77e1bfc tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:18 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5 Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9b81d78-b8e9-488f-a083-870e7a48b325 tempest-CinderUnicodeTest-1836980750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:45:18 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e9b81d78-b8e9-488f-a083-870e7a48b325 tempest-CinderUnicodeTest-1836980750 None] Flow 'volume_create_manager' (135e0f71-d99a-4ef4-8701-bf3dd77790ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e9b81d78-b8e9-488f-a083-870e7a48b325 tempest-CinderUnicodeTest-1836980750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c08fc13-fb44-456f-84fc-e3c7ca2bd0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-03981cd6-a36c-49f7-8bf9-4a8568b7adcb tempest-CreateVolumesFromSnapshotTest-469897697 None] Acquiring lock "cinder-9e3fcd2c-0c17-4d49-9062-c6691e499351-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e9b81d78-b8e9-488f-a083-870e7a48b325 tempest-CinderUnicodeTest-1836980750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c08fc13-fb44-456f-84fc-e3c7ca2bd0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6b9caf8-408c-45d6-be96-620ab93337cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f89f86cf5934c208d1c1536cda6f1e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:45:18Z,use_quota=True,user_id='6b5e320000b84cadabf395022ee019f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e9b81d78-b8e9-488f-a083-870e7a48b325 tempest-CinderUnicodeTest-1836980750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f355d04-cfaa-4a84-827e-42f187e021d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e9b81d78-b8e9-488f-a083-870e7a48b325 tempest-CinderUnicodeTest-1836980750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f355d04-cfaa-4a84-827e-42f187e021d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e9b81d78-b8e9-488f-a083-870e7a48b325 tempest-CinderUnicodeTest-1836980750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (758bba01-363d-4fbd-922b-b65813cbdd8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e9b81d78-b8e9-488f-a083-870e7a48b325 tempest-CinderUnicodeTest-1836980750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (758bba01-363d-4fbd-922b-b65813cbdd8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6b9caf8-408c-45d6-be96-620ab93337cc', 'volume_name': 'volume-d6b9caf8-408c-45d6-be96-620ab93337cc', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e9b81d78-b8e9-488f-a083-870e7a48b325 tempest-CinderUnicodeTest-1836980750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d9aa763-b838-4210-be1d-1262ea7cebd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e9b81d78-b8e9-488f-a083-870e7a48b325 tempest-CinderUnicodeTest-1836980750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d9aa763-b838-4210-be1d-1262ea7cebd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e9b81d78-b8e9-488f-a083-870e7a48b325 tempest-CinderUnicodeTest-1836980750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0709b0bd-7a64-4a9d-8c9c-68876db7bc0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:18 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-e9b81d78-b8e9-488f-a083-870e7a48b325 tempest-CinderUnicodeTest-1836980750 None] Volume d6b9caf8-408c-45d6-be96-620ab93337cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6b9caf8-408c-45d6-be96-620ab93337cc', 'volume_size': 1} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e9b81d78-b8e9-488f-a083-870e7a48b325 tempest-CinderUnicodeTest-1836980750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e9b81d78-b8e9-488f-a083-870e7a48b325 tempest-CinderUnicodeTest-1836980750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e9b81d78-b8e9-488f-a083-870e7a48b325 tempest-CinderUnicodeTest-1836980750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6b9caf8-408c-45d6-be96-620ab93337cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f89f86cf5934c208d1c1536cda6f1e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:45:18Z,use_quota=True,user_id='6b5e320000b84cadabf395022ee019f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-e9b81d78-b8e9-488f-a083-870e7a48b325 tempest-CinderUnicodeTest-1836980750 None] Creating volume d6b9caf8-408c-45d6-be96-620ab93337cc {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e9b81d78-b8e9-488f-a083-870e7a48b325 tempest-CinderUnicodeTest-1836980750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e9b81d78-b8e9-488f-a083-870e7a48b325 tempest-CinderUnicodeTest-1836980750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e9b81d78-b8e9-488f-a083-870e7a48b325 tempest-CinderUnicodeTest-1836980750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e9b81d78-b8e9-488f-a083-870e7a48b325 tempest-CinderUnicodeTest-1836980750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e9b81d78-b8e9-488f-a083-870e7a48b325 tempest-CinderUnicodeTest-1836980750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e9b81d78-b8e9-488f-a083-870e7a48b325 tempest-CinderUnicodeTest-1836980750 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:45:18 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-e9b81d78-b8e9-488f-a083-870e7a48b325 tempest-CinderUnicodeTest-1836980750 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e9b81d78-b8e9-488f-a083-870e7a48b325 tempest-CinderUnicodeTest-1836980750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d6b9caf8-408c-45d6-be96-620ab93337cc 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-03981cd6-a36c-49f7-8bf9-4a8568b7adcb tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "cinder-9e3fcd2c-0c17-4d49-9062-c6691e499351-delete_volume" acquired by "delete_volume" :: waited 0.186s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:18 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d6b9caf8-408c-45d6-be96-620ab93337cc 1073741824 Jul 11 04:45:18 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-52a1c7c7-456e-4199-ba4d-5bc17fa1184a tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-52a1c7c7-456e-4199-ba4d-5bc17fa1184a tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Flow 'volume_create_manager' (2bb37547-8a82-4ae9-af37-4b255324b317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-52a1c7c7-456e-4199-ba4d-5bc17fa1184a tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dac3f908-9a35-443f-8a5a-b589e1a5abb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-52a1c7c7-456e-4199-ba4d-5bc17fa1184a tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dac3f908-9a35-443f-8a5a-b589e1a5abb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-601806189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef4912a8-7609-48b9-b3f1-4d9c969aa6fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41933e9eac842fc98c37003c26e8b14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:45:18Z,use_quota=True,user_id='b382014fe726416599d9531d4e7788ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-52a1c7c7-456e-4199-ba4d-5bc17fa1184a tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (918bb498-3603-4842-bc4c-409180b2d59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-52a1c7c7-456e-4199-ba4d-5bc17fa1184a tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (918bb498-3603-4842-bc4c-409180b2d59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-52a1c7c7-456e-4199-ba4d-5bc17fa1184a tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0abe7427-627b-4ff9-ac99-04cf82b88f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-52a1c7c7-456e-4199-ba4d-5bc17fa1184a tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0abe7427-627b-4ff9-ac99-04cf82b88f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef4912a8-7609-48b9-b3f1-4d9c969aa6fe', 'volume_name': 'volume-ef4912a8-7609-48b9-b3f1-4d9c969aa6fe', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-52a1c7c7-456e-4199-ba4d-5bc17fa1184a tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c113adb5-0f4c-4212-98dc-d5b3765f082f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-52a1c7c7-456e-4199-ba4d-5bc17fa1184a tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c113adb5-0f4c-4212-98dc-d5b3765f082f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-52a1c7c7-456e-4199-ba4d-5bc17fa1184a tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fb356b4-a08b-476b-a310-7c3590b20a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:18 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-52a1c7c7-456e-4199-ba4d-5bc17fa1184a tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Volume ef4912a8-7609-48b9-b3f1-4d9c969aa6fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef4912a8-7609-48b9-b3f1-4d9c969aa6fe', 'volume_size': 1} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-52a1c7c7-456e-4199-ba4d-5bc17fa1184a tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-03981cd6-a36c-49f7-8bf9-4a8568b7adcb tempest-CreateVolumesFromSnapshotTest-469897697 None] Acquiring lock "cinder-quobyte-9e3fcd2c-0c17-4d49-9062-c6691e499351" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-03981cd6-a36c-49f7-8bf9-4a8568b7adcb tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "cinder-quobyte-9e3fcd2c-0c17-4d49-9062-c6691e499351" acquired by "delete_volume" :: waited 0.030s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc815a33-26ba-4d89-b557-f000ae4cceb4]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-03981cd6-a36c-49f7-8bf9-4a8568b7adcb tempest-CreateVolumesFromSnapshotTest-469897697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9e3fcd2c-0c17-4d49-9062-c6691e499351 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:18 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fe927fd0-e651-421c-bd7e-1cdc1f85b3c1 tempest-CreateVolumesFromSnapshotTest-469897697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.901s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-fe927fd0-e651-421c-bd7e-1cdc1f85b3c1 tempest-CreateVolumesFromSnapshotTest-469897697 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:45:19 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-fe927fd0-e651-421c-bd7e-1cdc1f85b3c1 tempest-CreateVolumesFromSnapshotTest-469897697 None] Deleted volume successfully. Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fe927fd0-e651-421c-bd7e-1cdc1f85b3c1 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "cinder-6f2ce532-4aec-45fd-98bd-46b6f8201033-delete_volume" released by "delete_volume" :: held 3.074s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-67497978-1522-4241-a119-1406fc0e2cbc tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-67497978-1522-4241-a119-1406fc0e2cbc tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Flow 'volume_create_manager' (fa8ade7c-1ef3-4d05-b95d-aec8a3d22981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:45:19 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9e3fcd2c-0c17-4d49-9062-c6691e499351 Jul 11 04:45:19 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-67497978-1522-4241-a119-1406fc0e2cbc tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9644393b-ea10-463a-9b39-5e1a4b533a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-67497978-1522-4241-a119-1406fc0e2cbc tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9644393b-ea10-463a-9b39-5e1a4b533a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1826888120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fd8227a-c5af-4d9a-b245-689bd4e36773,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41933e9eac842fc98c37003c26e8b14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:45:19Z,use_quota=True,user_id='b382014fe726416599d9531d4e7788ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-67497978-1522-4241-a119-1406fc0e2cbc tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (147fa65c-3e53-4e83-aedb-fb9e307aeedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-67497978-1522-4241-a119-1406fc0e2cbc tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (147fa65c-3e53-4e83-aedb-fb9e307aeedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-67497978-1522-4241-a119-1406fc0e2cbc tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab7561a7-b91d-48cb-9462-1c2305efe51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-67497978-1522-4241-a119-1406fc0e2cbc tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab7561a7-b91d-48cb-9462-1c2305efe51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fd8227a-c5af-4d9a-b245-689bd4e36773', 'volume_name': 'volume-7fd8227a-c5af-4d9a-b245-689bd4e36773', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-67497978-1522-4241-a119-1406fc0e2cbc tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd54a45-f2c7-4b28-b080-5aeda056016e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-67497978-1522-4241-a119-1406fc0e2cbc tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd54a45-f2c7-4b28-b080-5aeda056016e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-67497978-1522-4241-a119-1406fc0e2cbc tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8be235a3-efe7-4c64-9492-627bf5f5228b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:19 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-67497978-1522-4241-a119-1406fc0e2cbc tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Volume 7fd8227a-c5af-4d9a-b245-689bd4e36773: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fd8227a-c5af-4d9a-b245-689bd4e36773', 'volume_size': 1} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-67497978-1522-4241-a119-1406fc0e2cbc tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-7da9776c-0cab-4843-a40d-f69c8dec1e29 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7da9776c-0cab-4843-a40d-f69c8dec1e29 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Flow 'volume_create_manager' (0fb0ed56-ad7f-4a68-98dd-5d7d3ca3c472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7da9776c-0cab-4843-a40d-f69c8dec1e29 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a467e3f-e525-489d-84ec-a13eeb4946b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7da9776c-0cab-4843-a40d-f69c8dec1e29 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a467e3f-e525-489d-84ec-a13eeb4946b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1474231200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74dd5177-ff25-4927-a49f-2568af2264e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41933e9eac842fc98c37003c26e8b14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:45:19Z,use_quota=True,user_id='b382014fe726416599d9531d4e7788ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7da9776c-0cab-4843-a40d-f69c8dec1e29 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99ce8a2a-6b90-4fa4-a11c-0be2af20cace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7da9776c-0cab-4843-a40d-f69c8dec1e29 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99ce8a2a-6b90-4fa4-a11c-0be2af20cace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7da9776c-0cab-4843-a40d-f69c8dec1e29 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (574f2d1c-c66e-4f14-8e9e-1ce4cefc4a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7da9776c-0cab-4843-a40d-f69c8dec1e29 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (574f2d1c-c66e-4f14-8e9e-1ce4cefc4a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74dd5177-ff25-4927-a49f-2568af2264e2', 'volume_name': 'volume-74dd5177-ff25-4927-a49f-2568af2264e2', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7da9776c-0cab-4843-a40d-f69c8dec1e29 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55517fcc-960f-47a3-8437-9d3ed9cd19a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7da9776c-0cab-4843-a40d-f69c8dec1e29 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55517fcc-960f-47a3-8437-9d3ed9cd19a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7da9776c-0cab-4843-a40d-f69c8dec1e29 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0d47de4-4e72-4afe-949c-454797e9be8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:19 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-7da9776c-0cab-4843-a40d-f69c8dec1e29 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Volume 74dd5177-ff25-4927-a49f-2568af2264e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74dd5177-ff25-4927-a49f-2568af2264e2', 'volume_size': 1} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7da9776c-0cab-4843-a40d-f69c8dec1e29 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:19 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ce3f2f8b-d244-4624-9c76-fd7fd77e1bfc tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-99206423-1e47-40d7-96b7-49c8ae6f75c5" returned: 0 in 1.257s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ce3f2f8b-d244-4624-9c76-fd7fd77e1bfc tempest-ProjectReaderTests-787132287 None] Lock "cinder-quobyte-99206423-1e47-40d7-96b7-49c8ae6f75c5" released by "delete_volume" :: held 2.437s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-ce3f2f8b-d244-4624-9c76-fd7fd77e1bfc tempest-ProjectReaderTests-787132287 None] Created reservations ['02b215ee-c055-441f-b224-e1f443a73b2b', '786069f6-e983-497f-a1aa-92b82358e821', '582deadd-f36d-4e41-8d48-4f373b4a873b', 'ecaf81c9-a3d6-47a4-a1e1-b80e136bfe09'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bb02aa1-79b6-4bb3-b8c2-7eb0373c1868 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0bb02aa1-79b6-4bb3-b8c2-7eb0373c1868 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Flow 'volume_create_manager' (937b9e98-da7c-4c7a-94d9-a24ef617e08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0bb02aa1-79b6-4bb3-b8c2-7eb0373c1868 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62142d7f-3ee0-4df0-8091-f39eb173c066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0bb02aa1-79b6-4bb3-b8c2-7eb0373c1868 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62142d7f-3ee0-4df0-8091-f39eb173c066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-141234317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d946579-e856-4585-b2b9-4ffa2f105241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41933e9eac842fc98c37003c26e8b14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:45:20Z,use_quota=True,user_id='b382014fe726416599d9531d4e7788ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0bb02aa1-79b6-4bb3-b8c2-7eb0373c1868 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9ae3cfd-16c7-4d6a-89e0-573a8ea913aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0bb02aa1-79b6-4bb3-b8c2-7eb0373c1868 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9ae3cfd-16c7-4d6a-89e0-573a8ea913aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0bb02aa1-79b6-4bb3-b8c2-7eb0373c1868 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64908969-c234-4a82-847b-2814099973ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0bb02aa1-79b6-4bb3-b8c2-7eb0373c1868 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64908969-c234-4a82-847b-2814099973ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d946579-e856-4585-b2b9-4ffa2f105241', 'volume_name': 'volume-5d946579-e856-4585-b2b9-4ffa2f105241', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0bb02aa1-79b6-4bb3-b8c2-7eb0373c1868 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96f7d95-4e78-4d4c-949f-2e93edadb5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0bb02aa1-79b6-4bb3-b8c2-7eb0373c1868 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96f7d95-4e78-4d4c-949f-2e93edadb5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0bb02aa1-79b6-4bb3-b8c2-7eb0373c1868 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9b8f026-bd94-466b-adf1-068db209a00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:19 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-0bb02aa1-79b6-4bb3-b8c2-7eb0373c1868 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Volume 5d946579-e856-4585-b2b9-4ffa2f105241: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d946579-e856-4585-b2b9-4ffa2f105241', 'volume_size': 1} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-0bb02aa1-79b6-4bb3-b8c2-7eb0373c1868 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ce3f2f8b-d244-4624-9c76-fd7fd77e1bfc tempest-ProjectReaderTests-787132287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ce3f2f8b-d244-4624-9c76-fd7fd77e1bfc tempest-ProjectReaderTests-787132287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ce3f2f8b-d244-4624-9c76-fd7fd77e1bfc tempest-ProjectReaderTests-787132287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ce3f2f8b-d244-4624-9c76-fd7fd77e1bfc tempest-ProjectReaderTests-787132287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ce3f2f8b-d244-4624-9c76-fd7fd77e1bfc tempest-ProjectReaderTests-787132287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ce3f2f8b-d244-4624-9c76-fd7fd77e1bfc tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:19 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:45:19 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:20 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e9b81d78-b8e9-488f-a083-870e7a48b325 tempest-CinderUnicodeTest-1836980750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d6b9caf8-408c-45d6-be96-620ab93337cc 1073741824" returned: 0 in 1.458s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:20 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-03981cd6-a36c-49f7-8bf9-4a8568b7adcb tempest-CreateVolumesFromSnapshotTest-469897697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9e3fcd2c-0c17-4d49-9062-c6691e499351" returned: 0 in 1.113s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-03981cd6-a36c-49f7-8bf9-4a8568b7adcb tempest-CreateVolumesFromSnapshotTest-469897697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9e3fcd2c-0c17-4d49-9062-c6691e499351 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e9b81d78-b8e9-488f-a083-870e7a48b325 tempest-CinderUnicodeTest-1836980750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d6b9caf8-408c-45d6-be96-620ab93337cc {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:20 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9e3fcd2c-0c17-4d49-9062-c6691e499351 Jul 11 04:45:20 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:20 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d6b9caf8-408c-45d6-be96-620ab93337cc Jul 11 04:45:20 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:20 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa4b304d-b6ff-490c-8536-99f0c92aa366 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:45:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fa4b304d-b6ff-490c-8536-99f0c92aa366 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Flow 'volume_create_manager' (67b2cd0d-4bc5-473d-948c-6ae21c2d60f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:45:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fa4b304d-b6ff-490c-8536-99f0c92aa366 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be3a5183-d634-40fc-8bbc-3f505923cb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fa4b304d-b6ff-490c-8536-99f0c92aa366 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be3a5183-d634-40fc-8bbc-3f505923cb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1886940980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20a1edcc-48d0-4c9e-a07a-5dced0eb0cbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41933e9eac842fc98c37003c26e8b14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:45:20Z,use_quota=True,user_id='b382014fe726416599d9531d4e7788ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fa4b304d-b6ff-490c-8536-99f0c92aa366 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e61130-82ef-498a-8eb0-3e74e9ac1bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fa4b304d-b6ff-490c-8536-99f0c92aa366 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e61130-82ef-498a-8eb0-3e74e9ac1bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fa4b304d-b6ff-490c-8536-99f0c92aa366 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7838683c-5cbc-43a1-a939-924eb2dde163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fa4b304d-b6ff-490c-8536-99f0c92aa366 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7838683c-5cbc-43a1-a939-924eb2dde163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20a1edcc-48d0-4c9e-a07a-5dced0eb0cbf', 'volume_name': 'volume-20a1edcc-48d0-4c9e-a07a-5dced0eb0cbf', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fa4b304d-b6ff-490c-8536-99f0c92aa366 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1244f46-8ef9-4146-bd70-cc2f2a205a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fa4b304d-b6ff-490c-8536-99f0c92aa366 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1244f46-8ef9-4146-bd70-cc2f2a205a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fa4b304d-b6ff-490c-8536-99f0c92aa366 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb95333b-eb07-4950-bfd8-04c303a40623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:20 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-fa4b304d-b6ff-490c-8536-99f0c92aa366 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Volume 20a1edcc-48d0-4c9e-a07a-5dced0eb0cbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20a1edcc-48d0-4c9e-a07a-5dced0eb0cbf', 'volume_size': 1} Jul 11 04:45:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fa4b304d-b6ff-490c-8536-99f0c92aa366 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:20 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ce3f2f8b-d244-4624-9c76-fd7fd77e1bfc tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.760s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:20 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-ce3f2f8b-d244-4624-9c76-fd7fd77e1bfc tempest-ProjectReaderTests-787132287 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:45:20 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-ce3f2f8b-d244-4624-9c76-fd7fd77e1bfc tempest-ProjectReaderTests-787132287 None] Deleted volume successfully. Jul 11 04:45:20 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ce3f2f8b-d244-4624-9c76-fd7fd77e1bfc tempest-ProjectReaderTests-787132287 None] Lock "cinder-99206423-1e47-40d7-96b7-49c8ae6f75c5-delete_volume" released by "delete_volume" :: held 3.684s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:20 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e9b81d78-b8e9-488f-a083-870e7a48b325 tempest-CinderUnicodeTest-1836980750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d6b9caf8-408c-45d6-be96-620ab93337cc" returned: 0 in 0.799s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:20 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e9b81d78-b8e9-488f-a083-870e7a48b325 tempest-CinderUnicodeTest-1836980750 None] <== create_volume: return (2373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:45:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e9b81d78-b8e9-488f-a083-870e7a48b325 tempest-CinderUnicodeTest-1836980750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.377s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-52a1c7c7-456e-4199-ba4d-5bc17fa1184a tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.094s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:20 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-52a1c7c7-456e-4199-ba4d-5bc17fa1184a tempest-CreateVolumesFromSourceVolumeTest-247638403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-601806189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef4912a8-7609-48b9-b3f1-4d9c969aa6fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41933e9eac842fc98c37003c26e8b14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:45:18Z,use_quota=True,user_id='b382014fe726416599d9531d4e7788ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:45:20 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-52a1c7c7-456e-4199-ba4d-5bc17fa1184a tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Creating volume ef4912a8-7609-48b9-b3f1-4d9c969aa6fe {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:45:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-52a1c7c7-456e-4199-ba4d-5bc17fa1184a tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-52a1c7c7-456e-4199-ba4d-5bc17fa1184a tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:20 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-52a1c7c7-456e-4199-ba4d-5bc17fa1184a tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:45:20 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-52a1c7c7-456e-4199-ba4d-5bc17fa1184a tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:45:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-52a1c7c7-456e-4199-ba4d-5bc17fa1184a tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:20 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-52a1c7c7-456e-4199-ba4d-5bc17fa1184a tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:45:20 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-52a1c7c7-456e-4199-ba4d-5bc17fa1184a tempest-CreateVolumesFromSourceVolumeTest-247638403 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:45:20 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-52a1c7c7-456e-4199-ba4d-5bc17fa1184a tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef4912a8-7609-48b9-b3f1-4d9c969aa6fe 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:20 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-4168b53b-de83-4c13-bb76-82031909dbae tempest-ProjectReaderTests-787132287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:45:20 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef4912a8-7609-48b9-b3f1-4d9c969aa6fe 1073741824 Jul 11 04:45:20 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4168b53b-de83-4c13-bb76-82031909dbae tempest-ProjectReaderTests-787132287 None] Flow 'volume_create_manager' (ad96db91-a3b8-44e1-95c5-285ff2d99afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:45:20 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4168b53b-de83-4c13-bb76-82031909dbae tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f09ecd02-eec0-4f0f-aaf1-7641eb4ccd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-03981cd6-a36c-49f7-8bf9-4a8568b7adcb tempest-CreateVolumesFromSnapshotTest-469897697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9e3fcd2c-0c17-4d49-9062-c6691e499351" returned: 0 in 0.906s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:21 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4168b53b-de83-4c13-bb76-82031909dbae tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f09ecd02-eec0-4f0f-aaf1-7641eb4ccd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-532335606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=397586f0-3780-4ab8-af01-6603c3536919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36dcca031e5d4245aed8aadd7b6f88e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:45:21Z,use_quota=True,user_id='ee6e4107301b44a98a0fdd41aead55f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:21 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4168b53b-de83-4c13-bb76-82031909dbae tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92249766-8d0e-4cd3-9441-af623689b961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:21 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4168b53b-de83-4c13-bb76-82031909dbae tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92249766-8d0e-4cd3-9441-af623689b961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:21 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4168b53b-de83-4c13-bb76-82031909dbae tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3da77648-d0cb-4014-b988-7a58ea3614b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:21 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4168b53b-de83-4c13-bb76-82031909dbae tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3da77648-d0cb-4014-b988-7a58ea3614b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '397586f0-3780-4ab8-af01-6603c3536919', 'volume_name': 'volume-397586f0-3780-4ab8-af01-6603c3536919', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:21 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4168b53b-de83-4c13-bb76-82031909dbae tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (951aff10-92a9-461e-87cf-921083d53460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:21 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4168b53b-de83-4c13-bb76-82031909dbae tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (951aff10-92a9-461e-87cf-921083d53460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:21 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4168b53b-de83-4c13-bb76-82031909dbae tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3829f707-aba4-45d4-832f-167f4bd197e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:21 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-4168b53b-de83-4c13-bb76-82031909dbae tempest-ProjectReaderTests-787132287 None] Volume 397586f0-3780-4ab8-af01-6603c3536919: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-397586f0-3780-4ab8-af01-6603c3536919', 'volume_size': 1} Jul 11 04:45:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4168b53b-de83-4c13-bb76-82031909dbae tempest-ProjectReaderTests-787132287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:21 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-03981cd6-a36c-49f7-8bf9-4a8568b7adcb tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "cinder-quobyte-9e3fcd2c-0c17-4d49-9062-c6691e499351" released by "delete_volume" :: held 2.132s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:21 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e9b81d78-b8e9-488f-a083-870e7a48b325 tempest-CinderUnicodeTest-1836980750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0709b0bd-7a64-4a9d-8c9c-68876db7bc0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6b9caf8-408c-45d6-be96-620ab93337cc', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:21 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e9b81d78-b8e9-488f-a083-870e7a48b325 tempest-CinderUnicodeTest-1836980750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54371d2e-872b-41e5-bac8-27192331c105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:21 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-e9b81d78-b8e9-488f-a083-870e7a48b325 tempest-CinderUnicodeTest-1836980750 None] Volume volume-d6b9caf8-408c-45d6-be96-620ab93337cc (d6b9caf8-408c-45d6-be96-620ab93337cc): created successfully Jul 11 04:45:21 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e9b81d78-b8e9-488f-a083-870e7a48b325 tempest-CinderUnicodeTest-1836980750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54371d2e-872b-41e5-bac8-27192331c105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:21 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e9b81d78-b8e9-488f-a083-870e7a48b325 tempest-CinderUnicodeTest-1836980750 None] Flow 'volume_create_manager' (135e0f71-d99a-4ef4-8701-bf3dd77790ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:45:21 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-e9b81d78-b8e9-488f-a083-870e7a48b325 tempest-CinderUnicodeTest-1836980750 None] Created volume successfully. Jul 11 04:45:21 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-03981cd6-a36c-49f7-8bf9-4a8568b7adcb tempest-CreateVolumesFromSnapshotTest-469897697 None] Created reservations ['6cda3687-cfcd-4b9f-ac86-7ef3f308d6df', '6f12afce-3ff2-4292-802f-241244e86257', '820d5eb3-b048-466f-875c-d43b5fa6861b', 'a76fe983-918b-4529-b190-9dfd08d5228e'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:45:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-03981cd6-a36c-49f7-8bf9-4a8568b7adcb tempest-CreateVolumesFromSnapshotTest-469897697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-03981cd6-a36c-49f7-8bf9-4a8568b7adcb tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:21 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-03981cd6-a36c-49f7-8bf9-4a8568b7adcb tempest-CreateVolumesFromSnapshotTest-469897697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:45:21 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-03981cd6-a36c-49f7-8bf9-4a8568b7adcb tempest-CreateVolumesFromSnapshotTest-469897697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:45:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-03981cd6-a36c-49f7-8bf9-4a8568b7adcb tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-03981cd6-a36c-49f7-8bf9-4a8568b7adcb tempest-CreateVolumesFromSnapshotTest-469897697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:21 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:45:21 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:21 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-db2c10b3-725f-4f67-83fd-eae68129e12a tempest-CreateVolumesFromSnapshotTest-469897697 None] Acquiring lock "cinder-6387afdd-91e2-453d-be97-e9cc5e29e90b-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:21 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-db2c10b3-725f-4f67-83fd-eae68129e12a tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "cinder-6387afdd-91e2-453d-be97-e9cc5e29e90b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:21 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e6afef6-8c50-4879-a6fc-cee458ced1a2 tempest-CinderUnicodeTest-1836980750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:45:21 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8e6afef6-8c50-4879-a6fc-cee458ced1a2 tempest-CinderUnicodeTest-1836980750 None] Flow 'volume_create_manager' (bb556455-0f55-40fe-bec9-8bdb7627f045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:45:21 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8e6afef6-8c50-4879-a6fc-cee458ced1a2 tempest-CinderUnicodeTest-1836980750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a29c536-dd6c-4382-93df-9844c4fe3cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:21 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8e6afef6-8c50-4879-a6fc-cee458ced1a2 tempest-CinderUnicodeTest-1836980750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a29c536-dd6c-4382-93df-9844c4fe3cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:45:21Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1926294960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3e8f0a1-c3db-49b9-a8eb-2c2747db1262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f89f86cf5934c208d1c1536cda6f1e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:45:22Z,use_quota=True,user_id='6b5e320000b84cadabf395022ee019f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:21 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8e6afef6-8c50-4879-a6fc-cee458ced1a2 tempest-CinderUnicodeTest-1836980750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc88e881-82f1-4f6a-9e02-4003e4637277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:21 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:21 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8e6afef6-8c50-4879-a6fc-cee458ced1a2 tempest-CinderUnicodeTest-1836980750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc88e881-82f1-4f6a-9e02-4003e4637277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:21 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8e6afef6-8c50-4879-a6fc-cee458ced1a2 tempest-CinderUnicodeTest-1836980750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d7ada6-2173-4684-8aa3-2807f334aa96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:21 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8e6afef6-8c50-4879-a6fc-cee458ced1a2 tempest-CinderUnicodeTest-1836980750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d7ada6-2173-4684-8aa3-2807f334aa96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3e8f0a1-c3db-49b9-a8eb-2c2747db1262', 'volume_name': 'volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:21 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8e6afef6-8c50-4879-a6fc-cee458ced1a2 tempest-CinderUnicodeTest-1836980750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (585f8984-1354-4e80-bb9f-e8dc9544e084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:21 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8e6afef6-8c50-4879-a6fc-cee458ced1a2 tempest-CinderUnicodeTest-1836980750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (585f8984-1354-4e80-bb9f-e8dc9544e084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:21 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8e6afef6-8c50-4879-a6fc-cee458ced1a2 tempest-CinderUnicodeTest-1836980750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc356ae0-0d6b-4522-82f5-27c64216e639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:21 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-8e6afef6-8c50-4879-a6fc-cee458ced1a2 tempest-CinderUnicodeTest-1836980750 None] Volume a3e8f0a1-c3db-49b9-a8eb-2c2747db1262: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262', 'volume_size': 1} Jul 11 04:45:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-8e6afef6-8c50-4879-a6fc-cee458ced1a2 tempest-CinderUnicodeTest-1836980750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-52a1c7c7-456e-4199-ba4d-5bc17fa1184a tempest-CreateVolumesFromSourceVolumeTest-247638403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef4912a8-7609-48b9-b3f1-4d9c969aa6fe 1073741824" returned: 0 in 1.017s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:21 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-03981cd6-a36c-49f7-8bf9-4a8568b7adcb tempest-CreateVolumesFromSnapshotTest-469897697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.753s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:21 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-03981cd6-a36c-49f7-8bf9-4a8568b7adcb tempest-CreateVolumesFromSnapshotTest-469897697 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:45:21 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-db2c10b3-725f-4f67-83fd-eae68129e12a tempest-CreateVolumesFromSnapshotTest-469897697 None] Acquiring lock "cinder-quobyte-6387afdd-91e2-453d-be97-e9cc5e29e90b" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:21 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-03981cd6-a36c-49f7-8bf9-4a8568b7adcb tempest-CreateVolumesFromSnapshotTest-469897697 None] Deleted volume successfully. Jul 11 04:45:22 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-db2c10b3-725f-4f67-83fd-eae68129e12a tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "cinder-quobyte-6387afdd-91e2-453d-be97-e9cc5e29e90b" acquired by "delete_volume" :: waited 0.023s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:22 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-03981cd6-a36c-49f7-8bf9-4a8568b7adcb tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "cinder-9e3fcd2c-0c17-4d49-9062-c6691e499351-delete_volume" released by "delete_volume" :: held 3.409s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-52a1c7c7-456e-4199-ba4d-5bc17fa1184a tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef4912a8-7609-48b9-b3f1-4d9c969aa6fe {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:22 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[509f95fc-caa1-4a43-a44b-4bb453a6cd6f]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-db2c10b3-725f-4f67-83fd-eae68129e12a tempest-CreateVolumesFromSnapshotTest-469897697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6387afdd-91e2-453d-be97-e9cc5e29e90b {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:22 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef4912a8-7609-48b9-b3f1-4d9c969aa6fe Jul 11 04:45:22 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:22 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6387afdd-91e2-453d-be97-e9cc5e29e90b Jul 11 04:45:22 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:22 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-52a1c7c7-456e-4199-ba4d-5bc17fa1184a tempest-CreateVolumesFromSourceVolumeTest-247638403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef4912a8-7609-48b9-b3f1-4d9c969aa6fe" returned: 0 in 0.670s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-52a1c7c7-456e-4199-ba4d-5bc17fa1184a tempest-CreateVolumesFromSourceVolumeTest-247638403 None] <== create_volume: return (1758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:45:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-52a1c7c7-456e-4199-ba4d-5bc17fa1184a tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.761s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-67497978-1522-4241-a119-1406fc0e2cbc tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.404s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-67497978-1522-4241-a119-1406fc0e2cbc tempest-CreateVolumesFromSourceVolumeTest-247638403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1826888120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fd8227a-c5af-4d9a-b245-689bd4e36773,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41933e9eac842fc98c37003c26e8b14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:45:19Z,use_quota=True,user_id='b382014fe726416599d9531d4e7788ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:45:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-67497978-1522-4241-a119-1406fc0e2cbc tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Creating volume 7fd8227a-c5af-4d9a-b245-689bd4e36773 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:45:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-67497978-1522-4241-a119-1406fc0e2cbc tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-67497978-1522-4241-a119-1406fc0e2cbc tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-67497978-1522-4241-a119-1406fc0e2cbc tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:45:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-67497978-1522-4241-a119-1406fc0e2cbc tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:45:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-67497978-1522-4241-a119-1406fc0e2cbc tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-67497978-1522-4241-a119-1406fc0e2cbc tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:45:22 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-67497978-1522-4241-a119-1406fc0e2cbc tempest-CreateVolumesFromSourceVolumeTest-247638403 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:45:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-67497978-1522-4241-a119-1406fc0e2cbc tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7fd8227a-c5af-4d9a-b245-689bd4e36773 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:22 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7fd8227a-c5af-4d9a-b245-689bd4e36773 1073741824 Jul 11 04:45:22 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:22 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-52a1c7c7-456e-4199-ba4d-5bc17fa1184a tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fb356b4-a08b-476b-a310-7c3590b20a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef4912a8-7609-48b9-b3f1-4d9c969aa6fe', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:22 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-52a1c7c7-456e-4199-ba4d-5bc17fa1184a tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ece7b3-98d3-4755-80c2-05fbea212069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:22 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-52a1c7c7-456e-4199-ba4d-5bc17fa1184a tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Volume volume-ef4912a8-7609-48b9-b3f1-4d9c969aa6fe (ef4912a8-7609-48b9-b3f1-4d9c969aa6fe): created successfully Jul 11 04:45:22 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-52a1c7c7-456e-4199-ba4d-5bc17fa1184a tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ece7b3-98d3-4755-80c2-05fbea212069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:22 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-52a1c7c7-456e-4199-ba4d-5bc17fa1184a tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Flow 'volume_create_manager' (2bb37547-8a82-4ae9-af37-4b255324b317) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:45:22 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-52a1c7c7-456e-4199-ba4d-5bc17fa1184a tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Created volume successfully. Jul 11 04:45:22 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-db2c10b3-725f-4f67-83fd-eae68129e12a tempest-CreateVolumesFromSnapshotTest-469897697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6387afdd-91e2-453d-be97-e9cc5e29e90b" returned: 0 in 0.792s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-db2c10b3-725f-4f67-83fd-eae68129e12a tempest-CreateVolumesFromSnapshotTest-469897697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6387afdd-91e2-453d-be97-e9cc5e29e90b {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:22 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6387afdd-91e2-453d-be97-e9cc5e29e90b Jul 11 04:45:22 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:23 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-db2c10b3-725f-4f67-83fd-eae68129e12a tempest-CreateVolumesFromSnapshotTest-469897697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6387afdd-91e2-453d-be97-e9cc5e29e90b" returned: 0 in 0.649s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:23 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-db2c10b3-725f-4f67-83fd-eae68129e12a tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "cinder-quobyte-6387afdd-91e2-453d-be97-e9cc5e29e90b" released by "delete_volume" :: held 1.492s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:23 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-db2c10b3-725f-4f67-83fd-eae68129e12a tempest-CreateVolumesFromSnapshotTest-469897697 None] Created reservations ['eb254ea5-08ef-412a-9c56-26fa51250d6b', 'f8bde91a-0c18-45fc-9bf7-c5d72d3c91de', '4d443f71-abaa-42b7-afaf-0726fdfcdf05', '73ccd3fe-6f39-46d7-a2b2-65322c481f59'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:45:23 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-67497978-1522-4241-a119-1406fc0e2cbc tempest-CreateVolumesFromSourceVolumeTest-247638403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7fd8227a-c5af-4d9a-b245-689bd4e36773 1073741824" returned: 0 in 0.847s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-67497978-1522-4241-a119-1406fc0e2cbc tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7fd8227a-c5af-4d9a-b245-689bd4e36773 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:23 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7fd8227a-c5af-4d9a-b245-689bd4e36773 Jul 11 04:45:23 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-db2c10b3-725f-4f67-83fd-eae68129e12a tempest-CreateVolumesFromSnapshotTest-469897697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-db2c10b3-725f-4f67-83fd-eae68129e12a tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:23 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-db2c10b3-725f-4f67-83fd-eae68129e12a tempest-CreateVolumesFromSnapshotTest-469897697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:45:23 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-db2c10b3-725f-4f67-83fd-eae68129e12a tempest-CreateVolumesFromSnapshotTest-469897697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:45:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-db2c10b3-725f-4f67-83fd-eae68129e12a tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-db2c10b3-725f-4f67-83fd-eae68129e12a tempest-CreateVolumesFromSnapshotTest-469897697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:23 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:45:23 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:24 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fa695b45-0991-40d9-81ec-4a5517b37bb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Acquiring lock "cinder-344306c5-45b6-4844-b99c-fb5be87b538b-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:24 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fa695b45-0991-40d9-81ec-4a5517b37bb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "cinder-344306c5-45b6-4844-b99c-fb5be87b538b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:24 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fa695b45-0991-40d9-81ec-4a5517b37bb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Acquiring lock "cinder-quobyte-344306c5-45b6-4844-b99c-fb5be87b538b" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:24 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fa695b45-0991-40d9-81ec-4a5517b37bb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "cinder-quobyte-344306c5-45b6-4844-b99c-fb5be87b538b" acquired by "delete_volume" :: waited 0.014s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:24 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ff1ac3-0c0e-4f3d-b635-a6712203843b]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fa695b45-0991-40d9-81ec-4a5517b37bb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-344306c5-45b6-4844-b99c-fb5be87b538b {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:24 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-67497978-1522-4241-a119-1406fc0e2cbc tempest-CreateVolumesFromSourceVolumeTest-247638403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7fd8227a-c5af-4d9a-b245-689bd4e36773" returned: 0 in 0.675s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:24 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-67497978-1522-4241-a119-1406fc0e2cbc tempest-CreateVolumesFromSourceVolumeTest-247638403 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:45:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-67497978-1522-4241-a119-1406fc0e2cbc tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7da9776c-0cab-4843-a40d-f69c8dec1e29 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.756s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:24 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7da9776c-0cab-4843-a40d-f69c8dec1e29 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1474231200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74dd5177-ff25-4927-a49f-2568af2264e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41933e9eac842fc98c37003c26e8b14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:45:19Z,use_quota=True,user_id='b382014fe726416599d9531d4e7788ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:45:24 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-7da9776c-0cab-4843-a40d-f69c8dec1e29 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Creating volume 74dd5177-ff25-4927-a49f-2568af2264e2 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:45:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7da9776c-0cab-4843-a40d-f69c8dec1e29 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7da9776c-0cab-4843-a40d-f69c8dec1e29 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:24 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7da9776c-0cab-4843-a40d-f69c8dec1e29 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:45:24 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-344306c5-45b6-4844-b99c-fb5be87b538b Jul 11 04:45:24 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:24 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7da9776c-0cab-4843-a40d-f69c8dec1e29 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:45:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7da9776c-0cab-4843-a40d-f69c8dec1e29 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:24 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7da9776c-0cab-4843-a40d-f69c8dec1e29 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:45:24 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-7da9776c-0cab-4843-a40d-f69c8dec1e29 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:45:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7da9776c-0cab-4843-a40d-f69c8dec1e29 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-74dd5177-ff25-4927-a49f-2568af2264e2 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-67497978-1522-4241-a119-1406fc0e2cbc tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8be235a3-efe7-4c64-9492-627bf5f5228b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fd8227a-c5af-4d9a-b245-689bd4e36773', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-67497978-1522-4241-a119-1406fc0e2cbc tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9460216-6819-4aad-ab52-50a12831d659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:24 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-74dd5177-ff25-4927-a49f-2568af2264e2 1073741824 Jul 11 04:45:24 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:24 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-67497978-1522-4241-a119-1406fc0e2cbc tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Volume volume-7fd8227a-c5af-4d9a-b245-689bd4e36773 (7fd8227a-c5af-4d9a-b245-689bd4e36773): created successfully Jul 11 04:45:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-67497978-1522-4241-a119-1406fc0e2cbc tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9460216-6819-4aad-ab52-50a12831d659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-67497978-1522-4241-a119-1406fc0e2cbc tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Flow 'volume_create_manager' (fa8ade7c-1ef3-4d05-b95d-aec8a3d22981) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:45:24 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:24 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-67497978-1522-4241-a119-1406fc0e2cbc tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Created volume successfully. Jul 11 04:45:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-db2c10b3-725f-4f67-83fd-eae68129e12a tempest-CreateVolumesFromSnapshotTest-469897697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.733s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:24 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-db2c10b3-725f-4f67-83fd-eae68129e12a tempest-CreateVolumesFromSnapshotTest-469897697 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:45:24 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-db2c10b3-725f-4f67-83fd-eae68129e12a tempest-CreateVolumesFromSnapshotTest-469897697 None] Deleted volume successfully. Jul 11 04:45:24 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-db2c10b3-725f-4f67-83fd-eae68129e12a tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "cinder-6387afdd-91e2-453d-be97-e9cc5e29e90b-delete_volume" released by "delete_volume" :: held 2.558s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:24 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fa695b45-0991-40d9-81ec-4a5517b37bb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-344306c5-45b6-4844-b99c-fb5be87b538b" returned: 0 in 0.805s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fa695b45-0991-40d9-81ec-4a5517b37bb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-344306c5-45b6-4844-b99c-fb5be87b538b {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:25 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-344306c5-45b6-4844-b99c-fb5be87b538b Jul 11 04:45:25 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:25 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7da9776c-0cab-4843-a40d-f69c8dec1e29 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-74dd5177-ff25-4927-a49f-2568af2264e2 1073741824" returned: 0 in 0.856s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7da9776c-0cab-4843-a40d-f69c8dec1e29 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-74dd5177-ff25-4927-a49f-2568af2264e2 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:25 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-74dd5177-ff25-4927-a49f-2568af2264e2 Jul 11 04:45:25 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:25 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fa695b45-0991-40d9-81ec-4a5517b37bb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-344306c5-45b6-4844-b99c-fb5be87b538b" returned: 0 in 0.691s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:25 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fa695b45-0991-40d9-81ec-4a5517b37bb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "cinder-quobyte-344306c5-45b6-4844-b99c-fb5be87b538b" released by "delete_volume" :: held 1.541s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:25 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-fa695b45-0991-40d9-81ec-4a5517b37bb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Created reservations ['1f4389a5-5064-4cc5-b90b-00d04219cd19', '8227254a-b388-4323-b410-d82ec88a205a', '86dd2ca8-c22e-44b6-ad5d-7c18cbd82d49', '200e153b-45e9-4d2d-9c0e-5a5716a91925'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:45:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fa695b45-0991-40d9-81ec-4a5517b37bb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fa695b45-0991-40d9-81ec-4a5517b37bb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:25 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-fa695b45-0991-40d9-81ec-4a5517b37bb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:45:25 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-fa695b45-0991-40d9-81ec-4a5517b37bb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:45:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fa695b45-0991-40d9-81ec-4a5517b37bb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fa695b45-0991-40d9-81ec-4a5517b37bb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:25 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:45:25 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:25 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7da9776c-0cab-4843-a40d-f69c8dec1e29 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-74dd5177-ff25-4927-a49f-2568af2264e2" returned: 0 in 0.658s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:25 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7da9776c-0cab-4843-a40d-f69c8dec1e29 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:45:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7da9776c-0cab-4843-a40d-f69c8dec1e29 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-0bb02aa1-79b6-4bb3-b8c2-7eb0373c1868 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.952s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:25 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-0bb02aa1-79b6-4bb3-b8c2-7eb0373c1868 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-141234317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d946579-e856-4585-b2b9-4ffa2f105241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41933e9eac842fc98c37003c26e8b14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:45:20Z,use_quota=True,user_id='b382014fe726416599d9531d4e7788ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:45:25 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-0bb02aa1-79b6-4bb3-b8c2-7eb0373c1868 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Creating volume 5d946579-e856-4585-b2b9-4ffa2f105241 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:45:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-0bb02aa1-79b6-4bb3-b8c2-7eb0373c1868 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-0bb02aa1-79b6-4bb3-b8c2-7eb0373c1868 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:25 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-0bb02aa1-79b6-4bb3-b8c2-7eb0373c1868 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:45:25 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-0bb02aa1-79b6-4bb3-b8c2-7eb0373c1868 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:45:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-0bb02aa1-79b6-4bb3-b8c2-7eb0373c1868 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:25 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-0bb02aa1-79b6-4bb3-b8c2-7eb0373c1868 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:45:25 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-0bb02aa1-79b6-4bb3-b8c2-7eb0373c1868 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:45:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-0bb02aa1-79b6-4bb3-b8c2-7eb0373c1868 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d946579-e856-4585-b2b9-4ffa2f105241 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:25 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d946579-e856-4585-b2b9-4ffa2f105241 1073741824 Jul 11 04:45:25 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7da9776c-0cab-4843-a40d-f69c8dec1e29 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0d47de4-4e72-4afe-949c-454797e9be8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74dd5177-ff25-4927-a49f-2568af2264e2', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:25 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:25 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7da9776c-0cab-4843-a40d-f69c8dec1e29 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2afac821-0e71-4896-a6b4-b6bafee0a816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:25 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-7da9776c-0cab-4843-a40d-f69c8dec1e29 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Volume volume-74dd5177-ff25-4927-a49f-2568af2264e2 (74dd5177-ff25-4927-a49f-2568af2264e2): created successfully Jul 11 04:45:25 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7da9776c-0cab-4843-a40d-f69c8dec1e29 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2afac821-0e71-4896-a6b4-b6bafee0a816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:25 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7da9776c-0cab-4843-a40d-f69c8dec1e29 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Flow 'volume_create_manager' (0fb0ed56-ad7f-4a68-98dd-5d7d3ca3c472) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:45:25 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-7da9776c-0cab-4843-a40d-f69c8dec1e29 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Created volume successfully. Jul 11 04:45:26 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fb5e0a20-0b23-48c0-a4d2-060909ba0f84 tempest-CreateVolumesFromSnapshotTest-469897697 None] Acquiring lock "cinder-4feb22d7-7ae6-419e-a30f-48646a76ca70-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:26 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fb5e0a20-0b23-48c0-a4d2-060909ba0f84 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "cinder-4feb22d7-7ae6-419e-a30f-48646a76ca70-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:26 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fb5e0a20-0b23-48c0-a4d2-060909ba0f84 tempest-CreateVolumesFromSnapshotTest-469897697 None] Acquiring lock "cinder-quobyte-4feb22d7-7ae6-419e-a30f-48646a76ca70" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:26 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fb5e0a20-0b23-48c0-a4d2-060909ba0f84 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "cinder-quobyte-4feb22d7-7ae6-419e-a30f-48646a76ca70" acquired by "delete_volume" :: waited 0.022s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:26 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[30507c74-655b-42c8-8774-504db684f292]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb5e0a20-0b23-48c0-a4d2-060909ba0f84 tempest-CreateVolumesFromSnapshotTest-469897697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4feb22d7-7ae6-419e-a30f-48646a76ca70 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:26 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:26 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4feb22d7-7ae6-419e-a30f-48646a76ca70 Jul 11 04:45:26 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fa695b45-0991-40d9-81ec-4a5517b37bb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.732s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:26 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-fa695b45-0991-40d9-81ec-4a5517b37bb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:45:26 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-fa695b45-0991-40d9-81ec-4a5517b37bb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Deleted volume successfully. Jul 11 04:45:26 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fa695b45-0991-40d9-81ec-4a5517b37bb4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "cinder-344306c5-45b6-4844-b99c-fb5be87b538b-delete_volume" released by "delete_volume" :: held 2.487s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:26 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-0bb02aa1-79b6-4bb3-b8c2-7eb0373c1868 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d946579-e856-4585-b2b9-4ffa2f105241 1073741824" returned: 0 in 0.927s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-0bb02aa1-79b6-4bb3-b8c2-7eb0373c1868 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d946579-e856-4585-b2b9-4ffa2f105241 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:26 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d946579-e856-4585-b2b9-4ffa2f105241 Jul 11 04:45:26 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:27 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb5e0a20-0b23-48c0-a4d2-060909ba0f84 tempest-CreateVolumesFromSnapshotTest-469897697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4feb22d7-7ae6-419e-a30f-48646a76ca70" returned: 0 in 0.780s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb5e0a20-0b23-48c0-a4d2-060909ba0f84 tempest-CreateVolumesFromSnapshotTest-469897697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4feb22d7-7ae6-419e-a30f-48646a76ca70 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:27 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4feb22d7-7ae6-419e-a30f-48646a76ca70 Jul 11 04:45:27 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:27 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-0bb02aa1-79b6-4bb3-b8c2-7eb0373c1868 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d946579-e856-4585-b2b9-4ffa2f105241" returned: 0 in 0.685s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:27 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-0bb02aa1-79b6-4bb3-b8c2-7eb0373c1868 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:45:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-0bb02aa1-79b6-4bb3-b8c2-7eb0373c1868 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fa4b304d-b6ff-490c-8536-99f0c92aa366 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.138s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:27 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-fa4b304d-b6ff-490c-8536-99f0c92aa366 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1886940980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20a1edcc-48d0-4c9e-a07a-5dced0eb0cbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41933e9eac842fc98c37003c26e8b14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:45:20Z,use_quota=True,user_id='b382014fe726416599d9531d4e7788ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:45:27 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-fa4b304d-b6ff-490c-8536-99f0c92aa366 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Creating volume 20a1edcc-48d0-4c9e-a07a-5dced0eb0cbf {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:45:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fa4b304d-b6ff-490c-8536-99f0c92aa366 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fa4b304d-b6ff-490c-8536-99f0c92aa366 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:27 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-fa4b304d-b6ff-490c-8536-99f0c92aa366 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:45:27 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-fa4b304d-b6ff-490c-8536-99f0c92aa366 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:45:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fa4b304d-b6ff-490c-8536-99f0c92aa366 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:27 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-fa4b304d-b6ff-490c-8536-99f0c92aa366 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:45:27 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-fa4b304d-b6ff-490c-8536-99f0c92aa366 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:45:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fa4b304d-b6ff-490c-8536-99f0c92aa366 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-20a1edcc-48d0-4c9e-a07a-5dced0eb0cbf 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:27 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-20a1edcc-48d0-4c9e-a07a-5dced0eb0cbf 1073741824 Jul 11 04:45:27 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0bb02aa1-79b6-4bb3-b8c2-7eb0373c1868 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9b8f026-bd94-466b-adf1-068db209a00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d946579-e856-4585-b2b9-4ffa2f105241', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0bb02aa1-79b6-4bb3-b8c2-7eb0373c1868 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08457c7f-875e-4a92-879c-00b0b16c6ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:27 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-0bb02aa1-79b6-4bb3-b8c2-7eb0373c1868 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Volume volume-5d946579-e856-4585-b2b9-4ffa2f105241 (5d946579-e856-4585-b2b9-4ffa2f105241): created successfully Jul 11 04:45:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0bb02aa1-79b6-4bb3-b8c2-7eb0373c1868 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08457c7f-875e-4a92-879c-00b0b16c6ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-0bb02aa1-79b6-4bb3-b8c2-7eb0373c1868 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Flow 'volume_create_manager' (937b9e98-da7c-4c7a-94d9-a24ef617e08b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:45:27 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-0bb02aa1-79b6-4bb3-b8c2-7eb0373c1868 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Created volume successfully. Jul 11 04:45:27 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb5e0a20-0b23-48c0-a4d2-060909ba0f84 tempest-CreateVolumesFromSnapshotTest-469897697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4feb22d7-7ae6-419e-a30f-48646a76ca70" returned: 0 in 0.689s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:27 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fb5e0a20-0b23-48c0-a4d2-060909ba0f84 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "cinder-quobyte-4feb22d7-7ae6-419e-a30f-48646a76ca70" released by "delete_volume" :: held 1.517s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:27 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-fb5e0a20-0b23-48c0-a4d2-060909ba0f84 tempest-CreateVolumesFromSnapshotTest-469897697 None] Created reservations ['dcc58fa7-8a73-43d2-a848-0982f421c385', '5d0ba3cc-a5be-463e-b725-44aa08b49c90', 'd764d57d-0385-4ced-9fba-0e49c29be6eb', 'e5325a00-e101-4671-a7ff-dadab871f1f3'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:45:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fb5e0a20-0b23-48c0-a4d2-060909ba0f84 tempest-CreateVolumesFromSnapshotTest-469897697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fb5e0a20-0b23-48c0-a4d2-060909ba0f84 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-fb5e0a20-0b23-48c0-a4d2-060909ba0f84 tempest-CreateVolumesFromSnapshotTest-469897697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:45:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-fb5e0a20-0b23-48c0-a4d2-060909ba0f84 tempest-CreateVolumesFromSnapshotTest-469897697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:45:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fb5e0a20-0b23-48c0-a4d2-060909ba0f84 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb5e0a20-0b23-48c0-a4d2-060909ba0f84 tempest-CreateVolumesFromSnapshotTest-469897697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:28 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:45:28 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:28 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fa4b304d-b6ff-490c-8536-99f0c92aa366 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-20a1edcc-48d0-4c9e-a07a-5dced0eb0cbf 1073741824" returned: 0 in 0.869s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fa4b304d-b6ff-490c-8536-99f0c92aa366 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-20a1edcc-48d0-4c9e-a07a-5dced0eb0cbf {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:28 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-20a1edcc-48d0-4c9e-a07a-5dced0eb0cbf Jul 11 04:45:28 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:28 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-637471d4-4565-4582-b9c2-b8f0701802c4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Acquiring lock "cinder-68fdb5dd-e29c-440d-88cb-8ec9054a6f05-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:28 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-637471d4-4565-4582-b9c2-b8f0701802c4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "cinder-68fdb5dd-e29c-440d-88cb-8ec9054a6f05-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:28 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-637471d4-4565-4582-b9c2-b8f0701802c4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Acquiring lock "cinder-quobyte-45e42e77-7def-4a6f-b84c-a677dcc8bbda" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:28 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-637471d4-4565-4582-b9c2-b8f0701802c4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "cinder-quobyte-45e42e77-7def-4a6f-b84c-a677dcc8bbda" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:28 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-637471d4-4565-4582-b9c2-b8f0701802c4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Acquiring lock "cinder-quobyte-68fdb5dd-e29c-440d-88cb-8ec9054a6f05" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:28 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-637471d4-4565-4582-b9c2-b8f0701802c4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "cinder-quobyte-68fdb5dd-e29c-440d-88cb-8ec9054a6f05" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-637471d4-4565-4582-b9c2-b8f0701802c4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Deleting offline snapshot 68fdb5dd-e29c-440d-88cb-8ec9054a6f05 of volume 45e42e77-7def-4a6f-b84c-a677dcc8bbda {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:45:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-637471d4-4565-4582-b9c2-b8f0701802c4 tempest-CreateVolumesFromSnapshotTest-469897697 None] snapshot_file for this snap is: volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda.68fdb5dd-e29c-440d-88cb-8ec9054a6f05 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:45:28 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[217e4783-c428-4ac4-9a5c-d9afe8c221b3]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-637471d4-4565-4582-b9c2-b8f0701802c4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda.68fdb5dd-e29c-440d-88cb-8ec9054a6f05 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:28 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb5e0a20-0b23-48c0-a4d2-060909ba0f84 tempest-CreateVolumesFromSnapshotTest-469897697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.741s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:28 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-fb5e0a20-0b23-48c0-a4d2-060909ba0f84 tempest-CreateVolumesFromSnapshotTest-469897697 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:45:28 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-fb5e0a20-0b23-48c0-a4d2-060909ba0f84 tempest-CreateVolumesFromSnapshotTest-469897697 None] Deleted volume successfully. Jul 11 04:45:28 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-fb5e0a20-0b23-48c0-a4d2-060909ba0f84 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "cinder-4feb22d7-7ae6-419e-a30f-48646a76ca70-delete_volume" released by "delete_volume" :: held 2.465s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:28 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda.68fdb5dd-e29c-440d-88cb-8ec9054a6f05 Jul 11 04:45:28 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:29 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fa4b304d-b6ff-490c-8536-99f0c92aa366 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-20a1edcc-48d0-4c9e-a07a-5dced0eb0cbf" returned: 0 in 0.755s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:29 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-fa4b304d-b6ff-490c-8536-99f0c92aa366 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] <== create_volume: return (1667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:45:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fa4b304d-b6ff-490c-8536-99f0c92aa366 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4168b53b-de83-4c13-bb76-82031909dbae tempest-ProjectReaderTests-787132287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.139s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:29 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4168b53b-de83-4c13-bb76-82031909dbae tempest-ProjectReaderTests-787132287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-532335606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=397586f0-3780-4ab8-af01-6603c3536919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36dcca031e5d4245aed8aadd7b6f88e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:45:21Z,use_quota=True,user_id='ee6e4107301b44a98a0fdd41aead55f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:45:29 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-4168b53b-de83-4c13-bb76-82031909dbae tempest-ProjectReaderTests-787132287 None] Creating volume 397586f0-3780-4ab8-af01-6603c3536919 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:45:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4168b53b-de83-4c13-bb76-82031909dbae tempest-ProjectReaderTests-787132287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4168b53b-de83-4c13-bb76-82031909dbae tempest-ProjectReaderTests-787132287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:29 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4168b53b-de83-4c13-bb76-82031909dbae tempest-ProjectReaderTests-787132287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:45:29 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4168b53b-de83-4c13-bb76-82031909dbae tempest-ProjectReaderTests-787132287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:45:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4168b53b-de83-4c13-bb76-82031909dbae tempest-ProjectReaderTests-787132287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:29 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4168b53b-de83-4c13-bb76-82031909dbae tempest-ProjectReaderTests-787132287 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:45:29 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-4168b53b-de83-4c13-bb76-82031909dbae tempest-ProjectReaderTests-787132287 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:45:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4168b53b-de83-4c13-bb76-82031909dbae tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:29 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919 1073741824 Jul 11 04:45:29 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:29 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fa4b304d-b6ff-490c-8536-99f0c92aa366 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb95333b-eb07-4950-bfd8-04c303a40623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20a1edcc-48d0-4c9e-a07a-5dced0eb0cbf', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:29 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fa4b304d-b6ff-490c-8536-99f0c92aa366 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d50a40-bf93-452b-a6c4-f0b06e0e47be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:29 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-fa4b304d-b6ff-490c-8536-99f0c92aa366 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Volume volume-20a1edcc-48d0-4c9e-a07a-5dced0eb0cbf (20a1edcc-48d0-4c9e-a07a-5dced0eb0cbf): created successfully Jul 11 04:45:29 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fa4b304d-b6ff-490c-8536-99f0c92aa366 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d50a40-bf93-452b-a6c4-f0b06e0e47be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:29 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fa4b304d-b6ff-490c-8536-99f0c92aa366 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Flow 'volume_create_manager' (67b2cd0d-4bc5-473d-948c-6ae21c2d60f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:45:29 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-fa4b304d-b6ff-490c-8536-99f0c92aa366 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Created volume successfully. Jul 11 04:45:29 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-637471d4-4565-4582-b9c2-b8f0701802c4 tempest-CreateVolumesFromSnapshotTest-469897697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda.68fdb5dd-e29c-440d-88cb-8ec9054a6f05" returned: 0 in 0.748s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:29 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-637471d4-4565-4582-b9c2-b8f0701802c4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:45:29 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc17cd3-b8ce-49de-bd84-02537df74e02]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-637471d4-4565-4582-b9c2-b8f0701802c4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:29 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda Jul 11 04:45:29 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:30 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-32ebbbc2-fce0-4fd4-b8c5-56bf947b88de tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Acquiring lock "cinder-20a1edcc-48d0-4c9e-a07a-5dced0eb0cbf-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:30 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-32ebbbc2-fce0-4fd4-b8c5-56bf947b88de tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "cinder-20a1edcc-48d0-4c9e-a07a-5dced0eb0cbf-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:30 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4168b53b-de83-4c13-bb76-82031909dbae tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919 1073741824" returned: 0 in 0.919s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:30 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-32ebbbc2-fce0-4fd4-b8c5-56bf947b88de tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Acquiring lock "cinder-quobyte-20a1edcc-48d0-4c9e-a07a-5dced0eb0cbf" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4168b53b-de83-4c13-bb76-82031909dbae tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:30 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-32ebbbc2-fce0-4fd4-b8c5-56bf947b88de tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "cinder-quobyte-20a1edcc-48d0-4c9e-a07a-5dced0eb0cbf" acquired by "delete_volume" :: waited 0.032s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:30 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919 Jul 11 04:45:30 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:30 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b440f0-f182-4dbd-a278-eb39a4dc77b6]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-32ebbbc2-fce0-4fd4-b8c5-56bf947b88de tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-20a1edcc-48d0-4c9e-a07a-5dced0eb0cbf {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:30 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-20a1edcc-48d0-4c9e-a07a-5dced0eb0cbf Jul 11 04:45:30 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:30 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-637471d4-4565-4582-b9c2-b8f0701802c4 tempest-CreateVolumesFromSnapshotTest-469897697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda" returned: 0 in 0.838s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-637471d4-4565-4582-b9c2-b8f0701802c4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda.68fdb5dd-e29c-440d-88cb-8ec9054a6f05 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:30 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda.68fdb5dd-e29c-440d-88cb-8ec9054a6f05 Jul 11 04:45:30 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:30 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4168b53b-de83-4c13-bb76-82031909dbae tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919" returned: 0 in 0.671s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:30 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-4168b53b-de83-4c13-bb76-82031909dbae tempest-ProjectReaderTests-787132287 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:45:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4168b53b-de83-4c13-bb76-82031909dbae tempest-ProjectReaderTests-787132287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-8e6afef6-8c50-4879-a6fc-cee458ced1a2 tempest-CinderUnicodeTest-1836980750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.888s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:30 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-8e6afef6-8c50-4879-a6fc-cee458ced1a2 tempest-CinderUnicodeTest-1836980750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:45:21Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1926294960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3e8f0a1-c3db-49b9-a8eb-2c2747db1262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f89f86cf5934c208d1c1536cda6f1e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:45:22Z,use_quota=True,user_id='6b5e320000b84cadabf395022ee019f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:45:30 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-8e6afef6-8c50-4879-a6fc-cee458ced1a2 tempest-CinderUnicodeTest-1836980750 None] Creating volume a3e8f0a1-c3db-49b9-a8eb-2c2747db1262 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:45:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-8e6afef6-8c50-4879-a6fc-cee458ced1a2 tempest-CinderUnicodeTest-1836980750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-8e6afef6-8c50-4879-a6fc-cee458ced1a2 tempest-CinderUnicodeTest-1836980750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:30 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-8e6afef6-8c50-4879-a6fc-cee458ced1a2 tempest-CinderUnicodeTest-1836980750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:45:30 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-8e6afef6-8c50-4879-a6fc-cee458ced1a2 tempest-CinderUnicodeTest-1836980750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:45:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-8e6afef6-8c50-4879-a6fc-cee458ced1a2 tempest-CinderUnicodeTest-1836980750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:30 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-8e6afef6-8c50-4879-a6fc-cee458ced1a2 tempest-CinderUnicodeTest-1836980750 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:45:30 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-8e6afef6-8c50-4879-a6fc-cee458ced1a2 tempest-CinderUnicodeTest-1836980750 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:45:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8e6afef6-8c50-4879-a6fc-cee458ced1a2 tempest-CinderUnicodeTest-1836980750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:30 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262 1073741824 Jul 11 04:45:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4168b53b-de83-4c13-bb76-82031909dbae tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3829f707-aba4-45d4-832f-167f4bd197e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-397586f0-3780-4ab8-af01-6603c3536919', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:30 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4168b53b-de83-4c13-bb76-82031909dbae tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca1aa9db-e1a7-4ca4-9720-2e60efa4a3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:30 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-4168b53b-de83-4c13-bb76-82031909dbae tempest-ProjectReaderTests-787132287 None] Volume volume-397586f0-3780-4ab8-af01-6603c3536919 (397586f0-3780-4ab8-af01-6603c3536919): created successfully Jul 11 04:45:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4168b53b-de83-4c13-bb76-82031909dbae tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca1aa9db-e1a7-4ca4-9720-2e60efa4a3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-4168b53b-de83-4c13-bb76-82031909dbae tempest-ProjectReaderTests-787132287 None] Flow 'volume_create_manager' (ad96db91-a3b8-44e1-95c5-285ff2d99afd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:45:30 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-4168b53b-de83-4c13-bb76-82031909dbae tempest-ProjectReaderTests-787132287 None] Created volume successfully. Jul 11 04:45:31 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-32ebbbc2-fce0-4fd4-b8c5-56bf947b88de tempest-CreateVolumesFromSourceVolumeTest-247638403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-20a1edcc-48d0-4c9e-a07a-5dced0eb0cbf" returned: 0 in 0.816s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-32ebbbc2-fce0-4fd4-b8c5-56bf947b88de tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-20a1edcc-48d0-4c9e-a07a-5dced0eb0cbf {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:31 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-20a1edcc-48d0-4c9e-a07a-5dced0eb0cbf Jul 11 04:45:31 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:31 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-637471d4-4565-4582-b9c2-b8f0701802c4 tempest-CreateVolumesFromSnapshotTest-469897697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda.68fdb5dd-e29c-440d-88cb-8ec9054a6f05" returned: 0 in 0.756s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-637471d4-4565-4582-b9c2-b8f0701802c4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda.68fdb5dd-e29c-440d-88cb-8ec9054a6f05 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:31 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda.68fdb5dd-e29c-440d-88cb-8ec9054a6f05 Jul 11 04:45:31 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:31 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-32ebbbc2-fce0-4fd4-b8c5-56bf947b88de tempest-CreateVolumesFromSourceVolumeTest-247638403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-20a1edcc-48d0-4c9e-a07a-5dced0eb0cbf" returned: 0 in 0.680s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:31 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-32ebbbc2-fce0-4fd4-b8c5-56bf947b88de tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "cinder-quobyte-20a1edcc-48d0-4c9e-a07a-5dced0eb0cbf" released by "delete_volume" :: held 1.575s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:31 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:31 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-637471d4-4565-4582-b9c2-b8f0701802c4 tempest-CreateVolumesFromSnapshotTest-469897697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda.68fdb5dd-e29c-440d-88cb-8ec9054a6f05" returned: 0 in 0.689s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8e6afef6-8c50-4879-a6fc-cee458ced1a2 tempest-CinderUnicodeTest-1836980750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262 1073741824" returned: 0 in 0.943s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c1d62690-d49d-4e52-a807-633fbd38304f tempest-ProjectReaderTests-787132287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:31 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-637471d4-4565-4582-b9c2-b8f0701802c4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "cinder-quobyte-68fdb5dd-e29c-440d-88cb-8ec9054a6f05" released by "_delete_snapshot" :: held 3.237s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:31 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-637471d4-4565-4582-b9c2-b8f0701802c4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "cinder-quobyte-45e42e77-7def-4a6f-b84c-a677dcc8bbda" released by "delete_snapshot" :: held 3.276s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:31 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-32ebbbc2-fce0-4fd4-b8c5-56bf947b88de tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Created reservations ['22ddf318-7efc-4f39-a527-f5ce7bbf83c2', '1bc25bcc-eafb-49c5-b0b0-e54c896969ae', 'add467b7-67be-4e43-9135-b3ff1c484849', '9aeaab13-9c62-4c7d-bbbd-d2d2e9b7620d'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:45:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8e6afef6-8c50-4879-a6fc-cee458ced1a2 tempest-CinderUnicodeTest-1836980750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:31 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262 Jul 11 04:45:31 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:32 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-637471d4-4565-4582-b9c2-b8f0701802c4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Created reservations ['d38ae162-e003-451c-836a-3483b32889b3', 'ba57740f-6307-4023-9da5-cfc6e55c9bde', '757cd221-5686-4811-a7e7-f7ec3cfd3913', '6c5c7d31-1c37-4a5c-924b-a68f2c7f4092'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:45:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-32ebbbc2-fce0-4fd4-b8c5-56bf947b88de tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-32ebbbc2-fce0-4fd4-b8c5-56bf947b88de tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:32 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-32ebbbc2-fce0-4fd4-b8c5-56bf947b88de tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:45:32 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-32ebbbc2-fce0-4fd4-b8c5-56bf947b88de tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:45:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-32ebbbc2-fce0-4fd4-b8c5-56bf947b88de tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-32ebbbc2-fce0-4fd4-b8c5-56bf947b88de tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:32 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:45:32 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:32 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-637471d4-4565-4582-b9c2-b8f0701802c4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Delete snapshot completed successfully. Jul 11 04:45:32 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-637471d4-4565-4582-b9c2-b8f0701802c4 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "cinder-68fdb5dd-e29c-440d-88cb-8ec9054a6f05-delete_snapshot" released by "delete_snapshot" :: held 3.529s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:32 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c96e970d-c941-4712-b1c6-04d86863e53c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Acquiring lock "cinder-5d946579-e856-4585-b2b9-4ffa2f105241-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:32 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c96e970d-c941-4712-b1c6-04d86863e53c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "cinder-5d946579-e856-4585-b2b9-4ffa2f105241-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:32 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c96e970d-c941-4712-b1c6-04d86863e53c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Acquiring lock "cinder-quobyte-5d946579-e856-4585-b2b9-4ffa2f105241" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:32 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c96e970d-c941-4712-b1c6-04d86863e53c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "cinder-quobyte-5d946579-e856-4585-b2b9-4ffa2f105241" acquired by "delete_volume" :: waited 0.019s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:32 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64e7627-9a9d-4e93-bf9d-e10a2b9dff4b]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c96e970d-c941-4712-b1c6-04d86863e53c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d946579-e856-4585-b2b9-4ffa2f105241 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:32 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d946579-e856-4585-b2b9-4ffa2f105241 Jul 11 04:45:32 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:32 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8e6afef6-8c50-4879-a6fc-cee458ced1a2 tempest-CinderUnicodeTest-1836980750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262" returned: 0 in 0.687s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:32 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-8e6afef6-8c50-4879-a6fc-cee458ced1a2 tempest-CinderUnicodeTest-1836980750 None] <== create_volume: return (1786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:45:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-8e6afef6-8c50-4879-a6fc-cee458ced1a2 tempest-CinderUnicodeTest-1836980750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.790s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c1d62690-d49d-4e52-a807-633fbd38304f tempest-ProjectReaderTests-787132287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.777s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:32 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-c1d62690-d49d-4e52-a807-633fbd38304f tempest-ProjectReaderTests-787132287 None] Creating offline snapshot f9e0596b-96fc-4c0b-9ee5-5cf1b2a3d4fb of volume 397586f0-3780-4ab8-af01-6603c3536919 {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:45:32 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8e6afef6-8c50-4879-a6fc-cee458ced1a2 tempest-CinderUnicodeTest-1836980750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc356ae0-0d6b-4522-82f5-27c64216e639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:32 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8e6afef6-8c50-4879-a6fc-cee458ced1a2 tempest-CinderUnicodeTest-1836980750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (affda68c-90b0-4749-a015-836f23bc5ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:32 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ab88c8-195d-48cb-adf7-2940ad0a00b6]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c1d62690-d49d-4e52-a807-633fbd38304f tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:32 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-8e6afef6-8c50-4879-a6fc-cee458ced1a2 tempest-CinderUnicodeTest-1836980750 None] Volume volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262 (a3e8f0a1-c3db-49b9-a8eb-2c2747db1262): created successfully Jul 11 04:45:32 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8e6afef6-8c50-4879-a6fc-cee458ced1a2 tempest-CinderUnicodeTest-1836980750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (affda68c-90b0-4749-a015-836f23bc5ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:32 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8e6afef6-8c50-4879-a6fc-cee458ced1a2 tempest-CinderUnicodeTest-1836980750 None] Flow 'volume_create_manager' (bb556455-0f55-40fe-bec9-8bdb7627f045) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:45:32 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-8e6afef6-8c50-4879-a6fc-cee458ced1a2 tempest-CinderUnicodeTest-1836980750 None] Created volume successfully. Jul 11 04:45:32 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-32ebbbc2-fce0-4fd4-b8c5-56bf947b88de tempest-CreateVolumesFromSourceVolumeTest-247638403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.752s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:32 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-32ebbbc2-fce0-4fd4-b8c5-56bf947b88de tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:45:32 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-32ebbbc2-fce0-4fd4-b8c5-56bf947b88de tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Deleted volume successfully. Jul 11 04:45:32 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-32ebbbc2-fce0-4fd4-b8c5-56bf947b88de tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "cinder-20a1edcc-48d0-4c9e-a07a-5dced0eb0cbf-delete_volume" released by "delete_volume" :: held 2.769s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:32 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e80b46b7-b988-4b3e-9ce5-be2dc9804369 tempest-CreateVolumesFromSnapshotTest-469897697 None] Acquiring lock "cinder-45e42e77-7def-4a6f-b84c-a677dcc8bbda-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:32 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919 Jul 11 04:45:32 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:32 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e80b46b7-b988-4b3e-9ce5-be2dc9804369 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "cinder-45e42e77-7def-4a6f-b84c-a677dcc8bbda-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:32 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e80b46b7-b988-4b3e-9ce5-be2dc9804369 tempest-CreateVolumesFromSnapshotTest-469897697 None] Acquiring lock "cinder-quobyte-45e42e77-7def-4a6f-b84c-a677dcc8bbda" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:32 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e80b46b7-b988-4b3e-9ce5-be2dc9804369 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "cinder-quobyte-45e42e77-7def-4a6f-b84c-a677dcc8bbda" acquired by "delete_volume" :: waited 0.017s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:33 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[7589b2cf-53e3-462b-858d-a2cb9fd0bf79]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e80b46b7-b988-4b3e-9ce5-be2dc9804369 tempest-CreateVolumesFromSnapshotTest-469897697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:33 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda Jul 11 04:45:33 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:33 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c96e970d-c941-4712-b1c6-04d86863e53c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d946579-e856-4585-b2b9-4ffa2f105241" returned: 0 in 0.889s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c96e970d-c941-4712-b1c6-04d86863e53c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d946579-e856-4585-b2b9-4ffa2f105241 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:33 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d946579-e856-4585-b2b9-4ffa2f105241 Jul 11 04:45:33 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:33 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c1d62690-d49d-4e52-a807-633fbd38304f tempest-ProjectReaderTests-787132287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919" returned: 0 in 0.961s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c1d62690-d49d-4e52-a807-633fbd38304f tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919.f9e0596b-96fc-4c0b-9ee5-5cf1b2a3d4fb 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:33 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919.f9e0596b-96fc-4c0b-9ee5-5cf1b2a3d4fb 1G Jul 11 04:45:33 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-79df160e-e725-4050-ae39-e477acc85d25 tempest-CinderUnicodeTest-1836980750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:33 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e80b46b7-b988-4b3e-9ce5-be2dc9804369 tempest-CreateVolumesFromSnapshotTest-469897697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda" returned: 0 in 0.854s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e80b46b7-b988-4b3e-9ce5-be2dc9804369 tempest-CreateVolumesFromSnapshotTest-469897697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:33 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda Jul 11 04:45:33 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:34 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c96e970d-c941-4712-b1c6-04d86863e53c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d946579-e856-4585-b2b9-4ffa2f105241" returned: 0 in 0.774s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c96e970d-c941-4712-b1c6-04d86863e53c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "cinder-quobyte-5d946579-e856-4585-b2b9-4ffa2f105241" released by "delete_volume" :: held 1.704s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:34 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-c96e970d-c941-4712-b1c6-04d86863e53c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Created reservations ['5e2cb1b0-a1b3-40d0-8242-335863442462', '5d354f49-66eb-4a35-b431-8e64cba11b0d', '89dbffae-2415-4f5e-bf3a-b6ea0ed94998', '5babc4ef-4d07-4cbe-ac42-028742ff6c2a'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:45:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c96e970d-c941-4712-b1c6-04d86863e53c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c96e970d-c941-4712-b1c6-04d86863e53c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:34 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c96e970d-c941-4712-b1c6-04d86863e53c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:45:34 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c96e970d-c941-4712-b1c6-04d86863e53c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:45:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c96e970d-c941-4712-b1c6-04d86863e53c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c96e970d-c941-4712-b1c6-04d86863e53c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:34 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:45:34 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:34 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c1d62690-d49d-4e52-a807-633fbd38304f tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919.f9e0596b-96fc-4c0b-9ee5-5cf1b2a3d4fb 1G" returned: 0 in 0.896s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c1d62690-d49d-4e52-a807-633fbd38304f tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-397586f0-3780-4ab8-af01-6603c3536919 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919.f9e0596b-96fc-4c0b-9ee5-5cf1b2a3d4fb {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:34 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e80b46b7-b988-4b3e-9ce5-be2dc9804369 tempest-CreateVolumesFromSnapshotTest-469897697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-45e42e77-7def-4a6f-b84c-a677dcc8bbda" returned: 0 in 0.701s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:34 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-397586f0-3780-4ab8-af01-6603c3536919 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919.f9e0596b-96fc-4c0b-9ee5-5cf1b2a3d4fb Jul 11 04:45:34 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ddc8af8f-8dcd-473a-b3ee-f15728c8731c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Acquiring lock "cinder-74dd5177-ff25-4927-a49f-2568af2264e2-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e80b46b7-b988-4b3e-9ce5-be2dc9804369 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "cinder-quobyte-45e42e77-7def-4a6f-b84c-a677dcc8bbda" released by "delete_volume" :: held 1.638s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:34 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=140,cinder:UPDATE=190,cinder:DELETE=25,cinder:INSERT=43 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:45:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ddc8af8f-8dcd-473a-b3ee-f15728c8731c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "cinder-74dd5177-ff25-4927-a49f-2568af2264e2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ddc8af8f-8dcd-473a-b3ee-f15728c8731c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Acquiring lock "cinder-quobyte-74dd5177-ff25-4927-a49f-2568af2264e2" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:34 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-e80b46b7-b988-4b3e-9ce5-be2dc9804369 tempest-CreateVolumesFromSnapshotTest-469897697 None] Created reservations ['a04ccd32-1378-4bb2-b14d-be93f322e6a6', 'b939a8fb-1e56-4e26-a535-0a0a8db62943', 'd78a3ffd-c30f-4935-98c2-373dddeae2c4', 'f01483df-aaf1-47d4-ab67-2bb21dc28267'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:45:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ddc8af8f-8dcd-473a-b3ee-f15728c8731c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "cinder-quobyte-74dd5177-ff25-4927-a49f-2568af2264e2" acquired by "delete_volume" :: waited 0.025s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:34 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3b30e8-6c60-4eaf-9c6f-a7d1480bcd74]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ddc8af8f-8dcd-473a-b3ee-f15728c8731c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-74dd5177-ff25-4927-a49f-2568af2264e2 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e80b46b7-b988-4b3e-9ce5-be2dc9804369 tempest-CreateVolumesFromSnapshotTest-469897697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e80b46b7-b988-4b3e-9ce5-be2dc9804369 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:34 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e80b46b7-b988-4b3e-9ce5-be2dc9804369 tempest-CreateVolumesFromSnapshotTest-469897697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:45:34 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e80b46b7-b988-4b3e-9ce5-be2dc9804369 tempest-CreateVolumesFromSnapshotTest-469897697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:45:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e80b46b7-b988-4b3e-9ce5-be2dc9804369 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e80b46b7-b988-4b3e-9ce5-be2dc9804369 tempest-CreateVolumesFromSnapshotTest-469897697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:34 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:45:34 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:34 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-74dd5177-ff25-4927-a49f-2568af2264e2 Jul 11 04:45:34 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:34 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c96e970d-c941-4712-b1c6-04d86863e53c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.725s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:34 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-c96e970d-c941-4712-b1c6-04d86863e53c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:45:35 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-c96e970d-c941-4712-b1c6-04d86863e53c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Deleted volume successfully. Jul 11 04:45:35 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c96e970d-c941-4712-b1c6-04d86863e53c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "cinder-5d946579-e856-4585-b2b9-4ffa2f105241-delete_volume" released by "delete_volume" :: held 2.659s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:35 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c1d62690-d49d-4e52-a807-633fbd38304f tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-397586f0-3780-4ab8-af01-6603c3536919 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919.f9e0596b-96fc-4c0b-9ee5-5cf1b2a3d4fb" returned: 0 in 0.845s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:35 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-c1d62690-d49d-4e52-a807-633fbd38304f tempest-ProjectReaderTests-787132287 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919.f9e0596b-96fc-4c0b-9ee5-5cf1b2a3d4fb is being set with open permissions: ugo+rw Jul 11 04:45:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c1d62690-d49d-4e52-a807-633fbd38304f tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919.f9e0596b-96fc-4c0b-9ee5-5cf1b2a3d4fb {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:35 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919.f9e0596b-96fc-4c0b-9ee5-5cf1b2a3d4fb Jul 11 04:45:35 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:35 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e80b46b7-b988-4b3e-9ce5-be2dc9804369 tempest-CreateVolumesFromSnapshotTest-469897697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.723s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:35 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-e80b46b7-b988-4b3e-9ce5-be2dc9804369 tempest-CreateVolumesFromSnapshotTest-469897697 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:45:35 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-e80b46b7-b988-4b3e-9ce5-be2dc9804369 tempest-CreateVolumesFromSnapshotTest-469897697 None] Deleted volume successfully. Jul 11 04:45:35 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e80b46b7-b988-4b3e-9ce5-be2dc9804369 tempest-CreateVolumesFromSnapshotTest-469897697 None] Lock "cinder-45e42e77-7def-4a6f-b84c-a677dcc8bbda-delete_volume" released by "delete_volume" :: held 2.680s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:35 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ddc8af8f-8dcd-473a-b3ee-f15728c8731c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-74dd5177-ff25-4927-a49f-2568af2264e2" returned: 0 in 0.912s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ddc8af8f-8dcd-473a-b3ee-f15728c8731c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-74dd5177-ff25-4927-a49f-2568af2264e2 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:35 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-74dd5177-ff25-4927-a49f-2568af2264e2 Jul 11 04:45:35 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:36 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c1d62690-d49d-4e52-a807-633fbd38304f tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919.f9e0596b-96fc-4c0b-9ee5-5cf1b2a3d4fb" returned: 0 in 0.762s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:36 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=145,cinder:UPDATE=211,cinder:INSERT=57,cinder:DELETE=13 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:45:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c1d62690-d49d-4e52-a807-633fbd38304f tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:36 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919.info Jul 11 04:45:36 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:36 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ddc8af8f-8dcd-473a-b3ee-f15728c8731c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-74dd5177-ff25-4927-a49f-2568af2264e2" returned: 0 in 0.754s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:36 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ddc8af8f-8dcd-473a-b3ee-f15728c8731c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "cinder-quobyte-74dd5177-ff25-4927-a49f-2568af2264e2" released by "delete_volume" :: held 1.722s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:36 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-ddc8af8f-8dcd-473a-b3ee-f15728c8731c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Created reservations ['944cfb0c-27c9-4947-b6dc-6502f65efea7', 'af526d6a-60da-4842-9659-f7d6abb1939b', 'f1b48a76-8f18-4325-9fb6-7d439e81eca2', 'be322304-e365-48cc-8461-c993a3ee37d0'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:45:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ddc8af8f-8dcd-473a-b3ee-f15728c8731c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ddc8af8f-8dcd-473a-b3ee-f15728c8731c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ddc8af8f-8dcd-473a-b3ee-f15728c8731c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:45:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ddc8af8f-8dcd-473a-b3ee-f15728c8731c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:45:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ddc8af8f-8dcd-473a-b3ee-f15728c8731c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ddc8af8f-8dcd-473a-b3ee-f15728c8731c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:36 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:45:36 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:36 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-915313f9-cfa6-47db-b767-9124a91e23c5 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Acquiring lock "cinder-7fd8227a-c5af-4d9a-b245-689bd4e36773-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:36 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c1d62690-d49d-4e52-a807-633fbd38304f tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919.info" returned: 0 in 0.733s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:36 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-c1d62690-d49d-4e52-a807-633fbd38304f tempest-ProjectReaderTests-787132287 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919.info is being set with open permissions: ugo+rw Jul 11 04:45:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c1d62690-d49d-4e52-a807-633fbd38304f tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:36 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-915313f9-cfa6-47db-b767-9124a91e23c5 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "cinder-7fd8227a-c5af-4d9a-b245-689bd4e36773-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:37 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919.info Jul 11 04:45:37 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:37 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-915313f9-cfa6-47db-b767-9124a91e23c5 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Acquiring lock "cinder-quobyte-7fd8227a-c5af-4d9a-b245-689bd4e36773" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:37 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-915313f9-cfa6-47db-b767-9124a91e23c5 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "cinder-quobyte-7fd8227a-c5af-4d9a-b245-689bd4e36773" acquired by "delete_volume" :: waited 0.018s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:37 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bc4004-cb18-49f5-a7f6-e24c125e4150]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-915313f9-cfa6-47db-b767-9124a91e23c5 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7fd8227a-c5af-4d9a-b245-689bd4e36773 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:37 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7fd8227a-c5af-4d9a-b245-689bd4e36773 Jul 11 04:45:37 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:37 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ddc8af8f-8dcd-473a-b3ee-f15728c8731c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.747s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:37 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-ddc8af8f-8dcd-473a-b3ee-f15728c8731c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:45:37 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-ddc8af8f-8dcd-473a-b3ee-f15728c8731c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Deleted volume successfully. Jul 11 04:45:37 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ddc8af8f-8dcd-473a-b3ee-f15728c8731c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "cinder-74dd5177-ff25-4927-a49f-2568af2264e2-delete_volume" released by "delete_volume" :: held 2.730s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:37 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c1d62690-d49d-4e52-a807-633fbd38304f tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919.info" returned: 0 in 0.767s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c1d62690-d49d-4e52-a807-633fbd38304f tempest-ProjectReaderTests-787132287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.102s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-79df160e-e725-4050-ae39-e477acc85d25 tempest-CinderUnicodeTest-1836980750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.867s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:37 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-79df160e-e725-4050-ae39-e477acc85d25 tempest-CinderUnicodeTest-1836980750 None] Creating offline snapshot 801a054f-a27d-4c22-9ab8-3e416d85c781 of volume a3e8f0a1-c3db-49b9-a8eb-2c2747db1262 {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:45:37 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-c1d62690-d49d-4e52-a807-633fbd38304f tempest-ProjectReaderTests-787132287 None] Create snapshot completed successfully Jul 11 04:45:37 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[80444e02-d4f1-4238-932d-c7c1593e37e5]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-79df160e-e725-4050-ae39-e477acc85d25 tempest-CinderUnicodeTest-1836980750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:37 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262 Jul 11 04:45:37 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:37 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-915313f9-cfa6-47db-b767-9124a91e23c5 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7fd8227a-c5af-4d9a-b245-689bd4e36773" returned: 0 in 0.818s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-915313f9-cfa6-47db-b767-9124a91e23c5 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7fd8227a-c5af-4d9a-b245-689bd4e36773 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:37 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7fd8227a-c5af-4d9a-b245-689bd4e36773 Jul 11 04:45:37 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:38 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b95d21df-9162-4f2b-9995-1275f20a6202 tempest-ProjectReaderTests-787132287 None] Acquiring lock "cinder-f9e0596b-96fc-4c0b-9ee5-5cf1b2a3d4fb-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:38 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b95d21df-9162-4f2b-9995-1275f20a6202 tempest-ProjectReaderTests-787132287 None] Lock "cinder-f9e0596b-96fc-4c0b-9ee5-5cf1b2a3d4fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:38 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b95d21df-9162-4f2b-9995-1275f20a6202 tempest-ProjectReaderTests-787132287 None] Acquiring lock "cinder-quobyte-397586f0-3780-4ab8-af01-6603c3536919" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:38 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b95d21df-9162-4f2b-9995-1275f20a6202 tempest-ProjectReaderTests-787132287 None] Lock "cinder-quobyte-397586f0-3780-4ab8-af01-6603c3536919" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:38 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b95d21df-9162-4f2b-9995-1275f20a6202 tempest-ProjectReaderTests-787132287 None] Acquiring lock "cinder-quobyte-f9e0596b-96fc-4c0b-9ee5-5cf1b2a3d4fb" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:38 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b95d21df-9162-4f2b-9995-1275f20a6202 tempest-ProjectReaderTests-787132287 None] Lock "cinder-quobyte-f9e0596b-96fc-4c0b-9ee5-5cf1b2a3d4fb" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:38 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-b95d21df-9162-4f2b-9995-1275f20a6202 tempest-ProjectReaderTests-787132287 None] Deleting offline snapshot f9e0596b-96fc-4c0b-9ee5-5cf1b2a3d4fb of volume 397586f0-3780-4ab8-af01-6603c3536919 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:45:38 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-b95d21df-9162-4f2b-9995-1275f20a6202 tempest-ProjectReaderTests-787132287 None] snapshot_file for this snap is: volume-397586f0-3780-4ab8-af01-6603c3536919.f9e0596b-96fc-4c0b-9ee5-5cf1b2a3d4fb {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:45:38 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[409d7148-74f4-4e74-8773-daf4ea020b8a]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b95d21df-9162-4f2b-9995-1275f20a6202 tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919.f9e0596b-96fc-4c0b-9ee5-5cf1b2a3d4fb {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:38 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919.f9e0596b-96fc-4c0b-9ee5-5cf1b2a3d4fb Jul 11 04:45:38 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:38 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-79df160e-e725-4050-ae39-e477acc85d25 tempest-CinderUnicodeTest-1836980750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262" returned: 0 in 0.797s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-79df160e-e725-4050-ae39-e477acc85d25 tempest-CinderUnicodeTest-1836980750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262.801a054f-a27d-4c22-9ab8-3e416d85c781 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:38 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-915313f9-cfa6-47db-b767-9124a91e23c5 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-7fd8227a-c5af-4d9a-b245-689bd4e36773" returned: 0 in 0.730s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:38 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262.801a054f-a27d-4c22-9ab8-3e416d85c781 1G Jul 11 04:45:38 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:38 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-915313f9-cfa6-47db-b767-9124a91e23c5 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "cinder-quobyte-7fd8227a-c5af-4d9a-b245-689bd4e36773" released by "delete_volume" :: held 1.615s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:38 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-915313f9-cfa6-47db-b767-9124a91e23c5 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Created reservations ['3924c688-1f01-48b1-bd94-0cdfdf703740', '431e58ef-ae43-4737-8cba-91dd40dfdac1', '955872d5-4a12-4252-8de2-e61e78e456d8', 'cc57b837-be0b-4108-9cd7-293440fcea62'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:45:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-915313f9-cfa6-47db-b767-9124a91e23c5 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-915313f9-cfa6-47db-b767-9124a91e23c5 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:38 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-915313f9-cfa6-47db-b767-9124a91e23c5 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:45:38 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-915313f9-cfa6-47db-b767-9124a91e23c5 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:45:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-915313f9-cfa6-47db-b767-9124a91e23c5 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-915313f9-cfa6-47db-b767-9124a91e23c5 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:38 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:45:38 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:39 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b95d21df-9162-4f2b-9995-1275f20a6202 tempest-ProjectReaderTests-787132287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919.f9e0596b-96fc-4c0b-9ee5-5cf1b2a3d4fb" returned: 0 in 0.886s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:39 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-b95d21df-9162-4f2b-9995-1275f20a6202 tempest-ProjectReaderTests-787132287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-397586f0-3780-4ab8-af01-6603c3536919(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:45:39 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-2a6c9c97-388b-44e0-8186-501cc841572c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Acquiring lock "cinder-ef4912a8-7609-48b9-b3f1-4d9c969aa6fe-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:39 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd56713-120c-42da-8a77-162aeec0fe68]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b95d21df-9162-4f2b-9995-1275f20a6202 tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:39 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-2a6c9c97-388b-44e0-8186-501cc841572c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "cinder-ef4912a8-7609-48b9-b3f1-4d9c969aa6fe-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:39 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-2a6c9c97-388b-44e0-8186-501cc841572c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Acquiring lock "cinder-quobyte-ef4912a8-7609-48b9-b3f1-4d9c969aa6fe" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:39 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-2a6c9c97-388b-44e0-8186-501cc841572c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "cinder-quobyte-ef4912a8-7609-48b9-b3f1-4d9c969aa6fe" acquired by "delete_volume" :: waited 0.026s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:39 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[81962419-8d97-469d-84ed-a5625fe8747f]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2a6c9c97-388b-44e0-8186-501cc841572c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef4912a8-7609-48b9-b3f1-4d9c969aa6fe {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:39 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919 Jul 11 04:45:39 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:39 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef4912a8-7609-48b9-b3f1-4d9c969aa6fe Jul 11 04:45:39 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:39 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-915313f9-cfa6-47db-b767-9124a91e23c5 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.821s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:39 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-915313f9-cfa6-47db-b767-9124a91e23c5 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:45:39 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-915313f9-cfa6-47db-b767-9124a91e23c5 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Deleted volume successfully. Jul 11 04:45:39 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-915313f9-cfa6-47db-b767-9124a91e23c5 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "cinder-7fd8227a-c5af-4d9a-b245-689bd4e36773-delete_volume" released by "delete_volume" :: held 2.753s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:39 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-79df160e-e725-4050-ae39-e477acc85d25 tempest-CinderUnicodeTest-1836980750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262.801a054f-a27d-4c22-9ab8-3e416d85c781 1G" returned: 0 in 1.138s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-79df160e-e725-4050-ae39-e477acc85d25 tempest-CinderUnicodeTest-1836980750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262.801a054f-a27d-4c22-9ab8-3e416d85c781 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:39 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262.801a054f-a27d-4c22-9ab8-3e416d85c781 Jul 11 04:45:39 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:40 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b95d21df-9162-4f2b-9995-1275f20a6202 tempest-ProjectReaderTests-787132287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919" returned: 0 in 0.978s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b95d21df-9162-4f2b-9995-1275f20a6202 tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919.f9e0596b-96fc-4c0b-9ee5-5cf1b2a3d4fb {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:40 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919.f9e0596b-96fc-4c0b-9ee5-5cf1b2a3d4fb Jul 11 04:45:40 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:40 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2a6c9c97-388b-44e0-8186-501cc841572c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef4912a8-7609-48b9-b3f1-4d9c969aa6fe" returned: 0 in 0.985s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2a6c9c97-388b-44e0-8186-501cc841572c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef4912a8-7609-48b9-b3f1-4d9c969aa6fe {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:40 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef4912a8-7609-48b9-b3f1-4d9c969aa6fe Jul 11 04:45:40 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:40 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-79df160e-e725-4050-ae39-e477acc85d25 tempest-CinderUnicodeTest-1836980750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262.801a054f-a27d-4c22-9ab8-3e416d85c781" returned: 0 in 0.864s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:40 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-79df160e-e725-4050-ae39-e477acc85d25 tempest-CinderUnicodeTest-1836980750 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262.801a054f-a27d-4c22-9ab8-3e416d85c781 is being set with open permissions: ugo+rw Jul 11 04:45:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-79df160e-e725-4050-ae39-e477acc85d25 tempest-CinderUnicodeTest-1836980750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262.801a054f-a27d-4c22-9ab8-3e416d85c781 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:40 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262.801a054f-a27d-4c22-9ab8-3e416d85c781 Jul 11 04:45:40 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:41 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b95d21df-9162-4f2b-9995-1275f20a6202 tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919.f9e0596b-96fc-4c0b-9ee5-5cf1b2a3d4fb" returned: 0 in 0.803s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b95d21df-9162-4f2b-9995-1275f20a6202 tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919.f9e0596b-96fc-4c0b-9ee5-5cf1b2a3d4fb {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:41 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919.f9e0596b-96fc-4c0b-9ee5-5cf1b2a3d4fb Jul 11 04:45:41 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:41 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2a6c9c97-388b-44e0-8186-501cc841572c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ef4912a8-7609-48b9-b3f1-4d9c969aa6fe" returned: 0 in 0.792s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:41 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-2a6c9c97-388b-44e0-8186-501cc841572c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "cinder-quobyte-ef4912a8-7609-48b9-b3f1-4d9c969aa6fe" released by "delete_volume" :: held 1.839s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:41 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-2a6c9c97-388b-44e0-8186-501cc841572c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Created reservations ['7ac20ce5-c342-4a81-bbbf-276f80667fa5', 'f8231dce-8dc0-477f-82a3-372d132925a1', '70edf2c8-693b-4e76-adca-7da68670264b', 'ca34535e-5eea-493c-8794-383fc5a4fa1a'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:45:41 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-79df160e-e725-4050-ae39-e477acc85d25 tempest-CinderUnicodeTest-1836980750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262.801a054f-a27d-4c22-9ab8-3e416d85c781" returned: 0 in 0.774s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-79df160e-e725-4050-ae39-e477acc85d25 tempest-CinderUnicodeTest-1836980750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:41 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262.info Jul 11 04:45:41 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2a6c9c97-388b-44e0-8186-501cc841572c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2a6c9c97-388b-44e0-8186-501cc841572c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:41 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2a6c9c97-388b-44e0-8186-501cc841572c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:45:41 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2a6c9c97-388b-44e0-8186-501cc841572c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:45:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2a6c9c97-388b-44e0-8186-501cc841572c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2a6c9c97-388b-44e0-8186-501cc841572c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:41 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:45:41 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:45:41 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:41 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Flow 'volume_create_manager' (1eb250dc-8f82-457b-a8cc-55bfcb566248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:45:41 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f7789d6-b69d-4b75-acd6-5ec39e562305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:41 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-df54157f-cea2-4ce0-9436-c6372f518331 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Acquiring lock "cinder-424d5fd7-7189-428b-b5de-9cd253035a83-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:41 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f7789d6-b69d-4b75-acd6-5ec39e562305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d0e4e37-a25f-4f21-ad68-fd9df2364702,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc62bde7b9524bafa83c1f3f7232761d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:45:41Z,use_quota=True,user_id='4791473f2af54eca80d386f76f4b3860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:41 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b3d248-b985-4ceb-ab1e-bd972167866a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:41 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b3d248-b985-4ceb-ab1e-bd972167866a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:41 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16243554-6943-43fc-b325-7adfac328ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:41 devstack cinder-volume[86964]: DEBUG cinder.image.glance [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Creating Keystone auth plugin from conf {{(pid=86964) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 04:45:41 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-df54157f-cea2-4ce0-9436-c6372f518331 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "cinder-424d5fd7-7189-428b-b5de-9cd253035a83-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:41 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-df54157f-cea2-4ce0-9436-c6372f518331 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Acquiring lock "cinder-quobyte-424d5fd7-7189-428b-b5de-9cd253035a83" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:41 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-df54157f-cea2-4ce0-9436-c6372f518331 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "cinder-quobyte-424d5fd7-7189-428b-b5de-9cd253035a83" acquired by "delete_volume" :: waited 0.019s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:41 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cc35e0-59a0-4d01-8e40-413d760b580e]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-df54157f-cea2-4ce0-9436-c6372f518331 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-424d5fd7-7189-428b-b5de-9cd253035a83 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:41 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b95d21df-9162-4f2b-9995-1275f20a6202 tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919.f9e0596b-96fc-4c0b-9ee5-5cf1b2a3d4fb" returned: 0 in 0.845s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:41 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b95d21df-9162-4f2b-9995-1275f20a6202 tempest-ProjectReaderTests-787132287 None] Lock "cinder-quobyte-f9e0596b-96fc-4c0b-9ee5-5cf1b2a3d4fb" released by "_delete_snapshot" :: held 3.690s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:41 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-424d5fd7-7189-428b-b5de-9cd253035a83 Jul 11 04:45:41 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:42 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16243554-6943-43fc-b325-7adfac328ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5d0e4e37-a25f-4f21-ad68-fd9df2364702', 'volume_name': 'volume-5d0e4e37-a25f-4f21-ad68-fd9df2364702', 'volume_size': 1, 'image_id': '579bccf8-632b-419f-a6ea-28236c093e9f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/579bccf8-632b-419f-a6ea-28236c093e9f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6470639fe2bc6bf12e3c08ff5bc5cc76', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bc62bde7b9524bafa83c1f3f7232761d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fa87cf4d9a2d885ead9903c3223f5876a64e51b0339434958cd594f1ccb01aaf90828499126bca7e3c5c728320a52fa36416d6275e8ae8fd16e5a0243a3a1c5b', 'id': '579bccf8-632b-419f-a6ea-28236c093e9f', 'created_at': datetime.datetime(2026, 7, 11, 2, 45, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 45, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/579bccf8-632b-419f-a6ea-28236c093e9f/file', 'properties': {}}, 'image_service': }' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:42 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (794be27a-f006-409d-8f82-45d7b45e8ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:42 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (794be27a-f006-409d-8f82-45d7b45e8ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:42 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69c6833e-e1ad-4aac-b663-d05d663d5705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:42 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Volume 5d0e4e37-a25f-4f21-ad68-fd9df2364702: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5d0e4e37-a25f-4f21-ad68-fd9df2364702', 'volume_size': 1, 'image_id': '579bccf8-632b-419f-a6ea-28236c093e9f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/579bccf8-632b-419f-a6ea-28236c093e9f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6470639fe2bc6bf12e3c08ff5bc5cc76', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bc62bde7b9524bafa83c1f3f7232761d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fa87cf4d9a2d885ead9903c3223f5876a64e51b0339434958cd594f1ccb01aaf90828499126bca7e3c5c728320a52fa36416d6275e8ae8fd16e5a0243a3a1c5b', 'id': '579bccf8-632b-419f-a6ea-28236c093e9f', 'created_at': datetime.datetime(2026, 7, 11, 2, 45, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 45, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/579bccf8-632b-419f-a6ea-28236c093e9f/file', 'properties': {}}, 'image_service': } Jul 11 04:45:42 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Trying to clone 5d0e4e37-a25f-4f21-ad68-fd9df2364702 from image 579bccf8-632b-419f-a6ea-28236c093e9f at location (None, [{'url': 'file:///opt/stack/data/glance/images/579bccf8-632b-419f-a6ea-28236c093e9f', 'metadata': {}}]). {{(pid=86964) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 04:45:42 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b95d21df-9162-4f2b-9995-1275f20a6202 tempest-ProjectReaderTests-787132287 None] Lock "cinder-quobyte-397586f0-3780-4ab8-af01-6603c3536919" released by "delete_snapshot" :: held 3.770s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:42 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-b95d21df-9162-4f2b-9995-1275f20a6202 tempest-ProjectReaderTests-787132287 None] Created reservations ['4cd58a9b-87b1-48d9-9491-0e150aa3079b', '7b4a9788-fe70-4c56-82fe-c9fbaeff77bf', '9d45ca33-3d12-4d9a-ac34-8cea203d3cf2', '22dfeb6c-ef08-4ecd-99b2-9f8e341bfa4d'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:45:42 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_579bccf8-632b-419f-a6ea-28236c093e9f_ud858m0fdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86964) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 11 04:45:42 devstack cinder-volume[86964]: INFO cinder.image.image_utils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Image download 0.00 MB at 0.00 MB/s Jul 11 04:45:42 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-b95d21df-9162-4f2b-9995-1275f20a6202 tempest-ProjectReaderTests-787132287 None] Delete snapshot completed successfully. Jul 11 04:45:42 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b95d21df-9162-4f2b-9995-1275f20a6202 tempest-ProjectReaderTests-787132287 None] Lock "cinder-f9e0596b-96fc-4c0b-9ee5-5cf1b2a3d4fb-delete_snapshot" released by "delete_snapshot" :: held 3.983s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:42 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7b0dae-233a-4701-834f-1c2fefccb021]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_579bccf8-632b-419f-a6ea-28236c093e9f_ud858m0fdevstack@QuobyteHD {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:42 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2a6c9c97-388b-44e0-8186-501cc841572c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.839s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:42 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-2a6c9c97-388b-44e0-8186-501cc841572c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:45:42 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-2a6c9c97-388b-44e0-8186-501cc841572c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Deleted volume successfully. Jul 11 04:45:42 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_579bccf8-632b-419f-a6ea-28236c093e9f_ud858m0fdevstack@QuobyteHD Jul 11 04:45:42 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:42 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-79df160e-e725-4050-ae39-e477acc85d25 tempest-CinderUnicodeTest-1836980750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262.info" returned: 0 in 1.007s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:42 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-79df160e-e725-4050-ae39-e477acc85d25 tempest-CinderUnicodeTest-1836980750 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262.info is being set with open permissions: ugo+rw Jul 11 04:45:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-79df160e-e725-4050-ae39-e477acc85d25 tempest-CinderUnicodeTest-1836980750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:42 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-2a6c9c97-388b-44e0-8186-501cc841572c tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "cinder-ef4912a8-7609-48b9-b3f1-4d9c969aa6fe-delete_volume" released by "delete_volume" :: held 3.130s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:42 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262.info Jul 11 04:45:42 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:42 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-7e1034f4-4a68-4445-9e93-33e0a83b9fa9 tempest-ProjectReaderTests-787132287 None] Acquiring lock "cinder-397586f0-3780-4ab8-af01-6603c3536919-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:42 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-7e1034f4-4a68-4445-9e93-33e0a83b9fa9 tempest-ProjectReaderTests-787132287 None] Lock "cinder-397586f0-3780-4ab8-af01-6603c3536919-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:42 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-7e1034f4-4a68-4445-9e93-33e0a83b9fa9 tempest-ProjectReaderTests-787132287 None] Acquiring lock "cinder-quobyte-397586f0-3780-4ab8-af01-6603c3536919" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:42 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-7e1034f4-4a68-4445-9e93-33e0a83b9fa9 tempest-ProjectReaderTests-787132287 None] Lock "cinder-quobyte-397586f0-3780-4ab8-af01-6603c3536919" acquired by "delete_volume" :: waited 0.019s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:42 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[20393775-0aaf-44fa-8292-83ca604e3b91]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7e1034f4-4a68-4445-9e93-33e0a83b9fa9 tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:42 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919 Jul 11 04:45:42 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:42 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-df54157f-cea2-4ce0-9436-c6372f518331 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-424d5fd7-7189-428b-b5de-9cd253035a83" returned: 0 in 1.029s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-df54157f-cea2-4ce0-9436-c6372f518331 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-424d5fd7-7189-428b-b5de-9cd253035a83 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:42 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-424d5fd7-7189-428b-b5de-9cd253035a83 Jul 11 04:45:42 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:43 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_579bccf8-632b-419f-a6ea-28236c093e9f_ud858m0fdevstack@QuobyteHD" returned: 0 in 0.814s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_579bccf8-632b-419f-a6ea-28236c093e9f_ud858m0fdevstack@QuobyteHD {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:43 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-79df160e-e725-4050-ae39-e477acc85d25 tempest-CinderUnicodeTest-1836980750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262.info" returned: 0 in 0.733s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:43 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_579bccf8-632b-419f-a6ea-28236c093e9f_ud858m0fdevstack@QuobyteHD Jul 11 04:45:43 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-79df160e-e725-4050-ae39-e477acc85d25 tempest-CinderUnicodeTest-1836980750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.447s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:43 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-79df160e-e725-4050-ae39-e477acc85d25 tempest-CinderUnicodeTest-1836980750 None] Create snapshot completed successfully Jul 11 04:45:43 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4121ecf7-83c0-4481-accd-dbf8068464b3 tempest-CinderUnicodeTest-1836980750 None] Acquiring lock "cinder-801a054f-a27d-4c22-9ab8-3e416d85c781-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:43 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4121ecf7-83c0-4481-accd-dbf8068464b3 tempest-CinderUnicodeTest-1836980750 None] Lock "cinder-801a054f-a27d-4c22-9ab8-3e416d85c781-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:43 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4121ecf7-83c0-4481-accd-dbf8068464b3 tempest-CinderUnicodeTest-1836980750 None] Acquiring lock "cinder-quobyte-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:43 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4121ecf7-83c0-4481-accd-dbf8068464b3 tempest-CinderUnicodeTest-1836980750 None] Lock "cinder-quobyte-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:43 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4121ecf7-83c0-4481-accd-dbf8068464b3 tempest-CinderUnicodeTest-1836980750 None] Acquiring lock "cinder-quobyte-801a054f-a27d-4c22-9ab8-3e416d85c781" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:43 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4121ecf7-83c0-4481-accd-dbf8068464b3 tempest-CinderUnicodeTest-1836980750 None] Lock "cinder-quobyte-801a054f-a27d-4c22-9ab8-3e416d85c781" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:43 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-4121ecf7-83c0-4481-accd-dbf8068464b3 tempest-CinderUnicodeTest-1836980750 None] Deleting offline snapshot 801a054f-a27d-4c22-9ab8-3e416d85c781 of volume a3e8f0a1-c3db-49b9-a8eb-2c2747db1262 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:45:43 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-4121ecf7-83c0-4481-accd-dbf8068464b3 tempest-CinderUnicodeTest-1836980750 None] snapshot_file for this snap is: volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262.801a054f-a27d-4c22-9ab8-3e416d85c781 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:45:43 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7eed13-9a7f-494f-80be-a36d44dfd303]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4121ecf7-83c0-4481-accd-dbf8068464b3 tempest-CinderUnicodeTest-1836980750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262.801a054f-a27d-4c22-9ab8-3e416d85c781 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:43 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:43 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-df54157f-cea2-4ce0-9436-c6372f518331 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-424d5fd7-7189-428b-b5de-9cd253035a83" returned: 0 in 0.703s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:43 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-df54157f-cea2-4ce0-9436-c6372f518331 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "cinder-quobyte-424d5fd7-7189-428b-b5de-9cd253035a83" released by "delete_volume" :: held 1.789s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7e1034f4-4a68-4445-9e93-33e0a83b9fa9 tempest-ProjectReaderTests-787132287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919" returned: 0 in 0.898s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7e1034f4-4a68-4445-9e93-33e0a83b9fa9 tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:43 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919 Jul 11 04:45:43 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:43 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-df54157f-cea2-4ce0-9436-c6372f518331 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Created reservations ['119338be-30c0-449c-bb76-4efcb7b41843', 'a981cd29-8a71-4686-a038-323fddf3ecc9', '9ef16b72-2f64-4560-803e-a341fefb22de', '552573ca-4386-4fa2-a511-fd41785955d3'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:45:43 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262.801a054f-a27d-4c22-9ab8-3e416d85c781 Jul 11 04:45:43 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-df54157f-cea2-4ce0-9436-c6372f518331 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-df54157f-cea2-4ce0-9436-c6372f518331 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:43 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-df54157f-cea2-4ce0-9436-c6372f518331 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:45:43 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-df54157f-cea2-4ce0-9436-c6372f518331 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:45:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-df54157f-cea2-4ce0-9436-c6372f518331 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-df54157f-cea2-4ce0-9436-c6372f518331 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:43 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:45:43 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:43 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_579bccf8-632b-419f-a6ea-28236c093e9f_ud858m0fdevstack@QuobyteHD" returned: 1 in 0.896s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_579bccf8-632b-419f-a6ea-28236c093e9f_ud858m0fdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:45:43 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Temporary image 579bccf8-632b-419f-a6ea-28236c093e9f is fetched for user 4791473f2af54eca80d386f76f4b3860. {{(pid=86964) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 11 04:45:44 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdb61bc-172c-4708-850d-63a5799dcf0c]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_579bccf8-632b-419f-a6ea-28236c093e9f_ud858m0fdevstack@QuobyteHD {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:44 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_579bccf8-632b-419f-a6ea-28236c093e9f_ud858m0fdevstack@QuobyteHD Jul 11 04:45:44 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:44 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7e1034f4-4a68-4445-9e93-33e0a83b9fa9 tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-397586f0-3780-4ab8-af01-6603c3536919" returned: 0 in 0.862s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:44 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-7e1034f4-4a68-4445-9e93-33e0a83b9fa9 tempest-ProjectReaderTests-787132287 None] Lock "cinder-quobyte-397586f0-3780-4ab8-af01-6603c3536919" released by "delete_volume" :: held 1.850s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:44 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-7e1034f4-4a68-4445-9e93-33e0a83b9fa9 tempest-ProjectReaderTests-787132287 None] Created reservations ['654069e8-bf6b-4448-97b3-c7e18e22c74f', 'edcca57e-a0af-40f3-ba82-854863dd853a', 'ae7c6d7f-09fa-4159-b80f-a72467c2347d', 'd3f70ff4-8a63-4cc4-9f10-5371eb382458'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:45:44 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4121ecf7-83c0-4481-accd-dbf8068464b3 tempest-CinderUnicodeTest-1836980750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262.801a054f-a27d-4c22-9ab8-3e416d85c781" returned: 0 in 1.041s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:44 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-4121ecf7-83c0-4481-accd-dbf8068464b3 tempest-CinderUnicodeTest-1836980750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:45:44 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b2b505-1c06-4b6a-af4d-a7285d930396]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4121ecf7-83c0-4481-accd-dbf8068464b3 tempest-CinderUnicodeTest-1836980750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7e1034f4-4a68-4445-9e93-33e0a83b9fa9 tempest-ProjectReaderTests-787132287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7e1034f4-4a68-4445-9e93-33e0a83b9fa9 tempest-ProjectReaderTests-787132287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:44 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7e1034f4-4a68-4445-9e93-33e0a83b9fa9 tempest-ProjectReaderTests-787132287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:45:44 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7e1034f4-4a68-4445-9e93-33e0a83b9fa9 tempest-ProjectReaderTests-787132287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:45:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7e1034f4-4a68-4445-9e93-33e0a83b9fa9 tempest-ProjectReaderTests-787132287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7e1034f4-4a68-4445-9e93-33e0a83b9fa9 tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:44 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:44 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:45:44 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-df54157f-cea2-4ce0-9436-c6372f518331 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.975s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:44 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-df54157f-cea2-4ce0-9436-c6372f518331 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:45:44 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-df54157f-cea2-4ce0-9436-c6372f518331 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Deleted volume successfully. Jul 11 04:45:44 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-df54157f-cea2-4ce0-9436-c6372f518331 tempest-CreateVolumesFromSourceVolumeTest-247638403 None] Lock "cinder-424d5fd7-7189-428b-b5de-9cd253035a83-delete_volume" released by "delete_volume" :: held 3.041s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:44 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262 Jul 11 04:45:44 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:45 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_579bccf8-632b-419f-a6ea-28236c093e9f_ud858m0fdevstack@QuobyteHD" returned: 0 in 1.129s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_579bccf8-632b-419f-a6ea-28236c093e9f_ud858m0fdevstack@QuobyteHD {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:45 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_579bccf8-632b-419f-a6ea-28236c093e9f_ud858m0fdevstack@QuobyteHD Jul 11 04:45:45 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:45 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7e1034f4-4a68-4445-9e93-33e0a83b9fa9 tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.827s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:45 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-7e1034f4-4a68-4445-9e93-33e0a83b9fa9 tempest-ProjectReaderTests-787132287 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:45:45 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-7e1034f4-4a68-4445-9e93-33e0a83b9fa9 tempest-ProjectReaderTests-787132287 None] Deleted volume successfully. Jul 11 04:45:45 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-7e1034f4-4a68-4445-9e93-33e0a83b9fa9 tempest-ProjectReaderTests-787132287 None] Lock "cinder-397586f0-3780-4ab8-af01-6603c3536919-delete_volume" released by "delete_volume" :: held 3.011s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:45 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb7bed6c-ae43-4dfa-b544-d5d0ac6beca8 tempest-ProjectReaderTests-787132287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:45:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fb7bed6c-ae43-4dfa-b544-d5d0ac6beca8 tempest-ProjectReaderTests-787132287 None] Flow 'volume_create_manager' (a8a99bd2-fe7f-42aa-9e14-03f8e84918da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:45:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fb7bed6c-ae43-4dfa-b544-d5d0ac6beca8 tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6011ef19-f81a-4152-adbe-77a76c37c18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fb7bed6c-ae43-4dfa-b544-d5d0ac6beca8 tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6011ef19-f81a-4152-adbe-77a76c37c18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-323431044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4adc9e22-ca46-44c9-a83f-6b2cbb834f2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36dcca031e5d4245aed8aadd7b6f88e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:45:46Z,use_quota=True,user_id='ee6e4107301b44a98a0fdd41aead55f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fb7bed6c-ae43-4dfa-b544-d5d0ac6beca8 tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73454e77-8cc9-46c1-aac2-f168a17bf6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fb7bed6c-ae43-4dfa-b544-d5d0ac6beca8 tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73454e77-8cc9-46c1-aac2-f168a17bf6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fb7bed6c-ae43-4dfa-b544-d5d0ac6beca8 tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b7c0d90-d047-4c91-9d43-def9c5245435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fb7bed6c-ae43-4dfa-b544-d5d0ac6beca8 tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b7c0d90-d047-4c91-9d43-def9c5245435) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4adc9e22-ca46-44c9-a83f-6b2cbb834f2a', 'volume_name': 'volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fb7bed6c-ae43-4dfa-b544-d5d0ac6beca8 tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318d1a05-4ef1-4cfb-b3ca-534927f43e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fb7bed6c-ae43-4dfa-b544-d5d0ac6beca8 tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318d1a05-4ef1-4cfb-b3ca-534927f43e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fb7bed6c-ae43-4dfa-b544-d5d0ac6beca8 tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (113cf15d-bcbc-4f6c-8b83-74c7eb02f38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:45 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-fb7bed6c-ae43-4dfa-b544-d5d0ac6beca8 tempest-ProjectReaderTests-787132287 None] Volume 4adc9e22-ca46-44c9-a83f-6b2cbb834f2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a', 'volume_size': 1} Jul 11 04:45:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fb7bed6c-ae43-4dfa-b544-d5d0ac6beca8 tempest-ProjectReaderTests-787132287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fb7bed6c-ae43-4dfa-b544-d5d0ac6beca8 tempest-ProjectReaderTests-787132287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-fb7bed6c-ae43-4dfa-b544-d5d0ac6beca8 tempest-ProjectReaderTests-787132287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-323431044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4adc9e22-ca46-44c9-a83f-6b2cbb834f2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36dcca031e5d4245aed8aadd7b6f88e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:45:46Z,use_quota=True,user_id='ee6e4107301b44a98a0fdd41aead55f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:45:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-fb7bed6c-ae43-4dfa-b544-d5d0ac6beca8 tempest-ProjectReaderTests-787132287 None] Creating volume 4adc9e22-ca46-44c9-a83f-6b2cbb834f2a {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:45:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fb7bed6c-ae43-4dfa-b544-d5d0ac6beca8 tempest-ProjectReaderTests-787132287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fb7bed6c-ae43-4dfa-b544-d5d0ac6beca8 tempest-ProjectReaderTests-787132287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-fb7bed6c-ae43-4dfa-b544-d5d0ac6beca8 tempest-ProjectReaderTests-787132287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:45:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-fb7bed6c-ae43-4dfa-b544-d5d0ac6beca8 tempest-ProjectReaderTests-787132287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:45:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fb7bed6c-ae43-4dfa-b544-d5d0ac6beca8 tempest-ProjectReaderTests-787132287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-fb7bed6c-ae43-4dfa-b544-d5d0ac6beca8 tempest-ProjectReaderTests-787132287 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:45:45 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-fb7bed6c-ae43-4dfa-b544-d5d0ac6beca8 tempest-ProjectReaderTests-787132287 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:45:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb7bed6c-ae43-4dfa-b544-d5d0ac6beca8 tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:45 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a 1073741824 Jul 11 04:45:45 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:45 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4121ecf7-83c0-4481-accd-dbf8068464b3 tempest-CinderUnicodeTest-1836980750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262" returned: 0 in 1.311s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4121ecf7-83c0-4481-accd-dbf8068464b3 tempest-CinderUnicodeTest-1836980750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262.801a054f-a27d-4c22-9ab8-3e416d85c781 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:45 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262.801a054f-a27d-4c22-9ab8-3e416d85c781 Jul 11 04:45:45 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:46 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_579bccf8-632b-419f-a6ea-28236c093e9f_ud858m0fdevstack@QuobyteHD" returned: 1 in 0.895s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_579bccf8-632b-419f-a6ea-28236c093e9f_ud858m0fdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:45:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:46 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4121ecf7-83c0-4481-accd-dbf8068464b3 tempest-CinderUnicodeTest-1836980750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262.801a054f-a27d-4c22-9ab8-3e416d85c781" returned: 0 in 0.796s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4121ecf7-83c0-4481-accd-dbf8068464b3 tempest-CinderUnicodeTest-1836980750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262.801a054f-a27d-4c22-9ab8-3e416d85c781 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:46 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262.801a054f-a27d-4c22-9ab8-3e416d85c781 Jul 11 04:45:46 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:46 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb7bed6c-ae43-4dfa-b544-d5d0ac6beca8 tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a 1073741824" returned: 0 in 0.931s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb7bed6c-ae43-4dfa-b544-d5d0ac6beca8 tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:46 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a Jul 11 04:45:46 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:47 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4121ecf7-83c0-4481-accd-dbf8068464b3 tempest-CinderUnicodeTest-1836980750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262.801a054f-a27d-4c22-9ab8-3e416d85c781" returned: 0 in 0.696s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:47 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4121ecf7-83c0-4481-accd-dbf8068464b3 tempest-CinderUnicodeTest-1836980750 None] Lock "cinder-quobyte-801a054f-a27d-4c22-9ab8-3e416d85c781" released by "_delete_snapshot" :: held 4.025s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:47 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4121ecf7-83c0-4481-accd-dbf8068464b3 tempest-CinderUnicodeTest-1836980750 None] Lock "cinder-quobyte-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262" released by "delete_snapshot" :: held 4.062s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:47 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-fb7bed6c-ae43-4dfa-b544-d5d0ac6beca8 tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a" returned: 0 in 0.664s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:47 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-fb7bed6c-ae43-4dfa-b544-d5d0ac6beca8 tempest-ProjectReaderTests-787132287 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:45:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-fb7bed6c-ae43-4dfa-b544-d5d0ac6beca8 tempest-ProjectReaderTests-787132287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.381s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:47 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d0e4e37-a25f-4f21-ad68-fd9df2364702,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc62bde7b9524bafa83c1f3f7232761d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:45:41Z,use_quota=True,user_id='4791473f2af54eca80d386f76f4b3860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:45:47 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Creating volume 5d0e4e37-a25f-4f21-ad68-fd9df2364702 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:45:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:47 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:45:47 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:45:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:47 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:45:47 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:45:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d0e4e37-a25f-4f21-ad68-fd9df2364702 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:47 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fb7bed6c-ae43-4dfa-b544-d5d0ac6beca8 tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (113cf15d-bcbc-4f6c-8b83-74c7eb02f38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:47 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d0e4e37-a25f-4f21-ad68-fd9df2364702 1073741824 Jul 11 04:45:47 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:47 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fb7bed6c-ae43-4dfa-b544-d5d0ac6beca8 tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (684ce737-a423-4a70-8bcc-3af16a767036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:47 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-fb7bed6c-ae43-4dfa-b544-d5d0ac6beca8 tempest-ProjectReaderTests-787132287 None] Volume volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a (4adc9e22-ca46-44c9-a83f-6b2cbb834f2a): created successfully Jul 11 04:45:47 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fb7bed6c-ae43-4dfa-b544-d5d0ac6beca8 tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (684ce737-a423-4a70-8bcc-3af16a767036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:47 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-fb7bed6c-ae43-4dfa-b544-d5d0ac6beca8 tempest-ProjectReaderTests-787132287 None] Flow 'volume_create_manager' (a8a99bd2-fe7f-42aa-9e14-03f8e84918da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:45:47 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5ae9d86-4c71-49b0-95e4-dc79f969c587 tempest-VolumeDependencyTests-1722146605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:45:47 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a5ae9d86-4c71-49b0-95e4-dc79f969c587 tempest-VolumeDependencyTests-1722146605 None] Flow 'volume_create_manager' (5e9d63ef-7741-4505-bbd5-95aafa273fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:45:47 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a5ae9d86-4c71-49b0-95e4-dc79f969c587 tempest-VolumeDependencyTests-1722146605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9632deb-5a43-4df4-ac1e-d0bd639ae1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:47 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-fb7bed6c-ae43-4dfa-b544-d5d0ac6beca8 tempest-ProjectReaderTests-787132287 None] Created volume successfully. Jul 11 04:45:47 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a5ae9d86-4c71-49b0-95e4-dc79f969c587 tempest-VolumeDependencyTests-1722146605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9632deb-5a43-4df4-ac1e-d0bd639ae1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-815275018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='366b0576e5974d158f7ea8ad9b6cc8f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:45:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:45:48Z,use_quota=True,user_id='4906b9b7299042d9b59db8c4bbae11f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:47 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a5ae9d86-4c71-49b0-95e4-dc79f969c587 tempest-VolumeDependencyTests-1722146605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40c3f729-f1f6-41bb-83ce-413b570e437c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:47 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a5ae9d86-4c71-49b0-95e4-dc79f969c587 tempest-VolumeDependencyTests-1722146605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40c3f729-f1f6-41bb-83ce-413b570e437c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:47 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a5ae9d86-4c71-49b0-95e4-dc79f969c587 tempest-VolumeDependencyTests-1722146605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b076d1ec-a45d-40fe-8dba-47b80c1e9f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:47 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a5ae9d86-4c71-49b0-95e4-dc79f969c587 tempest-VolumeDependencyTests-1722146605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b076d1ec-a45d-40fe-8dba-47b80c1e9f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d', 'volume_name': 'volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:47 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a5ae9d86-4c71-49b0-95e4-dc79f969c587 tempest-VolumeDependencyTests-1722146605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e25182a6-0d89-4384-a783-b1ea52725b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:47 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a5ae9d86-4c71-49b0-95e4-dc79f969c587 tempest-VolumeDependencyTests-1722146605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e25182a6-0d89-4384-a783-b1ea52725b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:47 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a5ae9d86-4c71-49b0-95e4-dc79f969c587 tempest-VolumeDependencyTests-1722146605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d06c2b81-6b4c-4302-b5da-0e73fc9258eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:47 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-a5ae9d86-4c71-49b0-95e4-dc79f969c587 tempest-VolumeDependencyTests-1722146605 None] Volume 6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d', 'volume_size': 1} Jul 11 04:45:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a5ae9d86-4c71-49b0-95e4-dc79f969c587 tempest-VolumeDependencyTests-1722146605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:47 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-4121ecf7-83c0-4481-accd-dbf8068464b3 tempest-CinderUnicodeTest-1836980750 None] Created reservations ['3e314dfc-48e0-4a07-b328-14f694a3b7e9', 'bec38468-7a3e-4053-9ab3-24423382827f', 'bdd3e93d-68d2-4df2-b4db-dc264b871294', '275d5ec0-b228-41f9-afc9-48f710a34edd'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:45:47 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-4121ecf7-83c0-4481-accd-dbf8068464b3 tempest-CinderUnicodeTest-1836980750 None] Delete snapshot completed successfully. Jul 11 04:45:47 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-4121ecf7-83c0-4481-accd-dbf8068464b3 tempest-CinderUnicodeTest-1836980750 None] Lock "cinder-801a054f-a27d-4c22-9ab8-3e416d85c781-delete_snapshot" released by "delete_snapshot" :: held 4.380s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:48 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d0e4e37-a25f-4f21-ad68-fd9df2364702 1073741824" returned: 0 in 0.843s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d0e4e37-a25f-4f21-ad68-fd9df2364702 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:48 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d0e4e37-a25f-4f21-ad68-fd9df2364702 Jul 11 04:45:48 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:48 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-9d90f5ec-1769-4d27-b4e2-c7b8694bd342 tempest-CinderUnicodeTest-1836980750 None] Acquiring lock "cinder-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:48 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-9d90f5ec-1769-4d27-b4e2-c7b8694bd342 tempest-CinderUnicodeTest-1836980750 None] Lock "cinder-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:48 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-9d90f5ec-1769-4d27-b4e2-c7b8694bd342 tempest-CinderUnicodeTest-1836980750 None] Acquiring lock "cinder-quobyte-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:48 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-9d90f5ec-1769-4d27-b4e2-c7b8694bd342 tempest-CinderUnicodeTest-1836980750 None] Lock "cinder-quobyte-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262" acquired by "delete_volume" :: waited 0.022s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:48 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1ddc28-3451-4464-96ef-68ecf58d9fde]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9d90f5ec-1769-4d27-b4e2-c7b8694bd342 tempest-CinderUnicodeTest-1836980750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-be3770fb-0a46-4d4d-bec1-f95f037899fd tempest-ProjectReaderTests-787132287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:49 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262 Jul 11 04:45:49 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:49 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d0e4e37-a25f-4f21-ad68-fd9df2364702" returned: 0 in 0.677s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:45:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a5ae9d86-4c71-49b0-95e4-dc79f969c587 tempest-VolumeDependencyTests-1722146605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.371s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-a5ae9d86-4c71-49b0-95e4-dc79f969c587 tempest-VolumeDependencyTests-1722146605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-815275018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='366b0576e5974d158f7ea8ad9b6cc8f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:45:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:45:48Z,use_quota=True,user_id='4906b9b7299042d9b59db8c4bbae11f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:45:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-a5ae9d86-4c71-49b0-95e4-dc79f969c587 tempest-VolumeDependencyTests-1722146605 None] Creating volume 6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:45:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a5ae9d86-4c71-49b0-95e4-dc79f969c587 tempest-VolumeDependencyTests-1722146605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a5ae9d86-4c71-49b0-95e4-dc79f969c587 tempest-VolumeDependencyTests-1722146605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-a5ae9d86-4c71-49b0-95e4-dc79f969c587 tempest-VolumeDependencyTests-1722146605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:45:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-a5ae9d86-4c71-49b0-95e4-dc79f969c587 tempest-VolumeDependencyTests-1722146605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:45:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a5ae9d86-4c71-49b0-95e4-dc79f969c587 tempest-VolumeDependencyTests-1722146605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-a5ae9d86-4c71-49b0-95e4-dc79f969c587 tempest-VolumeDependencyTests-1722146605 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:45:49 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-a5ae9d86-4c71-49b0-95e4-dc79f969c587 tempest-VolumeDependencyTests-1722146605 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:45:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a5ae9d86-4c71-49b0-95e4-dc79f969c587 tempest-VolumeDependencyTests-1722146605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:49 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d 1073741824 Jul 11 04:45:49 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:49 devstack cinder-volume[86964]: DEBUG cinder.volume.volume_utils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Attempting download of 579bccf8-632b-419f-a6ea-28236c093e9f ((None, [{'url': 'file:///opt/stack/data/glance/images/579bccf8-632b-419f-a6ea-28236c093e9f', 'metadata': {}}])) to volume 5d0e4e37-a25f-4f21-ad68-fd9df2364702. {{(pid=86964) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 04:45:49 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d71df4-3689-4b34-90af-766b6929df0a]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_579bccf8-632b-419f-a6ea-28236c093e9f_gh52_g7t {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:49 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_579bccf8-632b-419f-a6ea-28236c093e9f_gh52_g7t Jul 11 04:45:49 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:49 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9d90f5ec-1769-4d27-b4e2-c7b8694bd342 tempest-CinderUnicodeTest-1836980750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262" returned: 0 in 0.831s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9d90f5ec-1769-4d27-b4e2-c7b8694bd342 tempest-CinderUnicodeTest-1836980750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:49 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262 Jul 11 04:45:49 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:49 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_579bccf8-632b-419f-a6ea-28236c093e9f_gh52_g7t" returned: 0 in 0.805s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_579bccf8-632b-419f-a6ea-28236c093e9f_gh52_g7t {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:50 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a5ae9d86-4c71-49b0-95e4-dc79f969c587 tempest-VolumeDependencyTests-1722146605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d 1073741824" returned: 0 in 0.913s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a5ae9d86-4c71-49b0-95e4-dc79f969c587 tempest-VolumeDependencyTests-1722146605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:50 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d Jul 11 04:45:50 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:50 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_579bccf8-632b-419f-a6ea-28236c093e9f_gh52_g7t Jul 11 04:45:50 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:50 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9d90f5ec-1769-4d27-b4e2-c7b8694bd342 tempest-CinderUnicodeTest-1836980750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262" returned: 0 in 0.696s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-9d90f5ec-1769-4d27-b4e2-c7b8694bd342 tempest-CinderUnicodeTest-1836980750 None] Lock "cinder-quobyte-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262" released by "delete_volume" :: held 1.596s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:50 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-9d90f5ec-1769-4d27-b4e2-c7b8694bd342 tempest-CinderUnicodeTest-1836980750 None] Created reservations ['b855e001-bfa6-4609-b631-683648a39389', 'c5d20386-5754-4055-a5c2-054d503ed1bb', '71672cf5-cc97-4494-8669-7d10d56fe8cb', '264c9a3d-f0ae-4def-8d4e-ed068b6553c1'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:45:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9d90f5ec-1769-4d27-b4e2-c7b8694bd342 tempest-CinderUnicodeTest-1836980750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9d90f5ec-1769-4d27-b4e2-c7b8694bd342 tempest-CinderUnicodeTest-1836980750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:50 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-9d90f5ec-1769-4d27-b4e2-c7b8694bd342 tempest-CinderUnicodeTest-1836980750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:45:50 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-9d90f5ec-1769-4d27-b4e2-c7b8694bd342 tempest-CinderUnicodeTest-1836980750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:45:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9d90f5ec-1769-4d27-b4e2-c7b8694bd342 tempest-CinderUnicodeTest-1836980750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9d90f5ec-1769-4d27-b4e2-c7b8694bd342 tempest-CinderUnicodeTest-1836980750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:50 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:45:50 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:50 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_579bccf8-632b-419f-a6ea-28236c093e9f_gh52_g7t" returned: 1 in 0.741s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_579bccf8-632b-419f-a6ea-28236c093e9f_gh52_g7t' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:45:50 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[380bae33-1177-4323-92bd-92800d810c85]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_579bccf8-632b-419f-a6ea-28236c093e9f_ud858m0fdevstack@QuobyteHD {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:50 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a5ae9d86-4c71-49b0-95e4-dc79f969c587 tempest-VolumeDependencyTests-1722146605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d" returned: 0 in 0.706s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:50 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-a5ae9d86-4c71-49b0-95e4-dc79f969c587 tempest-VolumeDependencyTests-1722146605 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:45:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a5ae9d86-4c71-49b0-95e4-dc79f969c587 tempest-VolumeDependencyTests-1722146605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.671s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-be3770fb-0a46-4d4d-bec1-f95f037899fd tempest-ProjectReaderTests-787132287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.782s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:50 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a5ae9d86-4c71-49b0-95e4-dc79f969c587 tempest-VolumeDependencyTests-1722146605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d06c2b81-6b4c-4302-b5da-0e73fc9258eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:50 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a5ae9d86-4c71-49b0-95e4-dc79f969c587 tempest-VolumeDependencyTests-1722146605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c7a6d5e-ebda-40b4-8ec3-b60d260ff7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:50 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-be3770fb-0a46-4d4d-bec1-f95f037899fd tempest-ProjectReaderTests-787132287 None] Creating offline snapshot 5d780c7b-5436-4871-b56d-463352c426a5 of volume 4adc9e22-ca46-44c9-a83f-6b2cbb834f2a {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:45:50 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-a5ae9d86-4c71-49b0-95e4-dc79f969c587 tempest-VolumeDependencyTests-1722146605 None] Volume volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d (6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d): created successfully Jul 11 04:45:50 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a5ae9d86-4c71-49b0-95e4-dc79f969c587 tempest-VolumeDependencyTests-1722146605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c7a6d5e-ebda-40b4-8ec3-b60d260ff7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:50 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a5ae9d86-4c71-49b0-95e4-dc79f969c587 tempest-VolumeDependencyTests-1722146605 None] Flow 'volume_create_manager' (5e9d63ef-7741-4505-bbd5-95aafa273fb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:45:50 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc865d9-4908-4880-8151-242223062504]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-be3770fb-0a46-4d4d-bec1-f95f037899fd tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:50 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-a5ae9d86-4c71-49b0-95e4-dc79f969c587 tempest-VolumeDependencyTests-1722146605 None] Created volume successfully. Jul 11 04:45:50 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_579bccf8-632b-419f-a6ea-28236c093e9f_ud858m0fdevstack@QuobyteHD Jul 11 04:45:50 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-82d67af6-1239-4d30-8c09-2f1fb848d249 tempest-CinderUnicodeTest-1836980750 None] Acquiring lock "cinder-d6b9caf8-408c-45d6-be96-620ab93337cc-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:50 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a Jul 11 04:45:50 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-82d67af6-1239-4d30-8c09-2f1fb848d249 tempest-CinderUnicodeTest-1836980750 None] Lock "cinder-d6b9caf8-408c-45d6-be96-620ab93337cc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-82d67af6-1239-4d30-8c09-2f1fb848d249 tempest-CinderUnicodeTest-1836980750 None] Acquiring lock "cinder-quobyte-d6b9caf8-408c-45d6-be96-620ab93337cc" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-82d67af6-1239-4d30-8c09-2f1fb848d249 tempest-CinderUnicodeTest-1836980750 None] Lock "cinder-quobyte-d6b9caf8-408c-45d6-be96-620ab93337cc" acquired by "delete_volume" :: waited 0.026s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:51 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f564c2-c591-4bcb-bd3b-a77a387e6640]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-82d67af6-1239-4d30-8c09-2f1fb848d249 tempest-CinderUnicodeTest-1836980750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d6b9caf8-408c-45d6-be96-620ab93337cc {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:51 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d6b9caf8-408c-45d6-be96-620ab93337cc Jul 11 04:45:51 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:51 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9d90f5ec-1769-4d27-b4e2-c7b8694bd342 tempest-CinderUnicodeTest-1836980750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.740s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:51 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-9d90f5ec-1769-4d27-b4e2-c7b8694bd342 tempest-CinderUnicodeTest-1836980750 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:45:51 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-9d90f5ec-1769-4d27-b4e2-c7b8694bd342 tempest-CinderUnicodeTest-1836980750 None] Deleted volume successfully. Jul 11 04:45:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-9d90f5ec-1769-4d27-b4e2-c7b8694bd342 tempest-CinderUnicodeTest-1836980750 None] Lock "cinder-a3e8f0a1-c3db-49b9-a8eb-2c2747db1262-delete_volume" released by "delete_volume" :: held 2.556s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:51 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_579bccf8-632b-419f-a6ea-28236c093e9f_ud858m0fdevstack@QuobyteHD" returned: 0 in 0.874s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_579bccf8-632b-419f-a6ea-28236c093e9f_ud858m0fdevstack@QuobyteHD {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:51 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-be3770fb-0a46-4d4d-bec1-f95f037899fd tempest-ProjectReaderTests-787132287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a" returned: 0 in 0.891s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-be3770fb-0a46-4d4d-bec1-f95f037899fd tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a.5d780c7b-5436-4871-b56d-463352c426a5 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:51 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_579bccf8-632b-419f-a6ea-28236c093e9f_ud858m0fdevstack@QuobyteHD Jul 11 04:45:51 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:51 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a.5d780c7b-5436-4871-b56d-463352c426a5 1G Jul 11 04:45:51 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:52 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-82d67af6-1239-4d30-8c09-2f1fb848d249 tempest-CinderUnicodeTest-1836980750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d6b9caf8-408c-45d6-be96-620ab93337cc" returned: 0 in 0.890s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-82d67af6-1239-4d30-8c09-2f1fb848d249 tempest-CinderUnicodeTest-1836980750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d6b9caf8-408c-45d6-be96-620ab93337cc {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-cfb62c10-232c-4632-9ad9-eb41bdc96d81 tempest-VolumeDependencyTests-1722146605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:52 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d6b9caf8-408c-45d6-be96-620ab93337cc Jul 11 04:45:52 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:52 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_579bccf8-632b-419f-a6ea-28236c093e9f_ud858m0fdevstack@QuobyteHD" returned: 1 in 0.855s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_579bccf8-632b-419f-a6ea-28236c093e9f_ud858m0fdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:45:52 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] 579bccf8-632b-419f-a6ea-28236c093e9f was raw, converting to raw {{(pid=86964) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 11 04:45:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_579bccf8-632b-419f-a6ea-28236c093e9f_ud858m0fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d0e4e37-a25f-4f21-ad68-fd9df2364702 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:52 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_579bccf8-632b-419f-a6ea-28236c093e9f_ud858m0fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d0e4e37-a25f-4f21-ad68-fd9df2364702 Jul 11 04:45:52 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:52 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-be3770fb-0a46-4d4d-bec1-f95f037899fd tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a.5d780c7b-5436-4871-b56d-463352c426a5 1G" returned: 0 in 0.886s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-be3770fb-0a46-4d4d-bec1-f95f037899fd tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a.5d780c7b-5436-4871-b56d-463352c426a5 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:52 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a.5d780c7b-5436-4871-b56d-463352c426a5 Jul 11 04:45:52 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:52 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-82d67af6-1239-4d30-8c09-2f1fb848d249 tempest-CinderUnicodeTest-1836980750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d6b9caf8-408c-45d6-be96-620ab93337cc" returned: 0 in 0.701s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:52 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-82d67af6-1239-4d30-8c09-2f1fb848d249 tempest-CinderUnicodeTest-1836980750 None] Lock "cinder-quobyte-d6b9caf8-408c-45d6-be96-620ab93337cc" released by "delete_volume" :: held 1.654s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:52 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-82d67af6-1239-4d30-8c09-2f1fb848d249 tempest-CinderUnicodeTest-1836980750 None] Created reservations ['6469b2a5-cd25-44ce-9af9-15bd82767bf0', '35a195f8-a9f1-48c8-bf99-d727977161ec', '5c3390e2-a348-41fe-98c1-593cc41449fc', 'f12fbdfd-444c-4227-81ce-ad4c6d140b5b'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:45:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-82d67af6-1239-4d30-8c09-2f1fb848d249 tempest-CinderUnicodeTest-1836980750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-82d67af6-1239-4d30-8c09-2f1fb848d249 tempest-CinderUnicodeTest-1836980750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:52 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-82d67af6-1239-4d30-8c09-2f1fb848d249 tempest-CinderUnicodeTest-1836980750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:45:52 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-82d67af6-1239-4d30-8c09-2f1fb848d249 tempest-CinderUnicodeTest-1836980750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:45:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-82d67af6-1239-4d30-8c09-2f1fb848d249 tempest-CinderUnicodeTest-1836980750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-82d67af6-1239-4d30-8c09-2f1fb848d249 tempest-CinderUnicodeTest-1836980750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:52 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:45:52 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:53 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_579bccf8-632b-419f-a6ea-28236c093e9f_ud858m0fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d0e4e37-a25f-4f21-ad68-fd9df2364702" returned: 0 in 0.827s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:53 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_579bccf8-632b-419f-a6ea-28236c093e9f_ud858m0fdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d0e4e37-a25f-4f21-ad68-fd9df2364702 {{(pid=86964) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 04:45:53 devstack cinder-volume[86964]: INFO cinder.image.image_utils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Converted 0.00 MB image at 0.00 MB/s Jul 11 04:45:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d0e4e37-a25f-4f21-ad68-fd9df2364702 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:53 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d0e4e37-a25f-4f21-ad68-fd9df2364702 1G Jul 11 04:45:53 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:53 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-be3770fb-0a46-4d4d-bec1-f95f037899fd tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a.5d780c7b-5436-4871-b56d-463352c426a5" returned: 0 in 0.838s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:53 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-be3770fb-0a46-4d4d-bec1-f95f037899fd tempest-ProjectReaderTests-787132287 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a.5d780c7b-5436-4871-b56d-463352c426a5 is being set with open permissions: ugo+rw Jul 11 04:45:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-be3770fb-0a46-4d4d-bec1-f95f037899fd tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a.5d780c7b-5436-4871-b56d-463352c426a5 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:53 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a.5d780c7b-5436-4871-b56d-463352c426a5 Jul 11 04:45:53 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:53 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-82d67af6-1239-4d30-8c09-2f1fb848d249 tempest-CinderUnicodeTest-1836980750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.825s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:53 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-82d67af6-1239-4d30-8c09-2f1fb848d249 tempest-CinderUnicodeTest-1836980750 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:45:53 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-82d67af6-1239-4d30-8c09-2f1fb848d249 tempest-CinderUnicodeTest-1836980750 None] Deleted volume successfully. Jul 11 04:45:53 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-82d67af6-1239-4d30-8c09-2f1fb848d249 tempest-CinderUnicodeTest-1836980750 None] Lock "cinder-d6b9caf8-408c-45d6-be96-620ab93337cc-delete_volume" released by "delete_volume" :: held 2.735s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:54 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d0e4e37-a25f-4f21-ad68-fd9df2364702 1G" returned: 0 in 0.805s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:54 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8670cbe-54ae-444c-81b5-2fd3e3c8e1e4]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d0e4e37-a25f-4f21-ad68-fd9df2364702 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:54 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-be3770fb-0a46-4d4d-bec1-f95f037899fd tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a.5d780c7b-5436-4871-b56d-463352c426a5" returned: 0 in 0.744s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-be3770fb-0a46-4d4d-bec1-f95f037899fd tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:54 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a.info Jul 11 04:45:54 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:54 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d0e4e37-a25f-4f21-ad68-fd9df2364702 Jul 11 04:45:54 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:54 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d0e4e37-a25f-4f21-ad68-fd9df2364702" returned: 0 in 0.779s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d0e4e37-a25f-4f21-ad68-fd9df2364702 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:54 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-be3770fb-0a46-4d4d-bec1-f95f037899fd tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a.info" returned: 0 in 0.726s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:54 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-be3770fb-0a46-4d4d-bec1-f95f037899fd tempest-ProjectReaderTests-787132287 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a.info is being set with open permissions: ugo+rw Jul 11 04:45:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-be3770fb-0a46-4d4d-bec1-f95f037899fd tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:54 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a.info Jul 11 04:45:54 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:55 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d0e4e37-a25f-4f21-ad68-fd9df2364702 Jul 11 04:45:55 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:55 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-be3770fb-0a46-4d4d-bec1-f95f037899fd tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a.info" returned: 0 in 0.701s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-be3770fb-0a46-4d4d-bec1-f95f037899fd tempest-ProjectReaderTests-787132287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.915s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-cfb62c10-232c-4632-9ad9-eb41bdc96d81 tempest-VolumeDependencyTests-1722146605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.631s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:55 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-cfb62c10-232c-4632-9ad9-eb41bdc96d81 tempest-VolumeDependencyTests-1722146605 None] Creating offline snapshot 8fc9e979-a1cc-43dc-93d8-a7ba6fa77236 of volume 6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:45:55 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-be3770fb-0a46-4d4d-bec1-f95f037899fd tempest-ProjectReaderTests-787132287 None] Create snapshot completed successfully Jul 11 04:45:55 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fa81b5-e8da-430c-b0f4-1f80a9716cdb]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cfb62c10-232c-4632-9ad9-eb41bdc96d81 tempest-VolumeDependencyTests-1722146605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:55 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d0e4e37-a25f-4f21-ad68-fd9df2364702" returned: 1 in 0.809s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d0e4e37-a25f-4f21-ad68-fd9df2364702' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:45:55 devstack cinder-volume[86964]: DEBUG cinder.volume.volume_utils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Downloaded image 579bccf8-632b-419f-a6ea-28236c093e9f ((None, [{'url': 'file:///opt/stack/data/glance/images/579bccf8-632b-419f-a6ea-28236c093e9f', 'metadata': {}}])) to volume 5d0e4e37-a25f-4f21-ad68-fd9df2364702 successfully. {{(pid=86964) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 04:45:55 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Temporary image 579bccf8-632b-419f-a6ea-28236c093e9f for user 4791473f2af54eca80d386f76f4b3860 is deleted. {{(pid=86964) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 11 04:45:55 devstack cinder-volume[86964]: DEBUG cinder.volume.volume_utils [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Marking volume 5d0e4e37-a25f-4f21-ad68-fd9df2364702 as bootable. {{(pid=86964) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 04:45:55 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Copying metadata from image 579bccf8-632b-419f-a6ea-28236c093e9f to 5d0e4e37-a25f-4f21-ad68-fd9df2364702. {{(pid=86964) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 04:45:55 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Creating volume glance metadata for volume 5d0e4e37-a25f-4f21-ad68-fd9df2364702 backed by image 579bccf8-632b-419f-a6ea-28236c093e9f with: {'image_id': '579bccf8-632b-419f-a6ea-28236c093e9f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '6470639fe2bc6bf12e3c08ff5bc5cc76', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86964) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 04:45:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69c6833e-e1ad-4aac-b663-d05d663d5705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d0e4e37-a25f-4f21-ad68-fd9df2364702', 'volume_size': 1, 'image_id': '579bccf8-632b-419f-a6ea-28236c093e9f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/579bccf8-632b-419f-a6ea-28236c093e9f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6470639fe2bc6bf12e3c08ff5bc5cc76', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bc62bde7b9524bafa83c1f3f7232761d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fa87cf4d9a2d885ead9903c3223f5876a64e51b0339434958cd594f1ccb01aaf90828499126bca7e3c5c728320a52fa36416d6275e8ae8fd16e5a0243a3a1c5b', 'id': '579bccf8-632b-419f-a6ea-28236c093e9f', 'created_at': datetime.datetime(2026, 7, 11, 2, 45, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 45, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/579bccf8-632b-419f-a6ea-28236c093e9f/file', 'properties': {}}, 'image_service': }' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ab1eee5-707b-45da-a505-598730826df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:45:55 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d Jul 11 04:45:55 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:55 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Volume volume-5d0e4e37-a25f-4f21-ad68-fd9df2364702 (5d0e4e37-a25f-4f21-ad68-fd9df2364702): created successfully Jul 11 04:45:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ab1eee5-707b-45da-a505-598730826df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:45:55 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Flow 'volume_create_manager' (1eb250dc-8f82-457b-a8cc-55bfcb566248) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:45:55 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-a6c023ae-d592-45bb-a05e-da528264ad17 tempest-VolumeImageDependencyTests-1369547990 None] Created volume successfully. Jul 11 04:45:56 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f7cb87d1-0f23-4570-89f0-2291d85d037a tempest-ProjectReaderTests-787132287 None] Acquiring lock "cinder-5d780c7b-5436-4871-b56d-463352c426a5-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:56 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f7cb87d1-0f23-4570-89f0-2291d85d037a tempest-ProjectReaderTests-787132287 None] Lock "cinder-5d780c7b-5436-4871-b56d-463352c426a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:56 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f7cb87d1-0f23-4570-89f0-2291d85d037a tempest-ProjectReaderTests-787132287 None] Acquiring lock "cinder-quobyte-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:56 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f7cb87d1-0f23-4570-89f0-2291d85d037a tempest-ProjectReaderTests-787132287 None] Lock "cinder-quobyte-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:56 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f7cb87d1-0f23-4570-89f0-2291d85d037a tempest-ProjectReaderTests-787132287 None] Acquiring lock "cinder-quobyte-5d780c7b-5436-4871-b56d-463352c426a5" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:56 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f7cb87d1-0f23-4570-89f0-2291d85d037a tempest-ProjectReaderTests-787132287 None] Lock "cinder-quobyte-5d780c7b-5436-4871-b56d-463352c426a5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:56 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-f7cb87d1-0f23-4570-89f0-2291d85d037a tempest-ProjectReaderTests-787132287 None] Deleting offline snapshot 5d780c7b-5436-4871-b56d-463352c426a5 of volume 4adc9e22-ca46-44c9-a83f-6b2cbb834f2a {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:45:56 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-f7cb87d1-0f23-4570-89f0-2291d85d037a tempest-ProjectReaderTests-787132287 None] snapshot_file for this snap is: volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a.5d780c7b-5436-4871-b56d-463352c426a5 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:45:56 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e44c56-68e3-4bc5-a152-d6177a44a695]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f7cb87d1-0f23-4570-89f0-2291d85d037a tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a.5d780c7b-5436-4871-b56d-463352c426a5 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:56 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cfb62c10-232c-4632-9ad9-eb41bdc96d81 tempest-VolumeDependencyTests-1722146605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d" returned: 0 in 0.817s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cfb62c10-232c-4632-9ad9-eb41bdc96d81 tempest-VolumeDependencyTests-1722146605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d.8fc9e979-a1cc-43dc-93d8-a7ba6fa77236 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:56 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d.8fc9e979-a1cc-43dc-93d8-a7ba6fa77236 1G Jul 11 04:45:56 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:56 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a.5d780c7b-5436-4871-b56d-463352c426a5 Jul 11 04:45:56 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:56 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b3d20bfc-8ebd-46fc-b08d-c3812978560d tempest-VolumeImageDependencyTests-1369547990 None] Acquiring lock "cinder-5d0e4e37-a25f-4f21-ad68-fd9df2364702-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:56 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b3d20bfc-8ebd-46fc-b08d-c3812978560d tempest-VolumeImageDependencyTests-1369547990 None] Lock "cinder-5d0e4e37-a25f-4f21-ad68-fd9df2364702-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:56 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b3d20bfc-8ebd-46fc-b08d-c3812978560d tempest-VolumeImageDependencyTests-1369547990 None] Acquiring lock "cinder-quobyte-5d0e4e37-a25f-4f21-ad68-fd9df2364702" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:45:56 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b3d20bfc-8ebd-46fc-b08d-c3812978560d tempest-VolumeImageDependencyTests-1369547990 None] Lock "cinder-quobyte-5d0e4e37-a25f-4f21-ad68-fd9df2364702" acquired by "delete_volume" :: waited 0.018s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:45:56 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[f280ebfc-3f80-4501-a4b7-f6569a49ce08]: (4, 'raw') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b3d20bfc-8ebd-46fc-b08d-c3812978560d tempest-VolumeImageDependencyTests-1369547990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d0e4e37-a25f-4f21-ad68-fd9df2364702 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:56 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d0e4e37-a25f-4f21-ad68-fd9df2364702 Jul 11 04:45:56 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:57 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f7cb87d1-0f23-4570-89f0-2291d85d037a tempest-ProjectReaderTests-787132287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a.5d780c7b-5436-4871-b56d-463352c426a5" returned: 0 in 0.907s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:57 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-f7cb87d1-0f23-4570-89f0-2291d85d037a tempest-ProjectReaderTests-787132287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:45:57 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bab2d36-7025-462d-bc1b-6578966a60dd]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:45:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f7cb87d1-0f23-4570-89f0-2291d85d037a tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:57 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a Jul 11 04:45:57 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:57 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cfb62c10-232c-4632-9ad9-eb41bdc96d81 tempest-VolumeDependencyTests-1722146605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d.8fc9e979-a1cc-43dc-93d8-a7ba6fa77236 1G" returned: 0 in 1.018s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cfb62c10-232c-4632-9ad9-eb41bdc96d81 tempest-VolumeDependencyTests-1722146605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d.8fc9e979-a1cc-43dc-93d8-a7ba6fa77236 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:57 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d.8fc9e979-a1cc-43dc-93d8-a7ba6fa77236 Jul 11 04:45:57 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:57 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b3d20bfc-8ebd-46fc-b08d-c3812978560d tempest-VolumeImageDependencyTests-1369547990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d0e4e37-a25f-4f21-ad68-fd9df2364702" returned: 0 in 0.952s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b3d20bfc-8ebd-46fc-b08d-c3812978560d tempest-VolumeImageDependencyTests-1369547990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d0e4e37-a25f-4f21-ad68-fd9df2364702 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:57 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d0e4e37-a25f-4f21-ad68-fd9df2364702 Jul 11 04:45:57 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:58 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f7cb87d1-0f23-4570-89f0-2291d85d037a tempest-ProjectReaderTests-787132287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a" returned: 0 in 0.960s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f7cb87d1-0f23-4570-89f0-2291d85d037a tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a.5d780c7b-5436-4871-b56d-463352c426a5 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:58 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cfb62c10-232c-4632-9ad9-eb41bdc96d81 tempest-VolumeDependencyTests-1722146605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d.8fc9e979-a1cc-43dc-93d8-a7ba6fa77236" returned: 0 in 0.804s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:58 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-cfb62c10-232c-4632-9ad9-eb41bdc96d81 tempest-VolumeDependencyTests-1722146605 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d.8fc9e979-a1cc-43dc-93d8-a7ba6fa77236 is being set with open permissions: ugo+rw Jul 11 04:45:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cfb62c10-232c-4632-9ad9-eb41bdc96d81 tempest-VolumeDependencyTests-1722146605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d.8fc9e979-a1cc-43dc-93d8-a7ba6fa77236 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:58 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a.5d780c7b-5436-4871-b56d-463352c426a5 Jul 11 04:45:58 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:58 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d.8fc9e979-a1cc-43dc-93d8-a7ba6fa77236 Jul 11 04:45:58 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:58 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b3d20bfc-8ebd-46fc-b08d-c3812978560d tempest-VolumeImageDependencyTests-1369547990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d0e4e37-a25f-4f21-ad68-fd9df2364702" returned: 1 in 0.871s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b3d20bfc-8ebd-46fc-b08d-c3812978560d tempest-VolumeImageDependencyTests-1369547990 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d0e4e37-a25f-4f21-ad68-fd9df2364702' failed. Not Retrying. {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:45:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b3d20bfc-8ebd-46fc-b08d-c3812978560d tempest-VolumeImageDependencyTests-1369547990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d0e4e37-a25f-4f21-ad68-fd9df2364702 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:58 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d0e4e37-a25f-4f21-ad68-fd9df2364702 Jul 11 04:45:58 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:59 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cfb62c10-232c-4632-9ad9-eb41bdc96d81 tempest-VolumeDependencyTests-1722146605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d.8fc9e979-a1cc-43dc-93d8-a7ba6fa77236" returned: 0 in 0.726s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cfb62c10-232c-4632-9ad9-eb41bdc96d81 tempest-VolumeDependencyTests-1722146605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:59 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:45:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:45:59 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d.info Jul 11 04:45:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:45:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:59 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:59 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f7cb87d1-0f23-4570-89f0-2291d85d037a tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a.5d780c7b-5436-4871-b56d-463352c426a5" returned: 0 in 0.861s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f7cb87d1-0f23-4570-89f0-2291d85d037a tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a.5d780c7b-5436-4871-b56d-463352c426a5 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:59 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:45:59 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:59 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a.5d780c7b-5436-4871-b56d-463352c426a5 Jul 11 04:45:59 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:45:59 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Jul 11 04:45:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b3d20bfc-8ebd-46fc-b08d-c3812978560d tempest-VolumeImageDependencyTests-1369547990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5d0e4e37-a25f-4f21-ad68-fd9df2364702" returned: 0 in 0.921s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:45:59 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b3d20bfc-8ebd-46fc-b08d-c3812978560d tempest-VolumeImageDependencyTests-1369547990 None] Lock "cinder-quobyte-5d0e4e37-a25f-4f21-ad68-fd9df2364702" released by "delete_volume" :: held 2.832s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:45:59 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-b3d20bfc-8ebd-46fc-b08d-c3812978560d tempest-VolumeImageDependencyTests-1369547990 None] Created reservations ['faf28a17-b9c5-4dd9-b304-c000a9a21868', 'd4db2652-cb9c-4718-8dfc-06f346a5dfa7', '40d82aa6-bd67-4d23-ba9d-3c89184d59b1', 'ecefdd03-bb9b-464b-ac39-92e2c112e71a'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:45:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b3d20bfc-8ebd-46fc-b08d-c3812978560d tempest-VolumeImageDependencyTests-1369547990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:45:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b3d20bfc-8ebd-46fc-b08d-c3812978560d tempest-VolumeImageDependencyTests-1369547990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:45:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b3d20bfc-8ebd-46fc-b08d-c3812978560d tempest-VolumeImageDependencyTests-1369547990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:45:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b3d20bfc-8ebd-46fc-b08d-c3812978560d tempest-VolumeImageDependencyTests-1369547990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:45:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b3d20bfc-8ebd-46fc-b08d-c3812978560d tempest-VolumeImageDependencyTests-1369547990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:45:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b3d20bfc-8ebd-46fc-b08d-c3812978560d tempest-VolumeImageDependencyTests-1369547990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:45:59 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:45:59 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:00 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cfb62c10-232c-4632-9ad9-eb41bdc96d81 tempest-VolumeDependencyTests-1722146605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d.info" returned: 0 in 0.936s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:00 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-cfb62c10-232c-4632-9ad9-eb41bdc96d81 tempest-VolumeDependencyTests-1722146605 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d.info is being set with open permissions: ugo+rw Jul 11 04:46:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cfb62c10-232c-4632-9ad9-eb41bdc96d81 tempest-VolumeDependencyTests-1722146605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:00 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d.info Jul 11 04:46:00 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:00 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 1.103s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:00 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:46:00 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager._thread_info {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:46:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread count: 28 {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:46:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread info: [<_MainThread(MainThread, started 124675027595392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:46:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f7cb87d1-0f23-4570-89f0-2291d85d037a tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a.5d780c7b-5436-4871-b56d-463352c426a5" returned: 0 in 1.175s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:00 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:00 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f7cb87d1-0f23-4570-89f0-2291d85d037a tempest-ProjectReaderTests-787132287 None] Lock "cinder-quobyte-5d780c7b-5436-4871-b56d-463352c426a5" released by "_delete_snapshot" :: held 4.046s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:46:00 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f7cb87d1-0f23-4570-89f0-2291d85d037a tempest-ProjectReaderTests-787132287 None] Lock "cinder-quobyte-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a" released by "delete_snapshot" :: held 4.073s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:46:00 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-f7cb87d1-0f23-4570-89f0-2291d85d037a tempest-ProjectReaderTests-787132287 None] Created reservations ['3eee07bd-f24e-4104-b8a0-faa91f60948c', 'c43f063a-33be-4200-bbd3-ff87eca6ed91', 'ae35fe72-accb-4d49-bdf0-d5c092e71285', 'bafab00a-4621-4ca1-8006-4abc48105b63'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:46:00 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-f7cb87d1-0f23-4570-89f0-2291d85d037a tempest-ProjectReaderTests-787132287 None] Delete snapshot completed successfully. Jul 11 04:46:00 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f7cb87d1-0f23-4570-89f0-2291d85d037a tempest-ProjectReaderTests-787132287 None] Lock "cinder-5d780c7b-5436-4871-b56d-463352c426a5-delete_snapshot" released by "delete_snapshot" :: held 4.368s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:46:00 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b3d20bfc-8ebd-46fc-b08d-c3812978560d tempest-VolumeImageDependencyTests-1369547990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 1.062s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:00 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-b3d20bfc-8ebd-46fc-b08d-c3812978560d tempest-VolumeImageDependencyTests-1369547990 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:46:00 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-b3d20bfc-8ebd-46fc-b08d-c3812978560d tempest-VolumeImageDependencyTests-1369547990 None] Deleted volume successfully. Jul 11 04:46:00 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b3d20bfc-8ebd-46fc-b08d-c3812978560d tempest-VolumeImageDependencyTests-1369547990 None] Lock "cinder-5d0e4e37-a25f-4f21-ad68-fd9df2364702-delete_volume" released by "delete_volume" :: held 4.209s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:46:00 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-cfb62c10-232c-4632-9ad9-eb41bdc96d81 tempest-VolumeDependencyTests-1722146605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d.info" returned: 0 in 0.872s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-cfb62c10-232c-4632-9ad9-eb41bdc96d81 tempest-VolumeDependencyTests-1722146605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.301s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:46:01 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-cfb62c10-232c-4632-9ad9-eb41bdc96d81 tempest-VolumeDependencyTests-1722146605 None] Create snapshot completed successfully Jul 11 04:46:01 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3dd1595e-7976-49c6-9d11-ad3c72b03915 tempest-ProjectReaderTests-787132287 None] Acquiring lock "cinder-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:46:01 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3dd1595e-7976-49c6-9d11-ad3c72b03915 tempest-ProjectReaderTests-787132287 None] Lock "cinder-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:46:01 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3dd1595e-7976-49c6-9d11-ad3c72b03915 tempest-ProjectReaderTests-787132287 None] Acquiring lock "cinder-quobyte-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:46:01 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3dd1595e-7976-49c6-9d11-ad3c72b03915 tempest-ProjectReaderTests-787132287 None] Lock "cinder-quobyte-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a" acquired by "delete_volume" :: waited 0.031s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:46:01 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ec29a3-2797-451b-a74a-f0ac2cc831e4]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:46:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3dd1595e-7976-49c6-9d11-ad3c72b03915 tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:02 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a Jul 11 04:46:02 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:02 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:46:02 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Flow 'volume_create_manager' (0de4fa7f-fb98-42c6-bf01-f7b385ffe755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:46:02 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41ad7413-e154-4bba-93fe-752c4637a2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:02 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41ad7413-e154-4bba-93fe-752c4637a2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1554325054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b52747a4-35ad-48ec-a3dc-4b1cbd033da2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='366b0576e5974d158f7ea8ad9b6cc8f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8fc9e979-a1cc-43dc-93d8-a7ba6fa77236,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:46:02Z,use_quota=True,user_id='4906b9b7299042d9b59db8c4bbae11f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:02 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (169badd1-db5f-4d57-a742-008ebb4de628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:02 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (169badd1-db5f-4d57-a742-008ebb4de628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:02 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7cccd7-403b-47f3-b1c8-e829174cd6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:02 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7cccd7-403b-47f3-b1c8-e829174cd6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b52747a4-35ad-48ec-a3dc-4b1cbd033da2', 'volume_name': 'volume-b52747a4-35ad-48ec-a3dc-4b1cbd033da2', 'volume_size': 1, 'snapshot_id': '8fc9e979-a1cc-43dc-93d8-a7ba6fa77236'}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:02 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6432f331-859d-46bf-9668-fc8984fec33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:02 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6432f331-859d-46bf-9668-fc8984fec33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:02 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3843e06-6a8a-48de-8d8e-192acce00ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:02 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Volume b52747a4-35ad-48ec-a3dc-4b1cbd033da2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b52747a4-35ad-48ec-a3dc-4b1cbd033da2', 'volume_size': 1, 'snapshot_id': '8fc9e979-a1cc-43dc-93d8-a7ba6fa77236'} Jul 11 04:46:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:46:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:46:02 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Acquiring lock "cinder-quobyte-8fc9e979-a1cc-43dc-93d8-a7ba6fa77236-b52747a4-35ad-48ec-a3dc-4b1cbd033da2" by "_create_volume_from_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:46:02 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Lock "cinder-quobyte-8fc9e979-a1cc-43dc-93d8-a7ba6fa77236-b52747a4-35ad-48ec-a3dc-4b1cbd033da2" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:46:02 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Creating volume b52747a4-35ad-48ec-a3dc-4b1cbd033da2 from snapshot 8fc9e979-a1cc-43dc-93d8-a7ba6fa77236 {{(pid=86964) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 04:46:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:46:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:46:02 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:46:02 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:46:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:46:02 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:46:02 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Acquiring lock "cinder-quobyte-b52747a4-35ad-48ec-a3dc-4b1cbd033da2" by "_copy_volume_from_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:46:02 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Lock "cinder-quobyte-b52747a4-35ad-48ec-a3dc-4b1cbd033da2" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:46:02 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] snapshot: 8fc9e979-a1cc-43dc-93d8-a7ba6fa77236, volume: b52747a4-35ad-48ec-a3dc-4b1cbd033da2, {{(pid=86964) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 04:46:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:46:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:46:02 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:46:02 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:46:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:46:02 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[9390f537-88f7-4064-a0e1-63eafba42b63]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:46:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d.8fc9e979-a1cc-43dc-93d8-a7ba6fa77236 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:02 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d.8fc9e979-a1cc-43dc-93d8-a7ba6fa77236 Jul 11 04:46:02 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:02 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3dd1595e-7976-49c6-9d11-ad3c72b03915 tempest-ProjectReaderTests-787132287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a" returned: 0 in 0.989s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3dd1595e-7976-49c6-9d11-ad3c72b03915 tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:02 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a Jul 11 04:46:02 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:03 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d.8fc9e979-a1cc-43dc-93d8-a7ba6fa77236" returned: 0 in 1.062s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:03 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:46:03 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d {{(pid=86964) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 04:46:03 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Creating direct copy from snapshot {{(pid=86964) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 04:46:03 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57f5c25-a33d-4147-aaab-14c90e46d012]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:46:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:03 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3dd1595e-7976-49c6-9d11-ad3c72b03915 tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a" returned: 0 in 0.880s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:03 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3dd1595e-7976-49c6-9d11-ad3c72b03915 tempest-ProjectReaderTests-787132287 None] Lock "cinder-quobyte-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a" released by "delete_volume" :: held 1.951s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:46:03 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d Jul 11 04:46:03 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:03 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-3dd1595e-7976-49c6-9d11-ad3c72b03915 tempest-ProjectReaderTests-787132287 None] Created reservations ['7b822461-bbe1-4286-b8ae-72932f526fdf', '9edb8ade-7fdd-4041-a177-c033ad0f1c5d', 'ec84dc7e-2f49-4930-81e0-7e110c9dd20c', '070f3135-d42c-4e20-8fb9-a8d42e17de05'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:46:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3dd1595e-7976-49c6-9d11-ad3c72b03915 tempest-ProjectReaderTests-787132287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:46:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3dd1595e-7976-49c6-9d11-ad3c72b03915 tempest-ProjectReaderTests-787132287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:46:03 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-3dd1595e-7976-49c6-9d11-ad3c72b03915 tempest-ProjectReaderTests-787132287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:46:03 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-3dd1595e-7976-49c6-9d11-ad3c72b03915 tempest-ProjectReaderTests-787132287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:46:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3dd1595e-7976-49c6-9d11-ad3c72b03915 tempest-ProjectReaderTests-787132287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:46:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3dd1595e-7976-49c6-9d11-ad3c72b03915 tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:03 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:46:03 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:04 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-bab29324-6895-4200-950f-0e5dc72b6b6f tempest-ProjectReaderTests-787132287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:46:04 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-bab29324-6895-4200-950f-0e5dc72b6b6f tempest-ProjectReaderTests-787132287 None] Flow 'volume_create_manager' (65fe0385-5beb-49cb-a9f3-cec39bbb72d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:46:04 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-bab29324-6895-4200-950f-0e5dc72b6b6f tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caa52d8d-5bdf-4034-a88a-0e42b0b140a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:04 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-bab29324-6895-4200-950f-0e5dc72b6b6f tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caa52d8d-5bdf-4034-a88a-0e42b0b140a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-745034046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77a221c4-b771-4276-a0a1-d29106c9f2f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36dcca031e5d4245aed8aadd7b6f88e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:46:05Z,use_quota=True,user_id='ee6e4107301b44a98a0fdd41aead55f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:04 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-bab29324-6895-4200-950f-0e5dc72b6b6f tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (769ba839-4dba-42ec-9ab6-45d2c334df64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:04 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-bab29324-6895-4200-950f-0e5dc72b6b6f tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (769ba839-4dba-42ec-9ab6-45d2c334df64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:04 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-bab29324-6895-4200-950f-0e5dc72b6b6f tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (835d8188-fc66-4cdb-bd21-01932e459b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:04 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-bab29324-6895-4200-950f-0e5dc72b6b6f tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (835d8188-fc66-4cdb-bd21-01932e459b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77a221c4-b771-4276-a0a1-d29106c9f2f9', 'volume_name': 'volume-77a221c4-b771-4276-a0a1-d29106c9f2f9', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:04 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-bab29324-6895-4200-950f-0e5dc72b6b6f tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c6f824a-739f-4833-bb05-097a4dcdc29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:04 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-bab29324-6895-4200-950f-0e5dc72b6b6f tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c6f824a-739f-4833-bb05-097a4dcdc29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:04 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:04 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-bab29324-6895-4200-950f-0e5dc72b6b6f tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ff5b252-b15b-43fe-a875-bfc2ef508b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:04 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-bab29324-6895-4200-950f-0e5dc72b6b6f tempest-ProjectReaderTests-787132287 None] Volume 77a221c4-b771-4276-a0a1-d29106c9f2f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77a221c4-b771-4276-a0a1-d29106c9f2f9', 'volume_size': 1} Jul 11 04:46:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-bab29324-6895-4200-950f-0e5dc72b6b6f tempest-ProjectReaderTests-787132287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:46:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3dd1595e-7976-49c6-9d11-ad3c72b03915 tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.938s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:04 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-3dd1595e-7976-49c6-9d11-ad3c72b03915 tempest-ProjectReaderTests-787132287 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:46:04 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-3dd1595e-7976-49c6-9d11-ad3c72b03915 tempest-ProjectReaderTests-787132287 None] Deleted volume successfully. Jul 11 04:46:04 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3dd1595e-7976-49c6-9d11-ad3c72b03915 tempest-ProjectReaderTests-787132287 None] Lock "cinder-4adc9e22-ca46-44c9-a83f-6b2cbb834f2a-delete_volume" released by "delete_volume" :: held 3.195s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:46:04 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d" returned: 0 in 1.315s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:04 devstack cinder-volume[86964]: DEBUG cinder.utils [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Path /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b52747a4-35ad-48ec-a3dc-4b1cbd033da2 not found in is_blk_device check {{(pid=86964) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 04:46:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b52747a4-35ad-48ec-a3dc-4b1cbd033da2 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:05 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b52747a4-35ad-48ec-a3dc-4b1cbd033da2 Jul 11 04:46:05 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:11 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b52747a4-35ad-48ec-a3dc-4b1cbd033da2" returned: 0 in 6.114s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:11 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e5cd94-fdbb-441d-b787-7dfb7dee37a7]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:46:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:11 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d Jul 11 04:46:11 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:12 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d" returned: 0 in 1.156s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:12 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Image conversion details: src /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d, size 1024.00 MB, duration 6.12 sec, destination /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b52747a4-35ad-48ec-a3dc-4b1cbd033da2 {{(pid=86964) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 04:46:12 devstack cinder-volume[86964]: INFO cinder.image.image_utils [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Converted 1024.00 MB image at 167.42 MB/s Jul 11 04:46:12 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b52747a4-35ad-48ec-a3dc-4b1cbd033da2 is being set with open permissions: ugo+rw Jul 11 04:46:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b52747a4-35ad-48ec-a3dc-4b1cbd033da2 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:12 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b52747a4-35ad-48ec-a3dc-4b1cbd033da2 Jul 11 04:46:12 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:13 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b52747a4-35ad-48ec-a3dc-4b1cbd033da2" returned: 0 in 0.911s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:13 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Lock "cinder-quobyte-b52747a4-35ad-48ec-a3dc-4b1cbd033da2" released by "_copy_volume_from_snapshot" :: held 10.726s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:46:13 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Lock "cinder-quobyte-8fc9e979-a1cc-43dc-93d8-a7ba6fa77236-b52747a4-35ad-48ec-a3dc-4b1cbd033da2" released by "_create_volume_from_snapshot" :: held 10.772s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:46:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.793s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:46:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-bab29324-6895-4200-950f-0e5dc72b6b6f tempest-ProjectReaderTests-787132287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.319s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:46:13 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-bab29324-6895-4200-950f-0e5dc72b6b6f tempest-ProjectReaderTests-787132287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-745034046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77a221c4-b771-4276-a0a1-d29106c9f2f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36dcca031e5d4245aed8aadd7b6f88e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:46:05Z,use_quota=True,user_id='ee6e4107301b44a98a0fdd41aead55f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:46:13 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-bab29324-6895-4200-950f-0e5dc72b6b6f tempest-ProjectReaderTests-787132287 None] Creating volume 77a221c4-b771-4276-a0a1-d29106c9f2f9 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:46:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-bab29324-6895-4200-950f-0e5dc72b6b6f tempest-ProjectReaderTests-787132287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:46:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-bab29324-6895-4200-950f-0e5dc72b6b6f tempest-ProjectReaderTests-787132287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:46:13 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-bab29324-6895-4200-950f-0e5dc72b6b6f tempest-ProjectReaderTests-787132287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:46:13 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-bab29324-6895-4200-950f-0e5dc72b6b6f tempest-ProjectReaderTests-787132287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:46:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-bab29324-6895-4200-950f-0e5dc72b6b6f tempest-ProjectReaderTests-787132287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:46:13 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-bab29324-6895-4200-950f-0e5dc72b6b6f tempest-ProjectReaderTests-787132287 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:46:13 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-bab29324-6895-4200-950f-0e5dc72b6b6f tempest-ProjectReaderTests-787132287 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:46:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bab29324-6895-4200-950f-0e5dc72b6b6f tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:13 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9 1073741824 Jul 11 04:46:13 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3843e06-6a8a-48de-8d8e-192acce00ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b52747a4-35ad-48ec-a3dc-4b1cbd033da2', 'volume_size': 1, 'snapshot_id': '8fc9e979-a1cc-43dc-93d8-a7ba6fa77236'}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad051b51-34f7-4a79-9247-ad0144d16841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:13 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Volume volume-b52747a4-35ad-48ec-a3dc-4b1cbd033da2 (b52747a4-35ad-48ec-a3dc-4b1cbd033da2): created successfully Jul 11 04:46:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad051b51-34f7-4a79-9247-ad0144d16841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Flow 'volume_create_manager' (0de4fa7f-fb98-42c6-bf01-f7b385ffe755) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:46:13 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-71386883-e257-4b74-99a2-7a630c24d981 tempest-VolumeDependencyTests-1722146605 None] Created volume successfully. Jul 11 04:46:13 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a65af78b-9649-4f49-96f3-7dbe41953c91 tempest-VolumeDependencyTests-1722146605 None] Acquiring lock "cinder-8fc9e979-a1cc-43dc-93d8-a7ba6fa77236-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:46:13 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a65af78b-9649-4f49-96f3-7dbe41953c91 tempest-VolumeDependencyTests-1722146605 None] Lock "cinder-8fc9e979-a1cc-43dc-93d8-a7ba6fa77236-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:46:13 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a65af78b-9649-4f49-96f3-7dbe41953c91 tempest-VolumeDependencyTests-1722146605 None] Acquiring lock "cinder-quobyte-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:46:13 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a65af78b-9649-4f49-96f3-7dbe41953c91 tempest-VolumeDependencyTests-1722146605 None] Lock "cinder-quobyte-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:46:13 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a65af78b-9649-4f49-96f3-7dbe41953c91 tempest-VolumeDependencyTests-1722146605 None] Acquiring lock "cinder-quobyte-8fc9e979-a1cc-43dc-93d8-a7ba6fa77236" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:46:13 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a65af78b-9649-4f49-96f3-7dbe41953c91 tempest-VolumeDependencyTests-1722146605 None] Lock "cinder-quobyte-8fc9e979-a1cc-43dc-93d8-a7ba6fa77236" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:46:13 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-a65af78b-9649-4f49-96f3-7dbe41953c91 tempest-VolumeDependencyTests-1722146605 None] Deleting offline snapshot 8fc9e979-a1cc-43dc-93d8-a7ba6fa77236 of volume 6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:46:13 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-a65af78b-9649-4f49-96f3-7dbe41953c91 tempest-VolumeDependencyTests-1722146605 None] snapshot_file for this snap is: volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d.8fc9e979-a1cc-43dc-93d8-a7ba6fa77236 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:46:13 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90bc141-88c6-4eec-969d-e0877f4597e3]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:46:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a65af78b-9649-4f49-96f3-7dbe41953c91 tempest-VolumeDependencyTests-1722146605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d.8fc9e979-a1cc-43dc-93d8-a7ba6fa77236 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:13 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d.8fc9e979-a1cc-43dc-93d8-a7ba6fa77236 Jul 11 04:46:13 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:14 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bab29324-6895-4200-950f-0e5dc72b6b6f tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9 1073741824" returned: 0 in 1.053s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bab29324-6895-4200-950f-0e5dc72b6b6f tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:14 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9 Jul 11 04:46:14 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:14 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a65af78b-9649-4f49-96f3-7dbe41953c91 tempest-VolumeDependencyTests-1722146605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d.8fc9e979-a1cc-43dc-93d8-a7ba6fa77236" returned: 0 in 1.181s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:14 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-a65af78b-9649-4f49-96f3-7dbe41953c91 tempest-VolumeDependencyTests-1722146605 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:46:14 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[0057b8c0-3fb5-4e91-a8ed-cffde09e4b58]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:46:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a65af78b-9649-4f49-96f3-7dbe41953c91 tempest-VolumeDependencyTests-1722146605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:15 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d Jul 11 04:46:15 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:15 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-bab29324-6895-4200-950f-0e5dc72b6b6f tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9" returned: 0 in 1.062s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:15 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-bab29324-6895-4200-950f-0e5dc72b6b6f tempest-ProjectReaderTests-787132287 None] <== create_volume: return (2192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:46:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-bab29324-6895-4200-950f-0e5dc72b6b6f tempest-ProjectReaderTests-787132287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.194s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:46:15 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-bab29324-6895-4200-950f-0e5dc72b6b6f tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ff5b252-b15b-43fe-a875-bfc2ef508b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77a221c4-b771-4276-a0a1-d29106c9f2f9', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:15 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-bab29324-6895-4200-950f-0e5dc72b6b6f tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (920ca006-00d4-4ef2-bdb6-a784e3c30376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:15 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-bab29324-6895-4200-950f-0e5dc72b6b6f tempest-ProjectReaderTests-787132287 None] Volume volume-77a221c4-b771-4276-a0a1-d29106c9f2f9 (77a221c4-b771-4276-a0a1-d29106c9f2f9): created successfully Jul 11 04:46:15 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-bab29324-6895-4200-950f-0e5dc72b6b6f tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (920ca006-00d4-4ef2-bdb6-a784e3c30376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:15 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-bab29324-6895-4200-950f-0e5dc72b6b6f tempest-ProjectReaderTests-787132287 None] Flow 'volume_create_manager' (65fe0385-5beb-49cb-a9f3-cec39bbb72d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:46:15 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-bab29324-6895-4200-950f-0e5dc72b6b6f tempest-ProjectReaderTests-787132287 None] Created volume successfully. Jul 11 04:46:15 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a65af78b-9649-4f49-96f3-7dbe41953c91 tempest-VolumeDependencyTests-1722146605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d" returned: 0 in 1.028s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a65af78b-9649-4f49-96f3-7dbe41953c91 tempest-VolumeDependencyTests-1722146605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d.8fc9e979-a1cc-43dc-93d8-a7ba6fa77236 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:15 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d.8fc9e979-a1cc-43dc-93d8-a7ba6fa77236 Jul 11 04:46:15 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-67d1bde5-c6f6-4520-9409-7b2ee5063fe8 tempest-ProjectReaderTests-787132287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:46:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-67d1bde5-c6f6-4520-9409-7b2ee5063fe8 tempest-ProjectReaderTests-787132287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:46:16 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-67d1bde5-c6f6-4520-9409-7b2ee5063fe8 tempest-ProjectReaderTests-787132287 None] Creating offline snapshot 6bfb72a7-bdf8-4f84-b710-21f0b9a4e8a3 of volume 77a221c4-b771-4276-a0a1-d29106c9f2f9 {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:46:16 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8931fc-28a1-4a97-a0eb-d1c4eb65a5a7]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:46:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-67d1bde5-c6f6-4520-9409-7b2ee5063fe8 tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:16 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9 Jul 11 04:46:16 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:16 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a65af78b-9649-4f49-96f3-7dbe41953c91 tempest-VolumeDependencyTests-1722146605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d.8fc9e979-a1cc-43dc-93d8-a7ba6fa77236" returned: 0 in 0.801s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a65af78b-9649-4f49-96f3-7dbe41953c91 tempest-VolumeDependencyTests-1722146605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d.8fc9e979-a1cc-43dc-93d8-a7ba6fa77236 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:16 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d.8fc9e979-a1cc-43dc-93d8-a7ba6fa77236 Jul 11 04:46:16 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:17 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-67d1bde5-c6f6-4520-9409-7b2ee5063fe8 tempest-ProjectReaderTests-787132287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9" returned: 0 in 0.951s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-67d1bde5-c6f6-4520-9409-7b2ee5063fe8 tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9.6bfb72a7-bdf8-4f84-b710-21f0b9a4e8a3 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:17 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9.6bfb72a7-bdf8-4f84-b710-21f0b9a4e8a3 1G Jul 11 04:46:17 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:17 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a65af78b-9649-4f49-96f3-7dbe41953c91 tempest-VolumeDependencyTests-1722146605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d.8fc9e979-a1cc-43dc-93d8-a7ba6fa77236" returned: 0 in 0.781s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a65af78b-9649-4f49-96f3-7dbe41953c91 tempest-VolumeDependencyTests-1722146605 None] Lock "cinder-quobyte-8fc9e979-a1cc-43dc-93d8-a7ba6fa77236" released by "_delete_snapshot" :: held 3.970s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:46:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a65af78b-9649-4f49-96f3-7dbe41953c91 tempest-VolumeDependencyTests-1722146605 None] Lock "cinder-quobyte-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d" released by "delete_snapshot" :: held 4.005s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:46:17 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-a65af78b-9649-4f49-96f3-7dbe41953c91 tempest-VolumeDependencyTests-1722146605 None] Created reservations ['fc20ee10-4511-4b7d-9c0c-48f0144f6be5', '502d3ef2-6857-47a7-9b18-66e47215cc8c', 'eed57ef2-8b6e-47ba-b692-b2561c1c81e7', '7b8870f4-329f-4e04-a862-eedca92931e1'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:46:17 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-a65af78b-9649-4f49-96f3-7dbe41953c91 tempest-VolumeDependencyTests-1722146605 None] Delete snapshot completed successfully. Jul 11 04:46:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a65af78b-9649-4f49-96f3-7dbe41953c91 tempest-VolumeDependencyTests-1722146605 None] Lock "cinder-8fc9e979-a1cc-43dc-93d8-a7ba6fa77236-delete_snapshot" released by "delete_snapshot" :: held 4.208s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:46:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-683eaccc-e312-43e6-aa4d-a2b706ca85f6 tempest-VolumeDependencyTests-1722146605 None] Acquiring lock "cinder-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:46:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-683eaccc-e312-43e6-aa4d-a2b706ca85f6 tempest-VolumeDependencyTests-1722146605 None] Lock "cinder-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:46:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-683eaccc-e312-43e6-aa4d-a2b706ca85f6 tempest-VolumeDependencyTests-1722146605 None] Acquiring lock "cinder-quobyte-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:46:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-683eaccc-e312-43e6-aa4d-a2b706ca85f6 tempest-VolumeDependencyTests-1722146605 None] Lock "cinder-quobyte-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d" acquired by "delete_volume" :: waited 0.018s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:46:18 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded79f37-091a-4660-bacb-6a35921fcd73]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:46:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-683eaccc-e312-43e6-aa4d-a2b706ca85f6 tempest-VolumeDependencyTests-1722146605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:18 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d Jul 11 04:46:18 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:18 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-67d1bde5-c6f6-4520-9409-7b2ee5063fe8 tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9.6bfb72a7-bdf8-4f84-b710-21f0b9a4e8a3 1G" returned: 0 in 1.079s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-67d1bde5-c6f6-4520-9409-7b2ee5063fe8 tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77a221c4-b771-4276-a0a1-d29106c9f2f9 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9.6bfb72a7-bdf8-4f84-b710-21f0b9a4e8a3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:18 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77a221c4-b771-4276-a0a1-d29106c9f2f9 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9.6bfb72a7-bdf8-4f84-b710-21f0b9a4e8a3 Jul 11 04:46:18 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:18 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-683eaccc-e312-43e6-aa4d-a2b706ca85f6 tempest-VolumeDependencyTests-1722146605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d" returned: 0 in 0.907s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-683eaccc-e312-43e6-aa4d-a2b706ca85f6 tempest-VolumeDependencyTests-1722146605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:18 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d Jul 11 04:46:18 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:19 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-67d1bde5-c6f6-4520-9409-7b2ee5063fe8 tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77a221c4-b771-4276-a0a1-d29106c9f2f9 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9.6bfb72a7-bdf8-4f84-b710-21f0b9a4e8a3" returned: 0 in 0.948s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:19 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-67d1bde5-c6f6-4520-9409-7b2ee5063fe8 tempest-ProjectReaderTests-787132287 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9.6bfb72a7-bdf8-4f84-b710-21f0b9a4e8a3 is being set with open permissions: ugo+rw Jul 11 04:46:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-67d1bde5-c6f6-4520-9409-7b2ee5063fe8 tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9.6bfb72a7-bdf8-4f84-b710-21f0b9a4e8a3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:19 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9.6bfb72a7-bdf8-4f84-b710-21f0b9a4e8a3 Jul 11 04:46:19 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:19 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-683eaccc-e312-43e6-aa4d-a2b706ca85f6 tempest-VolumeDependencyTests-1722146605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d" returned: 0 in 0.821s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:19 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-683eaccc-e312-43e6-aa4d-a2b706ca85f6 tempest-VolumeDependencyTests-1722146605 None] Lock "cinder-quobyte-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d" released by "delete_volume" :: held 1.799s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:46:19 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-683eaccc-e312-43e6-aa4d-a2b706ca85f6 tempest-VolumeDependencyTests-1722146605 None] Created reservations ['e9ed95aa-c3da-4a25-ad5f-ecdb5a40aeca', '37f3fdcd-8c80-4f1c-a37b-bf52fa604d07', '43d7329a-3ae5-40be-9266-5ce68ce70fed', 'b0e3f672-603e-4241-abcd-482755ce27cf'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:46:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-683eaccc-e312-43e6-aa4d-a2b706ca85f6 tempest-VolumeDependencyTests-1722146605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:46:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-683eaccc-e312-43e6-aa4d-a2b706ca85f6 tempest-VolumeDependencyTests-1722146605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:46:19 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-683eaccc-e312-43e6-aa4d-a2b706ca85f6 tempest-VolumeDependencyTests-1722146605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:46:19 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-683eaccc-e312-43e6-aa4d-a2b706ca85f6 tempest-VolumeDependencyTests-1722146605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:46:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-683eaccc-e312-43e6-aa4d-a2b706ca85f6 tempest-VolumeDependencyTests-1722146605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:46:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-683eaccc-e312-43e6-aa4d-a2b706ca85f6 tempest-VolumeDependencyTests-1722146605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:20 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:20 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:46:20 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-67d1bde5-c6f6-4520-9409-7b2ee5063fe8 tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9.6bfb72a7-bdf8-4f84-b710-21f0b9a4e8a3" returned: 0 in 0.857s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-67d1bde5-c6f6-4520-9409-7b2ee5063fe8 tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:20 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9.info Jul 11 04:46:20 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:20 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-79892304-8536-4599-b305-e7cadbe91ad9 tempest-VolumeDependencyTests-1722146605 None] Acquiring lock "cinder-b52747a4-35ad-48ec-a3dc-4b1cbd033da2-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:46:20 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-79892304-8536-4599-b305-e7cadbe91ad9 tempest-VolumeDependencyTests-1722146605 None] Lock "cinder-b52747a4-35ad-48ec-a3dc-4b1cbd033da2-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:46:20 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-79892304-8536-4599-b305-e7cadbe91ad9 tempest-VolumeDependencyTests-1722146605 None] Acquiring lock "cinder-quobyte-b52747a4-35ad-48ec-a3dc-4b1cbd033da2" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:46:20 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-79892304-8536-4599-b305-e7cadbe91ad9 tempest-VolumeDependencyTests-1722146605 None] Lock "cinder-quobyte-b52747a4-35ad-48ec-a3dc-4b1cbd033da2" acquired by "delete_volume" :: waited 0.025s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:46:20 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddf34bc-38a8-4c8a-be9e-ae8ae8d58c0a]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:46:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-79892304-8536-4599-b305-e7cadbe91ad9 tempest-VolumeDependencyTests-1722146605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b52747a4-35ad-48ec-a3dc-4b1cbd033da2 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:20 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b52747a4-35ad-48ec-a3dc-4b1cbd033da2 Jul 11 04:46:20 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:20 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-683eaccc-e312-43e6-aa4d-a2b706ca85f6 tempest-VolumeDependencyTests-1722146605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.843s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:20 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-683eaccc-e312-43e6-aa4d-a2b706ca85f6 tempest-VolumeDependencyTests-1722146605 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:46:20 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-683eaccc-e312-43e6-aa4d-a2b706ca85f6 tempest-VolumeDependencyTests-1722146605 None] Deleted volume successfully. Jul 11 04:46:20 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-683eaccc-e312-43e6-aa4d-a2b706ca85f6 tempest-VolumeDependencyTests-1722146605 None] Lock "cinder-6a5898b7-2bf5-4fc8-9d71-2be703e4dd2d-delete_volume" released by "delete_volume" :: held 2.964s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:46:20 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-67d1bde5-c6f6-4520-9409-7b2ee5063fe8 tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9.info" returned: 0 in 0.902s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:20 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-67d1bde5-c6f6-4520-9409-7b2ee5063fe8 tempest-ProjectReaderTests-787132287 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9.info is being set with open permissions: ugo+rw Jul 11 04:46:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-67d1bde5-c6f6-4520-9409-7b2ee5063fe8 tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:21 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9.info Jul 11 04:46:21 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:21 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-79892304-8536-4599-b305-e7cadbe91ad9 tempest-VolumeDependencyTests-1722146605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b52747a4-35ad-48ec-a3dc-4b1cbd033da2" returned: 0 in 1.240s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-79892304-8536-4599-b305-e7cadbe91ad9 tempest-VolumeDependencyTests-1722146605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b52747a4-35ad-48ec-a3dc-4b1cbd033da2 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:21 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b52747a4-35ad-48ec-a3dc-4b1cbd033da2 Jul 11 04:46:21 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:21 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-67d1bde5-c6f6-4520-9409-7b2ee5063fe8 tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9.info" returned: 0 in 1.000s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-67d1bde5-c6f6-4520-9409-7b2ee5063fe8 tempest-ProjectReaderTests-787132287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.863s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:46:22 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-67d1bde5-c6f6-4520-9409-7b2ee5063fe8 tempest-ProjectReaderTests-787132287 None] Create snapshot completed successfully Jul 11 04:46:22 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-79892304-8536-4599-b305-e7cadbe91ad9 tempest-VolumeDependencyTests-1722146605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b52747a4-35ad-48ec-a3dc-4b1cbd033da2" returned: 0 in 0.749s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-79892304-8536-4599-b305-e7cadbe91ad9 tempest-VolumeDependencyTests-1722146605 None] Lock "cinder-quobyte-b52747a4-35ad-48ec-a3dc-4b1cbd033da2" released by "delete_volume" :: held 2.052s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-06a7f43c-6ae4-4488-89d3-a5236bf3c6dc tempest-ProjectReaderTests-787132287 None] Acquiring lock "cinder-6bfb72a7-bdf8-4f84-b710-21f0b9a4e8a3-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-79892304-8536-4599-b305-e7cadbe91ad9 tempest-VolumeDependencyTests-1722146605 None] Created reservations ['b4b3363a-e06a-4109-bece-40d6696d8580', 'e6898dd8-96fc-4575-bd41-50bba87ee1a6', '836e539e-442c-4fde-b319-ce776b30daad', '034f45a2-b93d-4df2-bf51-d2acc759b898'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-06a7f43c-6ae4-4488-89d3-a5236bf3c6dc tempest-ProjectReaderTests-787132287 None] Lock "cinder-6bfb72a7-bdf8-4f84-b710-21f0b9a4e8a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-06a7f43c-6ae4-4488-89d3-a5236bf3c6dc tempest-ProjectReaderTests-787132287 None] Acquiring lock "cinder-quobyte-77a221c4-b771-4276-a0a1-d29106c9f2f9" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-739a6637-d409-4f88-a874-6a5f04c0d0db tempest-ProjectReaderTests-1896276487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-739a6637-d409-4f88-a874-6a5f04c0d0db tempest-ProjectReaderTests-1896276487 None] Flow 'volume_create_manager' (6969d667-2bbd-4d72-8984-551917c9d6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-739a6637-d409-4f88-a874-6a5f04c0d0db tempest-ProjectReaderTests-1896276487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71b89982-68d8-4104-a7bf-8c02097be5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-06a7f43c-6ae4-4488-89d3-a5236bf3c6dc tempest-ProjectReaderTests-787132287 None] Lock "cinder-quobyte-77a221c4-b771-4276-a0a1-d29106c9f2f9" acquired by "delete_snapshot" :: waited 0.060s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-06a7f43c-6ae4-4488-89d3-a5236bf3c6dc tempest-ProjectReaderTests-787132287 None] Acquiring lock "cinder-quobyte-6bfb72a7-bdf8-4f84-b710-21f0b9a4e8a3" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-739a6637-d409-4f88-a874-6a5f04c0d0db tempest-ProjectReaderTests-1896276487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71b89982-68d8-4104-a7bf-8c02097be5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1813288634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de108658-e838-4868-90f1-a43acb52a5c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='045479645f564c83ae6f4bf11f328992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:46:23Z,use_quota=True,user_id='a93e4379c0eb4ec2ad7d9e21e71bca20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-739a6637-d409-4f88-a874-6a5f04c0d0db tempest-ProjectReaderTests-1896276487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe1727bf-d09e-49b9-a419-53d654efb574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-739a6637-d409-4f88-a874-6a5f04c0d0db tempest-ProjectReaderTests-1896276487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe1727bf-d09e-49b9-a419-53d654efb574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-739a6637-d409-4f88-a874-6a5f04c0d0db tempest-ProjectReaderTests-1896276487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf6c5ec2-d334-40c8-a70e-9b5141aa6b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-739a6637-d409-4f88-a874-6a5f04c0d0db tempest-ProjectReaderTests-1896276487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf6c5ec2-d334-40c8-a70e-9b5141aa6b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de108658-e838-4868-90f1-a43acb52a5c9', 'volume_name': 'volume-de108658-e838-4868-90f1-a43acb52a5c9', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-739a6637-d409-4f88-a874-6a5f04c0d0db tempest-ProjectReaderTests-1896276487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8dc400c-8629-45da-a214-e8bd7cc65a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-739a6637-d409-4f88-a874-6a5f04c0d0db tempest-ProjectReaderTests-1896276487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8dc400c-8629-45da-a214-e8bd7cc65a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-739a6637-d409-4f88-a874-6a5f04c0d0db tempest-ProjectReaderTests-1896276487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77570545-4f37-493a-8ccc-45c9dd632967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:22 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-739a6637-d409-4f88-a874-6a5f04c0d0db tempest-ProjectReaderTests-1896276487 None] Volume de108658-e838-4868-90f1-a43acb52a5c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de108658-e838-4868-90f1-a43acb52a5c9', 'volume_size': 1} Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-739a6637-d409-4f88-a874-6a5f04c0d0db tempest-ProjectReaderTests-1896276487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-739a6637-d409-4f88-a874-6a5f04c0d0db tempest-ProjectReaderTests-1896276487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-739a6637-d409-4f88-a874-6a5f04c0d0db tempest-ProjectReaderTests-1896276487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1813288634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de108658-e838-4868-90f1-a43acb52a5c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='045479645f564c83ae6f4bf11f328992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:46:23Z,use_quota=True,user_id='a93e4379c0eb4ec2ad7d9e21e71bca20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-739a6637-d409-4f88-a874-6a5f04c0d0db tempest-ProjectReaderTests-1896276487 None] Creating volume de108658-e838-4868-90f1-a43acb52a5c9 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-739a6637-d409-4f88-a874-6a5f04c0d0db tempest-ProjectReaderTests-1896276487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-739a6637-d409-4f88-a874-6a5f04c0d0db tempest-ProjectReaderTests-1896276487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-739a6637-d409-4f88-a874-6a5f04c0d0db tempest-ProjectReaderTests-1896276487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-739a6637-d409-4f88-a874-6a5f04c0d0db tempest-ProjectReaderTests-1896276487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-739a6637-d409-4f88-a874-6a5f04c0d0db tempest-ProjectReaderTests-1896276487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-739a6637-d409-4f88-a874-6a5f04c0d0db tempest-ProjectReaderTests-1896276487 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:46:22 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-739a6637-d409-4f88-a874-6a5f04c0d0db tempest-ProjectReaderTests-1896276487 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-739a6637-d409-4f88-a874-6a5f04c0d0db tempest-ProjectReaderTests-1896276487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-de108658-e838-4868-90f1-a43acb52a5c9 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-06a7f43c-6ae4-4488-89d3-a5236bf3c6dc tempest-ProjectReaderTests-787132287 None] Lock "cinder-quobyte-6bfb72a7-bdf8-4f84-b710-21f0b9a4e8a3" acquired by "_delete_snapshot" :: waited 0.099s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-06a7f43c-6ae4-4488-89d3-a5236bf3c6dc tempest-ProjectReaderTests-787132287 None] Deleting offline snapshot 6bfb72a7-bdf8-4f84-b710-21f0b9a4e8a3 of volume 77a221c4-b771-4276-a0a1-d29106c9f2f9 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:46:22 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-de108658-e838-4868-90f1-a43acb52a5c9 1073741824 Jul 11 04:46:22 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-06a7f43c-6ae4-4488-89d3-a5236bf3c6dc tempest-ProjectReaderTests-787132287 None] snapshot_file for this snap is: volume-77a221c4-b771-4276-a0a1-d29106c9f2f9.6bfb72a7-bdf8-4f84-b710-21f0b9a4e8a3 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c85426-ee73-4d2c-9f50-2517324189e2]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-06a7f43c-6ae4-4488-89d3-a5236bf3c6dc tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9.6bfb72a7-bdf8-4f84-b710-21f0b9a4e8a3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-79892304-8536-4599-b305-e7cadbe91ad9 tempest-VolumeDependencyTests-1722146605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-79892304-8536-4599-b305-e7cadbe91ad9 tempest-VolumeDependencyTests-1722146605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-79892304-8536-4599-b305-e7cadbe91ad9 tempest-VolumeDependencyTests-1722146605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-79892304-8536-4599-b305-e7cadbe91ad9 tempest-VolumeDependencyTests-1722146605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-79892304-8536-4599-b305-e7cadbe91ad9 tempest-VolumeDependencyTests-1722146605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:46:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-79892304-8536-4599-b305-e7cadbe91ad9 tempest-VolumeDependencyTests-1722146605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:22 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:46:22 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:22 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9.6bfb72a7-bdf8-4f84-b710-21f0b9a4e8a3 Jul 11 04:46:22 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:23 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-79892304-8536-4599-b305-e7cadbe91ad9 tempest-VolumeDependencyTests-1722146605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.752s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:23 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-79892304-8536-4599-b305-e7cadbe91ad9 tempest-VolumeDependencyTests-1722146605 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:46:23 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-79892304-8536-4599-b305-e7cadbe91ad9 tempest-VolumeDependencyTests-1722146605 None] Deleted volume successfully. Jul 11 04:46:23 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-79892304-8536-4599-b305-e7cadbe91ad9 tempest-VolumeDependencyTests-1722146605 None] Lock "cinder-b52747a4-35ad-48ec-a3dc-4b1cbd033da2-delete_volume" released by "delete_volume" :: held 3.342s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:46:23 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-739a6637-d409-4f88-a874-6a5f04c0d0db tempest-ProjectReaderTests-1896276487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-de108658-e838-4868-90f1-a43acb52a5c9 1073741824" returned: 0 in 1.094s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-739a6637-d409-4f88-a874-6a5f04c0d0db tempest-ProjectReaderTests-1896276487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-de108658-e838-4868-90f1-a43acb52a5c9 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:23 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:23 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-de108658-e838-4868-90f1-a43acb52a5c9 Jul 11 04:46:23 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-06a7f43c-6ae4-4488-89d3-a5236bf3c6dc tempest-ProjectReaderTests-787132287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9.6bfb72a7-bdf8-4f84-b710-21f0b9a4e8a3" returned: 0 in 1.102s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:23 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-06a7f43c-6ae4-4488-89d3-a5236bf3c6dc tempest-ProjectReaderTests-787132287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77a221c4-b771-4276-a0a1-d29106c9f2f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:46:23 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[741f38d7-d819-4ba3-85f1-fff7592111c2]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:46:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-06a7f43c-6ae4-4488-89d3-a5236bf3c6dc tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:24 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9 Jul 11 04:46:24 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:24 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-739a6637-d409-4f88-a874-6a5f04c0d0db tempest-ProjectReaderTests-1896276487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-de108658-e838-4868-90f1-a43acb52a5c9" returned: 0 in 0.739s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:24 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-739a6637-d409-4f88-a874-6a5f04c0d0db tempest-ProjectReaderTests-1896276487 None] <== create_volume: return (1881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:46:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-739a6637-d409-4f88-a874-6a5f04c0d0db tempest-ProjectReaderTests-1896276487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:46:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-739a6637-d409-4f88-a874-6a5f04c0d0db tempest-ProjectReaderTests-1896276487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77570545-4f37-493a-8ccc-45c9dd632967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de108658-e838-4868-90f1-a43acb52a5c9', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-739a6637-d409-4f88-a874-6a5f04c0d0db tempest-ProjectReaderTests-1896276487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (832f88d7-2df1-48b0-8e31-240bca2bbc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:24 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-739a6637-d409-4f88-a874-6a5f04c0d0db tempest-ProjectReaderTests-1896276487 None] Volume volume-de108658-e838-4868-90f1-a43acb52a5c9 (de108658-e838-4868-90f1-a43acb52a5c9): created successfully Jul 11 04:46:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-739a6637-d409-4f88-a874-6a5f04c0d0db tempest-ProjectReaderTests-1896276487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (832f88d7-2df1-48b0-8e31-240bca2bbc16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-739a6637-d409-4f88-a874-6a5f04c0d0db tempest-ProjectReaderTests-1896276487 None] Flow 'volume_create_manager' (6969d667-2bbd-4d72-8984-551917c9d6a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:46:24 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-739a6637-d409-4f88-a874-6a5f04c0d0db tempest-ProjectReaderTests-1896276487 None] Created volume successfully. Jul 11 04:46:24 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-06a7f43c-6ae4-4488-89d3-a5236bf3c6dc tempest-ProjectReaderTests-787132287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9" returned: 0 in 0.926s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-06a7f43c-6ae4-4488-89d3-a5236bf3c6dc tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9.6bfb72a7-bdf8-4f84-b710-21f0b9a4e8a3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:24 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9.6bfb72a7-bdf8-4f84-b710-21f0b9a4e8a3 Jul 11 04:46:24 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:25 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-06a7f43c-6ae4-4488-89d3-a5236bf3c6dc tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9.6bfb72a7-bdf8-4f84-b710-21f0b9a4e8a3" returned: 0 in 0.929s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-06a7f43c-6ae4-4488-89d3-a5236bf3c6dc tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9.6bfb72a7-bdf8-4f84-b710-21f0b9a4e8a3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:25 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9.6bfb72a7-bdf8-4f84-b710-21f0b9a4e8a3 Jul 11 04:46:25 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:26 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6b2aa596-c595-4bd5-8c26-76dca9fcc6ea tempest-ProjectReaderTests-1896276487 None] Acquiring lock "cinder-de108658-e838-4868-90f1-a43acb52a5c9-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:46:26 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6b2aa596-c595-4bd5-8c26-76dca9fcc6ea tempest-ProjectReaderTests-1896276487 None] Lock "cinder-de108658-e838-4868-90f1-a43acb52a5c9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:46:26 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6b2aa596-c595-4bd5-8c26-76dca9fcc6ea tempest-ProjectReaderTests-1896276487 None] Acquiring lock "cinder-quobyte-de108658-e838-4868-90f1-a43acb52a5c9" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:46:26 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6b2aa596-c595-4bd5-8c26-76dca9fcc6ea tempest-ProjectReaderTests-1896276487 None] Lock "cinder-quobyte-de108658-e838-4868-90f1-a43acb52a5c9" acquired by "delete_volume" :: waited 0.031s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:46:26 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[93272006-4d2a-4787-81f7-49ee3aad5b5e]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:46:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6b2aa596-c595-4bd5-8c26-76dca9fcc6ea tempest-ProjectReaderTests-1896276487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-de108658-e838-4868-90f1-a43acb52a5c9 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:26 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-de108658-e838-4868-90f1-a43acb52a5c9 Jul 11 04:46:26 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:26 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-06a7f43c-6ae4-4488-89d3-a5236bf3c6dc tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9.6bfb72a7-bdf8-4f84-b710-21f0b9a4e8a3" returned: 0 in 0.831s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:26 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-06a7f43c-6ae4-4488-89d3-a5236bf3c6dc tempest-ProjectReaderTests-787132287 None] Lock "cinder-quobyte-6bfb72a7-bdf8-4f84-b710-21f0b9a4e8a3" released by "_delete_snapshot" :: held 3.922s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:46:26 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-06a7f43c-6ae4-4488-89d3-a5236bf3c6dc tempest-ProjectReaderTests-787132287 None] Lock "cinder-quobyte-77a221c4-b771-4276-a0a1-d29106c9f2f9" released by "delete_snapshot" :: held 4.035s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:46:26 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-06a7f43c-6ae4-4488-89d3-a5236bf3c6dc tempest-ProjectReaderTests-787132287 None] Created reservations ['0c0edbf5-77a9-4426-a1c3-e91fc907daf4', '0b340221-4629-4b47-b59d-09ec321695e7', 'b6fa78e1-e6dc-4df8-ab4a-c4ff57941bca', 'b15369b0-22f4-406f-8dee-1be7043f78b0'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:46:26 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-06a7f43c-6ae4-4488-89d3-a5236bf3c6dc tempest-ProjectReaderTests-787132287 None] Delete snapshot completed successfully. Jul 11 04:46:26 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-06a7f43c-6ae4-4488-89d3-a5236bf3c6dc tempest-ProjectReaderTests-787132287 None] Lock "cinder-6bfb72a7-bdf8-4f84-b710-21f0b9a4e8a3-delete_snapshot" released by "delete_snapshot" :: held 4.372s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:46:27 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6b2aa596-c595-4bd5-8c26-76dca9fcc6ea tempest-ProjectReaderTests-1896276487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-de108658-e838-4868-90f1-a43acb52a5c9" returned: 0 in 0.936s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6b2aa596-c595-4bd5-8c26-76dca9fcc6ea tempest-ProjectReaderTests-1896276487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-de108658-e838-4868-90f1-a43acb52a5c9 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:27 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-de108658-e838-4868-90f1-a43acb52a5c9 Jul 11 04:46:27 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:27 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1f3202be-9af3-4f73-b08b-752c5668f0b4 tempest-ProjectReaderTests-787132287 None] Acquiring lock "cinder-77a221c4-b771-4276-a0a1-d29106c9f2f9-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:46:27 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1f3202be-9af3-4f73-b08b-752c5668f0b4 tempest-ProjectReaderTests-787132287 None] Lock "cinder-77a221c4-b771-4276-a0a1-d29106c9f2f9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:46:27 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1f3202be-9af3-4f73-b08b-752c5668f0b4 tempest-ProjectReaderTests-787132287 None] Acquiring lock "cinder-quobyte-77a221c4-b771-4276-a0a1-d29106c9f2f9" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:46:27 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1f3202be-9af3-4f73-b08b-752c5668f0b4 tempest-ProjectReaderTests-787132287 None] Lock "cinder-quobyte-77a221c4-b771-4276-a0a1-d29106c9f2f9" acquired by "delete_volume" :: waited 0.016s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:46:28 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6b2aa596-c595-4bd5-8c26-76dca9fcc6ea tempest-ProjectReaderTests-1896276487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-de108658-e838-4868-90f1-a43acb52a5c9" returned: 0 in 0.736s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:28 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6b2aa596-c595-4bd5-8c26-76dca9fcc6ea tempest-ProjectReaderTests-1896276487 None] Lock "cinder-quobyte-de108658-e838-4868-90f1-a43acb52a5c9" released by "delete_volume" :: held 1.726s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:46:28 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23dcc72-80e2-484f-b9f7-15470be56e70]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:46:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1f3202be-9af3-4f73-b08b-752c5668f0b4 tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:28 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-6b2aa596-c595-4bd5-8c26-76dca9fcc6ea tempest-ProjectReaderTests-1896276487 None] Created reservations ['47ba0756-fbcb-432e-8126-4f9e5efbfe23', '1e6f42cb-aaa7-48ba-8f59-3aa6ee37f957', 'f3063367-bce9-442d-8a1e-c0364f0d8fb7', 'd82366fe-73cb-4f18-b00f-af0f1cd36e99'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:46:28 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9 Jul 11 04:46:28 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-d4af6519-d659-4ad7-b9fc-8a24e7e41742 tempest-ProjectAdminTests-456498077 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.726375579834, 'free_capacity_gb': 1775.726375579834, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86964) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 11 04:46:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6b2aa596-c595-4bd5-8c26-76dca9fcc6ea tempest-ProjectReaderTests-1896276487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:46:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6b2aa596-c595-4bd5-8c26-76dca9fcc6ea tempest-ProjectReaderTests-1896276487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:46:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6b2aa596-c595-4bd5-8c26-76dca9fcc6ea tempest-ProjectReaderTests-1896276487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:46:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-6b2aa596-c595-4bd5-8c26-76dca9fcc6ea tempest-ProjectReaderTests-1896276487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:46:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6b2aa596-c595-4bd5-8c26-76dca9fcc6ea tempest-ProjectReaderTests-1896276487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:46:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6b2aa596-c595-4bd5-8c26-76dca9fcc6ea tempest-ProjectReaderTests-1896276487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:28 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:46:28 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:29 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1f3202be-9af3-4f73-b08b-752c5668f0b4 tempest-ProjectReaderTests-787132287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9" returned: 0 in 1.050s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1f3202be-9af3-4f73-b08b-752c5668f0b4 tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:29 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6b2aa596-c595-4bd5-8c26-76dca9fcc6ea tempest-ProjectReaderTests-1896276487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.934s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:29 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-6b2aa596-c595-4bd5-8c26-76dca9fcc6ea tempest-ProjectReaderTests-1896276487 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:46:29 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9 Jul 11 04:46:29 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:29 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-6b2aa596-c595-4bd5-8c26-76dca9fcc6ea tempest-ProjectReaderTests-1896276487 None] Deleted volume successfully. Jul 11 04:46:29 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-6b2aa596-c595-4bd5-8c26-76dca9fcc6ea tempest-ProjectReaderTests-1896276487 None] Lock "cinder-de108658-e838-4868-90f1-a43acb52a5c9-delete_volume" released by "delete_volume" :: held 3.016s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:46:29 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-60ff16a0-70e4-43b9-a1f9-29c283b10782 tempest-ProjectReaderTests-1896276487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:46:29 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-60ff16a0-70e4-43b9-a1f9-29c283b10782 tempest-ProjectReaderTests-1896276487 None] Flow 'volume_create_manager' (6e4110c2-b8c1-49c6-952f-2ee32a6463ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:46:29 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-60ff16a0-70e4-43b9-a1f9-29c283b10782 tempest-ProjectReaderTests-1896276487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99e5d46f-16b0-4e50-8659-5682eddbb568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:29 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-60ff16a0-70e4-43b9-a1f9-29c283b10782 tempest-ProjectReaderTests-1896276487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99e5d46f-16b0-4e50-8659-5682eddbb568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-376836413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a6568cc-86c3-4fbf-8090-173d3d7a0699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='045479645f564c83ae6f4bf11f328992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:46:29Z,use_quota=True,user_id='a93e4379c0eb4ec2ad7d9e21e71bca20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:29 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-60ff16a0-70e4-43b9-a1f9-29c283b10782 tempest-ProjectReaderTests-1896276487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ed6edb4-1a6e-4fa2-a1ca-e56e87954e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:29 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-60ff16a0-70e4-43b9-a1f9-29c283b10782 tempest-ProjectReaderTests-1896276487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ed6edb4-1a6e-4fa2-a1ca-e56e87954e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:29 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-60ff16a0-70e4-43b9-a1f9-29c283b10782 tempest-ProjectReaderTests-1896276487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac0c4253-8393-4547-a05d-5663c297451d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:29 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-60ff16a0-70e4-43b9-a1f9-29c283b10782 tempest-ProjectReaderTests-1896276487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac0c4253-8393-4547-a05d-5663c297451d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a6568cc-86c3-4fbf-8090-173d3d7a0699', 'volume_name': 'volume-8a6568cc-86c3-4fbf-8090-173d3d7a0699', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:29 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-60ff16a0-70e4-43b9-a1f9-29c283b10782 tempest-ProjectReaderTests-1896276487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afd8ed47-a279-4720-883c-f55adcaf212c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:29 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-60ff16a0-70e4-43b9-a1f9-29c283b10782 tempest-ProjectReaderTests-1896276487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afd8ed47-a279-4720-883c-f55adcaf212c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:29 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-60ff16a0-70e4-43b9-a1f9-29c283b10782 tempest-ProjectReaderTests-1896276487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c72daf2f-c5e7-470e-a291-b70c6f96b8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:29 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-60ff16a0-70e4-43b9-a1f9-29c283b10782 tempest-ProjectReaderTests-1896276487 None] Volume 8a6568cc-86c3-4fbf-8090-173d3d7a0699: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a6568cc-86c3-4fbf-8090-173d3d7a0699', 'volume_size': 1} Jul 11 04:46:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-60ff16a0-70e4-43b9-a1f9-29c283b10782 tempest-ProjectReaderTests-1896276487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:46:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-60ff16a0-70e4-43b9-a1f9-29c283b10782 tempest-ProjectReaderTests-1896276487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:46:29 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-60ff16a0-70e4-43b9-a1f9-29c283b10782 tempest-ProjectReaderTests-1896276487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-376836413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a6568cc-86c3-4fbf-8090-173d3d7a0699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='045479645f564c83ae6f4bf11f328992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:46:29Z,use_quota=True,user_id='a93e4379c0eb4ec2ad7d9e21e71bca20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:46:29 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-60ff16a0-70e4-43b9-a1f9-29c283b10782 tempest-ProjectReaderTests-1896276487 None] Creating volume 8a6568cc-86c3-4fbf-8090-173d3d7a0699 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:46:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-60ff16a0-70e4-43b9-a1f9-29c283b10782 tempest-ProjectReaderTests-1896276487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:46:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-60ff16a0-70e4-43b9-a1f9-29c283b10782 tempest-ProjectReaderTests-1896276487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:46:29 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-60ff16a0-70e4-43b9-a1f9-29c283b10782 tempest-ProjectReaderTests-1896276487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:46:29 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-60ff16a0-70e4-43b9-a1f9-29c283b10782 tempest-ProjectReaderTests-1896276487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:46:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-60ff16a0-70e4-43b9-a1f9-29c283b10782 tempest-ProjectReaderTests-1896276487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:46:29 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-60ff16a0-70e4-43b9-a1f9-29c283b10782 tempest-ProjectReaderTests-1896276487 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:46:29 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-60ff16a0-70e4-43b9-a1f9-29c283b10782 tempest-ProjectReaderTests-1896276487 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:46:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-60ff16a0-70e4-43b9-a1f9-29c283b10782 tempest-ProjectReaderTests-1896276487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8a6568cc-86c3-4fbf-8090-173d3d7a0699 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:29 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8a6568cc-86c3-4fbf-8090-173d3d7a0699 1073741824 Jul 11 04:46:29 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:30 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1f3202be-9af3-4f73-b08b-752c5668f0b4 tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77a221c4-b771-4276-a0a1-d29106c9f2f9" returned: 0 in 0.931s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:30 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1f3202be-9af3-4f73-b08b-752c5668f0b4 tempest-ProjectReaderTests-787132287 None] Lock "cinder-quobyte-77a221c4-b771-4276-a0a1-d29106c9f2f9" released by "delete_volume" :: held 2.068s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:46:30 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-1f3202be-9af3-4f73-b08b-752c5668f0b4 tempest-ProjectReaderTests-787132287 None] Created reservations ['5ae8fc5d-0e37-496f-9015-0248a4735245', '23b122ce-ec90-4cbf-8175-7ddbb1330a3b', '08d93c36-999b-4a4a-993b-a9970b7af32c', '4122b17b-1277-4d2f-99db-cacd65be597f'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:46:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1f3202be-9af3-4f73-b08b-752c5668f0b4 tempest-ProjectReaderTests-787132287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:46:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1f3202be-9af3-4f73-b08b-752c5668f0b4 tempest-ProjectReaderTests-787132287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:46:30 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-1f3202be-9af3-4f73-b08b-752c5668f0b4 tempest-ProjectReaderTests-787132287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:46:30 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-1f3202be-9af3-4f73-b08b-752c5668f0b4 tempest-ProjectReaderTests-787132287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:46:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-1f3202be-9af3-4f73-b08b-752c5668f0b4 tempest-ProjectReaderTests-787132287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:46:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1f3202be-9af3-4f73-b08b-752c5668f0b4 tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:30 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:46:30 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:30 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-99b4f0a3-427f-4c6d-b82a-c6f7bc5961b6 tempest-SnapshotDependencyTests-1400697379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:46:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-99b4f0a3-427f-4c6d-b82a-c6f7bc5961b6 tempest-SnapshotDependencyTests-1400697379 None] Flow 'volume_create_manager' (ba9d664d-94a9-41f4-ac7e-64a0159ccddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:46:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-99b4f0a3-427f-4c6d-b82a-c6f7bc5961b6 tempest-SnapshotDependencyTests-1400697379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bdfb8ae-6ddf-4a4b-9d86-390b046ef68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:30 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-60ff16a0-70e4-43b9-a1f9-29c283b10782 tempest-ProjectReaderTests-1896276487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8a6568cc-86c3-4fbf-8090-173d3d7a0699 1073741824" returned: 0 in 1.271s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-99b4f0a3-427f-4c6d-b82a-c6f7bc5961b6 tempest-SnapshotDependencyTests-1400697379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bdfb8ae-6ddf-4a4b-9d86-390b046ef68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1785185120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ee11091-2749-4bd4-b3ea-ff5f531a2fd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9abc3a901774d698b4de133d868e5fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:46:31Z,use_quota=True,user_id='5e13e0c311214e3eb75c2770d9f3e440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-99b4f0a3-427f-4c6d-b82a-c6f7bc5961b6 tempest-SnapshotDependencyTests-1400697379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34e779e5-a710-445e-a6d2-747681626fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-99b4f0a3-427f-4c6d-b82a-c6f7bc5961b6 tempest-SnapshotDependencyTests-1400697379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34e779e5-a710-445e-a6d2-747681626fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-99b4f0a3-427f-4c6d-b82a-c6f7bc5961b6 tempest-SnapshotDependencyTests-1400697379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d51d518d-3560-426b-b4e2-ea86599bbd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-99b4f0a3-427f-4c6d-b82a-c6f7bc5961b6 tempest-SnapshotDependencyTests-1400697379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d51d518d-3560-426b-b4e2-ea86599bbd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ee11091-2749-4bd4-b3ea-ff5f531a2fd2', 'volume_name': 'volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-99b4f0a3-427f-4c6d-b82a-c6f7bc5961b6 tempest-SnapshotDependencyTests-1400697379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a219ad4-69c4-4ff4-ab1a-688b6cb208bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-99b4f0a3-427f-4c6d-b82a-c6f7bc5961b6 tempest-SnapshotDependencyTests-1400697379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a219ad4-69c4-4ff4-ab1a-688b6cb208bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-99b4f0a3-427f-4c6d-b82a-c6f7bc5961b6 tempest-SnapshotDependencyTests-1400697379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d4d0e3-88f3-466b-bffd-9ceb059a3def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:30 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-99b4f0a3-427f-4c6d-b82a-c6f7bc5961b6 tempest-SnapshotDependencyTests-1400697379 None] Volume 2ee11091-2749-4bd4-b3ea-ff5f531a2fd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2', 'volume_size': 1} Jul 11 04:46:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-99b4f0a3-427f-4c6d-b82a-c6f7bc5961b6 tempest-SnapshotDependencyTests-1400697379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:46:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-60ff16a0-70e4-43b9-a1f9-29c283b10782 tempest-ProjectReaderTests-1896276487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8a6568cc-86c3-4fbf-8090-173d3d7a0699 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:30 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8a6568cc-86c3-4fbf-8090-173d3d7a0699 Jul 11 04:46:30 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:31 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1f3202be-9af3-4f73-b08b-752c5668f0b4 tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.786s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:31 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-1f3202be-9af3-4f73-b08b-752c5668f0b4 tempest-ProjectReaderTests-787132287 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:46:31 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-1f3202be-9af3-4f73-b08b-752c5668f0b4 tempest-ProjectReaderTests-787132287 None] Deleted volume successfully. Jul 11 04:46:31 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1f3202be-9af3-4f73-b08b-752c5668f0b4 tempest-ProjectReaderTests-787132287 None] Lock "cinder-77a221c4-b771-4276-a0a1-d29106c9f2f9-delete_volume" released by "delete_volume" :: held 3.163s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:46:31 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-60ff16a0-70e4-43b9-a1f9-29c283b10782 tempest-ProjectReaderTests-1896276487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8a6568cc-86c3-4fbf-8090-173d3d7a0699" returned: 0 in 0.709s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:31 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-60ff16a0-70e4-43b9-a1f9-29c283b10782 tempest-ProjectReaderTests-1896276487 None] <== create_volume: return (2080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:46:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-60ff16a0-70e4-43b9-a1f9-29c283b10782 tempest-ProjectReaderTests-1896276487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.083s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:46:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-99b4f0a3-427f-4c6d-b82a-c6f7bc5961b6 tempest-SnapshotDependencyTests-1400697379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.739s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:46:31 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-99b4f0a3-427f-4c6d-b82a-c6f7bc5961b6 tempest-SnapshotDependencyTests-1400697379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1785185120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ee11091-2749-4bd4-b3ea-ff5f531a2fd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9abc3a901774d698b4de133d868e5fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:46:31Z,use_quota=True,user_id='5e13e0c311214e3eb75c2770d9f3e440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:46:31 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-99b4f0a3-427f-4c6d-b82a-c6f7bc5961b6 tempest-SnapshotDependencyTests-1400697379 None] Creating volume 2ee11091-2749-4bd4-b3ea-ff5f531a2fd2 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:46:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-99b4f0a3-427f-4c6d-b82a-c6f7bc5961b6 tempest-SnapshotDependencyTests-1400697379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:46:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-99b4f0a3-427f-4c6d-b82a-c6f7bc5961b6 tempest-SnapshotDependencyTests-1400697379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:46:31 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-99b4f0a3-427f-4c6d-b82a-c6f7bc5961b6 tempest-SnapshotDependencyTests-1400697379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:46:31 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-99b4f0a3-427f-4c6d-b82a-c6f7bc5961b6 tempest-SnapshotDependencyTests-1400697379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:46:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-99b4f0a3-427f-4c6d-b82a-c6f7bc5961b6 tempest-SnapshotDependencyTests-1400697379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:46:31 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-99b4f0a3-427f-4c6d-b82a-c6f7bc5961b6 tempest-SnapshotDependencyTests-1400697379 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:46:31 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-99b4f0a3-427f-4c6d-b82a-c6f7bc5961b6 tempest-SnapshotDependencyTests-1400697379 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:46:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-99b4f0a3-427f-4c6d-b82a-c6f7bc5961b6 tempest-SnapshotDependencyTests-1400697379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:31 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2 1073741824 Jul 11 04:46:31 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:31 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-60ff16a0-70e4-43b9-a1f9-29c283b10782 tempest-ProjectReaderTests-1896276487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c72daf2f-c5e7-470e-a291-b70c6f96b8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a6568cc-86c3-4fbf-8090-173d3d7a0699', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:31 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-60ff16a0-70e4-43b9-a1f9-29c283b10782 tempest-ProjectReaderTests-1896276487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7219f74-a760-40b9-8498-2939a70066cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:31 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-60ff16a0-70e4-43b9-a1f9-29c283b10782 tempest-ProjectReaderTests-1896276487 None] Volume volume-8a6568cc-86c3-4fbf-8090-173d3d7a0699 (8a6568cc-86c3-4fbf-8090-173d3d7a0699): created successfully Jul 11 04:46:31 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-60ff16a0-70e4-43b9-a1f9-29c283b10782 tempest-ProjectReaderTests-1896276487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7219f74-a760-40b9-8498-2939a70066cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:31 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-60ff16a0-70e4-43b9-a1f9-29c283b10782 tempest-ProjectReaderTests-1896276487 None] Flow 'volume_create_manager' (6e4110c2-b8c1-49c6-952f-2ee32a6463ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:46:31 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-60ff16a0-70e4-43b9-a1f9-29c283b10782 tempest-ProjectReaderTests-1896276487 None] Created volume successfully. Jul 11 04:46:31 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ec65822-4499-4be8-8e29-03b345358aa3 tempest-ProjectReaderTests-787132287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:46:31 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2ec65822-4499-4be8-8e29-03b345358aa3 tempest-ProjectReaderTests-787132287 None] Flow 'volume_create_manager' (7c02a1d3-8d7a-4b7d-af62-3638fe967a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:46:31 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2ec65822-4499-4be8-8e29-03b345358aa3 tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e68d686f-0212-406d-a179-6a2bf86429c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:31 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2ec65822-4499-4be8-8e29-03b345358aa3 tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e68d686f-0212-406d-a179-6a2bf86429c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1892904267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae329244-6522-406d-b443-33ee90f03d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36dcca031e5d4245aed8aadd7b6f88e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:46:32Z,use_quota=True,user_id='ee6e4107301b44a98a0fdd41aead55f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:31 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2ec65822-4499-4be8-8e29-03b345358aa3 tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (905bd6f7-55ff-4219-a0db-c8a94aee604b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:31 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2ec65822-4499-4be8-8e29-03b345358aa3 tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (905bd6f7-55ff-4219-a0db-c8a94aee604b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:31 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2ec65822-4499-4be8-8e29-03b345358aa3 tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c47618fe-7367-458d-b8ca-4cea90bd3915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:31 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2ec65822-4499-4be8-8e29-03b345358aa3 tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c47618fe-7367-458d-b8ca-4cea90bd3915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae329244-6522-406d-b443-33ee90f03d8a', 'volume_name': 'volume-ae329244-6522-406d-b443-33ee90f03d8a', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:31 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2ec65822-4499-4be8-8e29-03b345358aa3 tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72cdb73e-9943-44b6-bade-d2b4f6b9f701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:31 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2ec65822-4499-4be8-8e29-03b345358aa3 tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72cdb73e-9943-44b6-bade-d2b4f6b9f701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:31 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2ec65822-4499-4be8-8e29-03b345358aa3 tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64115638-ea21-43a5-b4a6-d561f5ac3910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:31 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-2ec65822-4499-4be8-8e29-03b345358aa3 tempest-ProjectReaderTests-787132287 None] Volume ae329244-6522-406d-b443-33ee90f03d8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae329244-6522-406d-b443-33ee90f03d8a', 'volume_size': 1} Jul 11 04:46:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2ec65822-4499-4be8-8e29-03b345358aa3 tempest-ProjectReaderTests-787132287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:46:32 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b2f97cc3-d9ef-4294-b8f5-298f2ae8a319 tempest-ProjectReaderTests-1896276487 None] Acquiring lock "cinder-8a6568cc-86c3-4fbf-8090-173d3d7a0699-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:46:32 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:32 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b2f97cc3-d9ef-4294-b8f5-298f2ae8a319 tempest-ProjectReaderTests-1896276487 None] Lock "cinder-8a6568cc-86c3-4fbf-8090-173d3d7a0699-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:46:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-99b4f0a3-427f-4c6d-b82a-c6f7bc5961b6 tempest-SnapshotDependencyTests-1400697379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2 1073741824" returned: 0 in 0.986s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:32 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b2f97cc3-d9ef-4294-b8f5-298f2ae8a319 tempest-ProjectReaderTests-1896276487 None] Acquiring lock "cinder-quobyte-8a6568cc-86c3-4fbf-8090-173d3d7a0699" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:46:32 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b2f97cc3-d9ef-4294-b8f5-298f2ae8a319 tempest-ProjectReaderTests-1896276487 None] Lock "cinder-quobyte-8a6568cc-86c3-4fbf-8090-173d3d7a0699" acquired by "delete_volume" :: waited 0.020s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:46:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-99b4f0a3-427f-4c6d-b82a-c6f7bc5961b6 tempest-SnapshotDependencyTests-1400697379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:32 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[20da1654-4e1f-4aed-8814-cc31e98148a3]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:46:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b2f97cc3-d9ef-4294-b8f5-298f2ae8a319 tempest-ProjectReaderTests-1896276487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8a6568cc-86c3-4fbf-8090-173d3d7a0699 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:32 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2 Jul 11 04:46:32 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:32 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8a6568cc-86c3-4fbf-8090-173d3d7a0699 Jul 11 04:46:32 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:33 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-99b4f0a3-427f-4c6d-b82a-c6f7bc5961b6 tempest-SnapshotDependencyTests-1400697379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2" returned: 0 in 0.704s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:33 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-99b4f0a3-427f-4c6d-b82a-c6f7bc5961b6 tempest-SnapshotDependencyTests-1400697379 None] <== create_volume: return (1776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:46:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-99b4f0a3-427f-4c6d-b82a-c6f7bc5961b6 tempest-SnapshotDependencyTests-1400697379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:46:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2ec65822-4499-4be8-8e29-03b345358aa3 tempest-ProjectReaderTests-787132287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.382s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:46:33 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2ec65822-4499-4be8-8e29-03b345358aa3 tempest-ProjectReaderTests-787132287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1892904267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae329244-6522-406d-b443-33ee90f03d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36dcca031e5d4245aed8aadd7b6f88e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:46:32Z,use_quota=True,user_id='ee6e4107301b44a98a0fdd41aead55f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:46:33 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-2ec65822-4499-4be8-8e29-03b345358aa3 tempest-ProjectReaderTests-787132287 None] Creating volume ae329244-6522-406d-b443-33ee90f03d8a {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:46:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2ec65822-4499-4be8-8e29-03b345358aa3 tempest-ProjectReaderTests-787132287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:46:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2ec65822-4499-4be8-8e29-03b345358aa3 tempest-ProjectReaderTests-787132287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:46:33 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2ec65822-4499-4be8-8e29-03b345358aa3 tempest-ProjectReaderTests-787132287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:46:33 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2ec65822-4499-4be8-8e29-03b345358aa3 tempest-ProjectReaderTests-787132287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:46:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2ec65822-4499-4be8-8e29-03b345358aa3 tempest-ProjectReaderTests-787132287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:46:33 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2ec65822-4499-4be8-8e29-03b345358aa3 tempest-ProjectReaderTests-787132287 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:46:33 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-2ec65822-4499-4be8-8e29-03b345358aa3 tempest-ProjectReaderTests-787132287 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:46:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2ec65822-4499-4be8-8e29-03b345358aa3 tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-99b4f0a3-427f-4c6d-b82a-c6f7bc5961b6 tempest-SnapshotDependencyTests-1400697379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d4d0e3-88f3-466b-bffd-9ceb059a3def) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-99b4f0a3-427f-4c6d-b82a-c6f7bc5961b6 tempest-SnapshotDependencyTests-1400697379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f37146-965f-44b2-ab19-d7719b19c022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:33 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a 1073741824 Jul 11 04:46:33 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:33 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-99b4f0a3-427f-4c6d-b82a-c6f7bc5961b6 tempest-SnapshotDependencyTests-1400697379 None] Volume volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2 (2ee11091-2749-4bd4-b3ea-ff5f531a2fd2): created successfully Jul 11 04:46:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-99b4f0a3-427f-4c6d-b82a-c6f7bc5961b6 tempest-SnapshotDependencyTests-1400697379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f37146-965f-44b2-ab19-d7719b19c022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-99b4f0a3-427f-4c6d-b82a-c6f7bc5961b6 tempest-SnapshotDependencyTests-1400697379 None] Flow 'volume_create_manager' (ba9d664d-94a9-41f4-ac7e-64a0159ccddb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:46:33 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-99b4f0a3-427f-4c6d-b82a-c6f7bc5961b6 tempest-SnapshotDependencyTests-1400697379 None] Created volume successfully. Jul 11 04:46:33 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-c80a6873-c407-4f8c-bb57-a1d39332bc17 tempest-ProjectMemberTests-908908227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:46:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c80a6873-c407-4f8c-bb57-a1d39332bc17 tempest-ProjectMemberTests-908908227 None] Flow 'volume_create_manager' (69be3488-131b-429b-9ff7-2b0139697a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:46:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c80a6873-c407-4f8c-bb57-a1d39332bc17 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d55e9155-38b7-428a-b3c0-4cf87408251a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c80a6873-c407-4f8c-bb57-a1d39332bc17 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d55e9155-38b7-428a-b3c0-4cf87408251a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-262609432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcdd55fb-0b45-4860-b289-0453c3d3d301,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab7832e09784b2e931b228228b2c95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:46:33Z,use_quota=True,user_id='dc1e9d4141f14bd6a58aebc9231b6fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:33 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c80a6873-c407-4f8c-bb57-a1d39332bc17 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eebc6d7c-17c0-40dd-b973-90e3f043e31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c80a6873-c407-4f8c-bb57-a1d39332bc17 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eebc6d7c-17c0-40dd-b973-90e3f043e31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c80a6873-c407-4f8c-bb57-a1d39332bc17 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7352d59d-a5e1-4fba-987b-c3c0848dbbe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c80a6873-c407-4f8c-bb57-a1d39332bc17 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7352d59d-a5e1-4fba-987b-c3c0848dbbe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcdd55fb-0b45-4860-b289-0453c3d3d301', 'volume_name': 'volume-dcdd55fb-0b45-4860-b289-0453c3d3d301', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c80a6873-c407-4f8c-bb57-a1d39332bc17 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4269f54-9040-4ba8-b78d-c84d03751664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c80a6873-c407-4f8c-bb57-a1d39332bc17 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4269f54-9040-4ba8-b78d-c84d03751664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:33 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c80a6873-c407-4f8c-bb57-a1d39332bc17 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4fbc2b2-1f1f-4eb5-a63f-2f89ca51740f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:33 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-c80a6873-c407-4f8c-bb57-a1d39332bc17 tempest-ProjectMemberTests-908908227 None] Volume dcdd55fb-0b45-4860-b289-0453c3d3d301: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcdd55fb-0b45-4860-b289-0453c3d3d301', 'volume_size': 1} Jul 11 04:46:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c80a6873-c407-4f8c-bb57-a1d39332bc17 tempest-ProjectMemberTests-908908227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:46:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b2f97cc3-d9ef-4294-b8f5-298f2ae8a319 tempest-ProjectReaderTests-1896276487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8a6568cc-86c3-4fbf-8090-173d3d7a0699" returned: 0 in 0.879s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b2f97cc3-d9ef-4294-b8f5-298f2ae8a319 tempest-ProjectReaderTests-1896276487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8a6568cc-86c3-4fbf-8090-173d3d7a0699 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:33 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8a6568cc-86c3-4fbf-8090-173d3d7a0699 Jul 11 04:46:33 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6f252c0a-b71b-49b6-8003-d5e105178798 tempest-SnapshotDependencyTests-1400697379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:46:34 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b2f97cc3-d9ef-4294-b8f5-298f2ae8a319 tempest-ProjectReaderTests-1896276487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-8a6568cc-86c3-4fbf-8090-173d3d7a0699" returned: 0 in 0.670s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b2f97cc3-d9ef-4294-b8f5-298f2ae8a319 tempest-ProjectReaderTests-1896276487 None] Lock "cinder-quobyte-8a6568cc-86c3-4fbf-8090-173d3d7a0699" released by "delete_volume" :: held 1.604s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:46:34 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2ec65822-4499-4be8-8e29-03b345358aa3 tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a 1073741824" returned: 0 in 0.882s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2ec65822-4499-4be8-8e29-03b345358aa3 tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:34 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-b2f97cc3-d9ef-4294-b8f5-298f2ae8a319 tempest-ProjectReaderTests-1896276487 None] Created reservations ['a0d2da65-ae4c-40b2-acee-1a4ecae637a7', '887c5f56-229e-443c-bafc-fc243ee7784a', '7bd8d04d-ece6-4949-b134-418faab9fe1c', 'f8e6c262-0c18-4c81-a897-397086dab91d'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:46:34 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a Jul 11 04:46:34 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b2f97cc3-d9ef-4294-b8f5-298f2ae8a319 tempest-ProjectReaderTests-1896276487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:46:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b2f97cc3-d9ef-4294-b8f5-298f2ae8a319 tempest-ProjectReaderTests-1896276487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:46:34 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b2f97cc3-d9ef-4294-b8f5-298f2ae8a319 tempest-ProjectReaderTests-1896276487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:46:34 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b2f97cc3-d9ef-4294-b8f5-298f2ae8a319 tempest-ProjectReaderTests-1896276487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:46:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b2f97cc3-d9ef-4294-b8f5-298f2ae8a319 tempest-ProjectReaderTests-1896276487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:46:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b2f97cc3-d9ef-4294-b8f5-298f2ae8a319 tempest-ProjectReaderTests-1896276487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:34 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:46:34 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:34 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2ec65822-4499-4be8-8e29-03b345358aa3 tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a" returned: 0 in 0.629s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:34 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2ec65822-4499-4be8-8e29-03b345358aa3 tempest-ProjectReaderTests-787132287 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:46:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2ec65822-4499-4be8-8e29-03b345358aa3 tempest-ProjectReaderTests-787132287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:46:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c80a6873-c407-4f8c-bb57-a1d39332bc17 tempest-ProjectMemberTests-908908227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.382s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:46:34 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c80a6873-c407-4f8c-bb57-a1d39332bc17 tempest-ProjectMemberTests-908908227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-262609432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcdd55fb-0b45-4860-b289-0453c3d3d301,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab7832e09784b2e931b228228b2c95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:46:33Z,use_quota=True,user_id='dc1e9d4141f14bd6a58aebc9231b6fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:46:34 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-c80a6873-c407-4f8c-bb57-a1d39332bc17 tempest-ProjectMemberTests-908908227 None] Creating volume dcdd55fb-0b45-4860-b289-0453c3d3d301 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:46:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c80a6873-c407-4f8c-bb57-a1d39332bc17 tempest-ProjectMemberTests-908908227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:46:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c80a6873-c407-4f8c-bb57-a1d39332bc17 tempest-ProjectMemberTests-908908227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:46:34 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c80a6873-c407-4f8c-bb57-a1d39332bc17 tempest-ProjectMemberTests-908908227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:46:34 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c80a6873-c407-4f8c-bb57-a1d39332bc17 tempest-ProjectMemberTests-908908227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:46:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c80a6873-c407-4f8c-bb57-a1d39332bc17 tempest-ProjectMemberTests-908908227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:46:34 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c80a6873-c407-4f8c-bb57-a1d39332bc17 tempest-ProjectMemberTests-908908227 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:46:34 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-c80a6873-c407-4f8c-bb57-a1d39332bc17 tempest-ProjectMemberTests-908908227 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:46:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c80a6873-c407-4f8c-bb57-a1d39332bc17 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:34 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2ec65822-4499-4be8-8e29-03b345358aa3 tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64115638-ea21-43a5-b4a6-d561f5ac3910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae329244-6522-406d-b443-33ee90f03d8a', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:34 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301 1073741824 Jul 11 04:46:34 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2ec65822-4499-4be8-8e29-03b345358aa3 tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca9721bd-2446-4ef4-9815-8701a5bc7f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:34 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:34 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=132,cinder:UPDATE=181,cinder:INSERT=57,cinder:DELETE=16 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:46:34 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-2ec65822-4499-4be8-8e29-03b345358aa3 tempest-ProjectReaderTests-787132287 None] Volume volume-ae329244-6522-406d-b443-33ee90f03d8a (ae329244-6522-406d-b443-33ee90f03d8a): created successfully Jul 11 04:46:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2ec65822-4499-4be8-8e29-03b345358aa3 tempest-ProjectReaderTests-787132287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca9721bd-2446-4ef4-9815-8701a5bc7f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:35 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2ec65822-4499-4be8-8e29-03b345358aa3 tempest-ProjectReaderTests-787132287 None] Flow 'volume_create_manager' (7c02a1d3-8d7a-4b7d-af62-3638fe967a24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:46:35 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-2ec65822-4499-4be8-8e29-03b345358aa3 tempest-ProjectReaderTests-787132287 None] Created volume successfully. Jul 11 04:46:35 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b2f97cc3-d9ef-4294-b8f5-298f2ae8a319 tempest-ProjectReaderTests-1896276487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.684s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:35 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-b2f97cc3-d9ef-4294-b8f5-298f2ae8a319 tempest-ProjectReaderTests-1896276487 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:46:35 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-b2f97cc3-d9ef-4294-b8f5-298f2ae8a319 tempest-ProjectReaderTests-1896276487 None] Deleted volume successfully. Jul 11 04:46:35 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b2f97cc3-d9ef-4294-b8f5-298f2ae8a319 tempest-ProjectReaderTests-1896276487 None] Lock "cinder-8a6568cc-86c3-4fbf-8090-173d3d7a0699-delete_volume" released by "delete_volume" :: held 2.533s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:46:35 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c80a6873-c407-4f8c-bb57-a1d39332bc17 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301 1073741824" returned: 0 in 0.923s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c80a6873-c407-4f8c-bb57-a1d39332bc17 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:35 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301 Jul 11 04:46:35 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:36 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=138,cinder:INSERT=44,cinder:UPDATE=173,cinder:DELETE=13 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:46:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-dab0f8fe-6890-4460-b0bd-8e51981102b4 tempest-ProjectReaderTests-787132287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:46:36 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c80a6873-c407-4f8c-bb57-a1d39332bc17 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301" returned: 0 in 0.692s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c80a6873-c407-4f8c-bb57-a1d39332bc17 tempest-ProjectMemberTests-908908227 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:46:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c80a6873-c407-4f8c-bb57-a1d39332bc17 tempest-ProjectMemberTests-908908227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:46:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6f252c0a-b71b-49b6-8003-d5e105178798 tempest-SnapshotDependencyTests-1400697379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.459s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:46:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c80a6873-c407-4f8c-bb57-a1d39332bc17 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4fbc2b2-1f1f-4eb5-a63f-2f89ca51740f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcdd55fb-0b45-4860-b289-0453c3d3d301', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c80a6873-c407-4f8c-bb57-a1d39332bc17 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf3c72bc-5ab1-48be-9284-5dfc4e5d0d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-6f252c0a-b71b-49b6-8003-d5e105178798 tempest-SnapshotDependencyTests-1400697379 None] Creating offline snapshot 6f2af6cd-43dd-425a-8ae7-45c99dae2e76 of volume 2ee11091-2749-4bd4-b3ea-ff5f531a2fd2 {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:46:36 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-c80a6873-c407-4f8c-bb57-a1d39332bc17 tempest-ProjectMemberTests-908908227 None] Volume volume-dcdd55fb-0b45-4860-b289-0453c3d3d301 (dcdd55fb-0b45-4860-b289-0453c3d3d301): created successfully Jul 11 04:46:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c80a6873-c407-4f8c-bb57-a1d39332bc17 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf3c72bc-5ab1-48be-9284-5dfc4e5d0d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:36 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c80a6873-c407-4f8c-bb57-a1d39332bc17 tempest-ProjectMemberTests-908908227 None] Flow 'volume_create_manager' (69be3488-131b-429b-9ff7-2b0139697a91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:46:36 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcfa30e-45aa-4a9d-9cd7-b250ac3acf04]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:46:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6f252c0a-b71b-49b6-8003-d5e105178798 tempest-SnapshotDependencyTests-1400697379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:36 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-c80a6873-c407-4f8c-bb57-a1d39332bc17 tempest-ProjectMemberTests-908908227 None] Created volume successfully. Jul 11 04:46:36 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2 Jul 11 04:46:36 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:37 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6f252c0a-b71b-49b6-8003-d5e105178798 tempest-SnapshotDependencyTests-1400697379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2" returned: 0 in 0.778s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6f252c0a-b71b-49b6-8003-d5e105178798 tempest-SnapshotDependencyTests-1400697379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2.6f2af6cd-43dd-425a-8ae7-45c99dae2e76 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:37 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2.6f2af6cd-43dd-425a-8ae7-45c99dae2e76 1G Jul 11 04:46:37 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-66c911d1-cb0d-43bc-832b-e15bf2685a14 tempest-ProjectMemberTests-908908227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:46:38 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6f252c0a-b71b-49b6-8003-d5e105178798 tempest-SnapshotDependencyTests-1400697379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2.6f2af6cd-43dd-425a-8ae7-45c99dae2e76 1G" returned: 0 in 0.874s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6f252c0a-b71b-49b6-8003-d5e105178798 tempest-SnapshotDependencyTests-1400697379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2.6f2af6cd-43dd-425a-8ae7-45c99dae2e76 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:38 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2.6f2af6cd-43dd-425a-8ae7-45c99dae2e76 Jul 11 04:46:38 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:39 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6f252c0a-b71b-49b6-8003-d5e105178798 tempest-SnapshotDependencyTests-1400697379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2.6f2af6cd-43dd-425a-8ae7-45c99dae2e76" returned: 0 in 0.707s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:39 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-6f252c0a-b71b-49b6-8003-d5e105178798 tempest-SnapshotDependencyTests-1400697379 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2.6f2af6cd-43dd-425a-8ae7-45c99dae2e76 is being set with open permissions: ugo+rw Jul 11 04:46:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6f252c0a-b71b-49b6-8003-d5e105178798 tempest-SnapshotDependencyTests-1400697379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2.6f2af6cd-43dd-425a-8ae7-45c99dae2e76 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:39 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2.6f2af6cd-43dd-425a-8ae7-45c99dae2e76 Jul 11 04:46:39 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:39 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6f252c0a-b71b-49b6-8003-d5e105178798 tempest-SnapshotDependencyTests-1400697379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2.6f2af6cd-43dd-425a-8ae7-45c99dae2e76" returned: 0 in 0.659s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6f252c0a-b71b-49b6-8003-d5e105178798 tempest-SnapshotDependencyTests-1400697379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:39 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2.info Jul 11 04:46:39 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:40 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6f252c0a-b71b-49b6-8003-d5e105178798 tempest-SnapshotDependencyTests-1400697379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2.info" returned: 0 in 0.719s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:40 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-6f252c0a-b71b-49b6-8003-d5e105178798 tempest-SnapshotDependencyTests-1400697379 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2.info is being set with open permissions: ugo+rw Jul 11 04:46:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6f252c0a-b71b-49b6-8003-d5e105178798 tempest-SnapshotDependencyTests-1400697379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:40 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2.info Jul 11 04:46:40 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:41 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-6f252c0a-b71b-49b6-8003-d5e105178798 tempest-SnapshotDependencyTests-1400697379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2.info" returned: 0 in 0.650s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-6f252c0a-b71b-49b6-8003-d5e105178798 tempest-SnapshotDependencyTests-1400697379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.504s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:46:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-dab0f8fe-6890-4460-b0bd-8e51981102b4 tempest-ProjectReaderTests-787132287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.787s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:46:41 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-dab0f8fe-6890-4460-b0bd-8e51981102b4 tempest-ProjectReaderTests-787132287 None] Creating offline snapshot b7124128-5a04-4878-a199-1df87d516614 of volume ae329244-6522-406d-b443-33ee90f03d8a {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:46:41 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d351cc-cf40-4947-b836-fe2ae481aaa9]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:46:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dab0f8fe-6890-4460-b0bd-8e51981102b4 tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:41 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-6f252c0a-b71b-49b6-8003-d5e105178798 tempest-SnapshotDependencyTests-1400697379 None] Create snapshot completed successfully Jul 11 04:46:41 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a Jul 11 04:46:41 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:41 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dab0f8fe-6890-4460-b0bd-8e51981102b4 tempest-ProjectReaderTests-787132287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a" returned: 0 in 0.792s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dab0f8fe-6890-4460-b0bd-8e51981102b4 tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a.b7124128-5a04-4878-a199-1df87d516614 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:41 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a.b7124128-5a04-4878-a199-1df87d516614 1G Jul 11 04:46:41 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:41 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:46:42 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Flow 'volume_create_manager' (8fd3ccdd-9ab0-456f-8eb8-93f2a9b5e9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:46:42 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af468942-4f13-4103-be23-9773baa531d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:42 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af468942-4f13-4103-be23-9773baa531d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d861f777-039f-4630-a312-430441e99a0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9abc3a901774d698b4de133d868e5fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6f2af6cd-43dd-425a-8ae7-45c99dae2e76,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:46:42Z,use_quota=True,user_id='5e13e0c311214e3eb75c2770d9f3e440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:42 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1353356-5fdf-4be6-937d-9763a3bcc996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:42 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1353356-5fdf-4be6-937d-9763a3bcc996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:42 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c533c05b-4abf-48a7-ac93-e72840cfd471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:42 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c533c05b-4abf-48a7-ac93-e72840cfd471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd861f777-039f-4630-a312-430441e99a0e', 'volume_name': 'volume-d861f777-039f-4630-a312-430441e99a0e', 'volume_size': 1, 'snapshot_id': '6f2af6cd-43dd-425a-8ae7-45c99dae2e76'}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:42 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cc0a608-02fe-4961-9f65-01c7b39c9174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:42 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cc0a608-02fe-4961-9f65-01c7b39c9174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:42 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f05f27-0003-4980-b7a1-8ffd08267fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:42 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Volume d861f777-039f-4630-a312-430441e99a0e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d861f777-039f-4630-a312-430441e99a0e', 'volume_size': 1, 'snapshot_id': '6f2af6cd-43dd-425a-8ae7-45c99dae2e76'} Jul 11 04:46:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:46:42 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dab0f8fe-6890-4460-b0bd-8e51981102b4 tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a.b7124128-5a04-4878-a199-1df87d516614 1G" returned: 0 in 0.776s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dab0f8fe-6890-4460-b0bd-8e51981102b4 tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae329244-6522-406d-b443-33ee90f03d8a -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a.b7124128-5a04-4878-a199-1df87d516614 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:42 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae329244-6522-406d-b443-33ee90f03d8a -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a.b7124128-5a04-4878-a199-1df87d516614 Jul 11 04:46:42 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:43 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dab0f8fe-6890-4460-b0bd-8e51981102b4 tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae329244-6522-406d-b443-33ee90f03d8a -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a.b7124128-5a04-4878-a199-1df87d516614" returned: 0 in 0.684s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:43 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-dab0f8fe-6890-4460-b0bd-8e51981102b4 tempest-ProjectReaderTests-787132287 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a.b7124128-5a04-4878-a199-1df87d516614 is being set with open permissions: ugo+rw Jul 11 04:46:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dab0f8fe-6890-4460-b0bd-8e51981102b4 tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a.b7124128-5a04-4878-a199-1df87d516614 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:43 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a.b7124128-5a04-4878-a199-1df87d516614 Jul 11 04:46:43 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:44 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dab0f8fe-6890-4460-b0bd-8e51981102b4 tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a.b7124128-5a04-4878-a199-1df87d516614" returned: 0 in 0.632s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dab0f8fe-6890-4460-b0bd-8e51981102b4 tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:44 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a.info Jul 11 04:46:44 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:44 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dab0f8fe-6890-4460-b0bd-8e51981102b4 tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a.info" returned: 0 in 0.641s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:44 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-dab0f8fe-6890-4460-b0bd-8e51981102b4 tempest-ProjectReaderTests-787132287 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a.info is being set with open permissions: ugo+rw Jul 11 04:46:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dab0f8fe-6890-4460-b0bd-8e51981102b4 tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:44 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a.info Jul 11 04:46:44 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:45 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dab0f8fe-6890-4460-b0bd-8e51981102b4 tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a.info" returned: 0 in 0.638s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-dab0f8fe-6890-4460-b0bd-8e51981102b4 tempest-ProjectReaderTests-787132287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.248s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:46:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-66c911d1-cb0d-43bc-832b-e15bf2685a14 tempest-ProjectMemberTests-908908227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.314s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:46:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-66c911d1-cb0d-43bc-832b-e15bf2685a14 tempest-ProjectMemberTests-908908227 None] Creating offline snapshot e6681c4e-36c4-448a-96ae-746842c163f0 of volume dcdd55fb-0b45-4860-b289-0453c3d3d301 {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:46:45 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-dab0f8fe-6890-4460-b0bd-8e51981102b4 tempest-ProjectReaderTests-787132287 None] Create snapshot completed successfully Jul 11 04:46:45 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[9099565f-0bb8-4a98-a2a9-4e96d26b38b4]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:46:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-66c911d1-cb0d-43bc-832b-e15bf2685a14 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:45 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301 Jul 11 04:46:45 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:45 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-12ac671c-035c-4c0d-b02e-d5dbc489833a tempest-ProjectReaderTests-787132287 None] Acquiring lock "cinder-b7124128-5a04-4878-a199-1df87d516614-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:46:45 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-12ac671c-035c-4c0d-b02e-d5dbc489833a tempest-ProjectReaderTests-787132287 None] Lock "cinder-b7124128-5a04-4878-a199-1df87d516614-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:46:45 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-12ac671c-035c-4c0d-b02e-d5dbc489833a tempest-ProjectReaderTests-787132287 None] Acquiring lock "cinder-quobyte-ae329244-6522-406d-b443-33ee90f03d8a" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:46:45 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-12ac671c-035c-4c0d-b02e-d5dbc489833a tempest-ProjectReaderTests-787132287 None] Lock "cinder-quobyte-ae329244-6522-406d-b443-33ee90f03d8a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:46:45 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-12ac671c-035c-4c0d-b02e-d5dbc489833a tempest-ProjectReaderTests-787132287 None] Acquiring lock "cinder-quobyte-b7124128-5a04-4878-a199-1df87d516614" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:46:45 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-12ac671c-035c-4c0d-b02e-d5dbc489833a tempest-ProjectReaderTests-787132287 None] Lock "cinder-quobyte-b7124128-5a04-4878-a199-1df87d516614" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:46:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-12ac671c-035c-4c0d-b02e-d5dbc489833a tempest-ProjectReaderTests-787132287 None] Deleting offline snapshot b7124128-5a04-4878-a199-1df87d516614 of volume ae329244-6522-406d-b443-33ee90f03d8a {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:46:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-12ac671c-035c-4c0d-b02e-d5dbc489833a tempest-ProjectReaderTests-787132287 None] snapshot_file for this snap is: volume-ae329244-6522-406d-b443-33ee90f03d8a.b7124128-5a04-4878-a199-1df87d516614 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:46:45 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[f057712f-9b0c-481b-8398-c89fd71981d5]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:46:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-12ac671c-035c-4c0d-b02e-d5dbc489833a tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a.b7124128-5a04-4878-a199-1df87d516614 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:45 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a.b7124128-5a04-4878-a199-1df87d516614 Jul 11 04:46:45 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:46 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-66c911d1-cb0d-43bc-832b-e15bf2685a14 tempest-ProjectMemberTests-908908227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301" returned: 0 in 0.804s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-66c911d1-cb0d-43bc-832b-e15bf2685a14 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301.e6681c4e-36c4-448a-96ae-746842c163f0 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:46 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301.e6681c4e-36c4-448a-96ae-746842c163f0 1G Jul 11 04:46:46 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:46 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-12ac671c-035c-4c0d-b02e-d5dbc489833a tempest-ProjectReaderTests-787132287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a.b7124128-5a04-4878-a199-1df87d516614" returned: 0 in 0.767s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:46 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-12ac671c-035c-4c0d-b02e-d5dbc489833a tempest-ProjectReaderTests-787132287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae329244-6522-406d-b443-33ee90f03d8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:46:46 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[897114c9-f96d-409c-95b9-e940ab82b00a]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:46:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-12ac671c-035c-4c0d-b02e-d5dbc489833a tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:46 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a Jul 11 04:46:46 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:46 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-66c911d1-cb0d-43bc-832b-e15bf2685a14 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301.e6681c4e-36c4-448a-96ae-746842c163f0 1G" returned: 0 in 0.790s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-66c911d1-cb0d-43bc-832b-e15bf2685a14 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcdd55fb-0b45-4860-b289-0453c3d3d301 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301.e6681c4e-36c4-448a-96ae-746842c163f0 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:47 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcdd55fb-0b45-4860-b289-0453c3d3d301 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301.e6681c4e-36c4-448a-96ae-746842c163f0 Jul 11 04:46:47 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:47 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-12ac671c-035c-4c0d-b02e-d5dbc489833a tempest-ProjectReaderTests-787132287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a" returned: 0 in 0.756s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-12ac671c-035c-4c0d-b02e-d5dbc489833a tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a.b7124128-5a04-4878-a199-1df87d516614 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:47 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a.b7124128-5a04-4878-a199-1df87d516614 Jul 11 04:46:47 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:47 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-66c911d1-cb0d-43bc-832b-e15bf2685a14 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcdd55fb-0b45-4860-b289-0453c3d3d301 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301.e6681c4e-36c4-448a-96ae-746842c163f0" returned: 0 in 0.680s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:47 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-66c911d1-cb0d-43bc-832b-e15bf2685a14 tempest-ProjectMemberTests-908908227 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301.e6681c4e-36c4-448a-96ae-746842c163f0 is being set with open permissions: ugo+rw Jul 11 04:46:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-66c911d1-cb0d-43bc-832b-e15bf2685a14 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301.e6681c4e-36c4-448a-96ae-746842c163f0 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:47 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301.e6681c4e-36c4-448a-96ae-746842c163f0 Jul 11 04:46:47 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:47 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-12ac671c-035c-4c0d-b02e-d5dbc489833a tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a.b7124128-5a04-4878-a199-1df87d516614" returned: 0 in 0.704s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-12ac671c-035c-4c0d-b02e-d5dbc489833a tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a.b7124128-5a04-4878-a199-1df87d516614 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:47 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a.b7124128-5a04-4878-a199-1df87d516614 Jul 11 04:46:47 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:48 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-66c911d1-cb0d-43bc-832b-e15bf2685a14 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301.e6681c4e-36c4-448a-96ae-746842c163f0" returned: 0 in 0.640s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-66c911d1-cb0d-43bc-832b-e15bf2685a14 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:48 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301.info Jul 11 04:46:48 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:48 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-12ac671c-035c-4c0d-b02e-d5dbc489833a tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a.b7124128-5a04-4878-a199-1df87d516614" returned: 0 in 0.703s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:48 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-12ac671c-035c-4c0d-b02e-d5dbc489833a tempest-ProjectReaderTests-787132287 None] Lock "cinder-quobyte-b7124128-5a04-4878-a199-1df87d516614" released by "_delete_snapshot" :: held 3.021s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:46:48 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-12ac671c-035c-4c0d-b02e-d5dbc489833a tempest-ProjectReaderTests-787132287 None] Lock "cinder-quobyte-ae329244-6522-406d-b443-33ee90f03d8a" released by "delete_snapshot" :: held 3.041s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:46:48 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-12ac671c-035c-4c0d-b02e-d5dbc489833a tempest-ProjectReaderTests-787132287 None] Created reservations ['8b909e18-f550-478d-8192-fda2dc0a77fa', '09c6af07-af65-4484-8885-0067c2e9be7f', 'd279ec6c-0129-45aa-8136-8b720bb8b346', 'e5018b08-d79f-4be5-91ab-8dcab176cdff'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:46:48 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-12ac671c-035c-4c0d-b02e-d5dbc489833a tempest-ProjectReaderTests-787132287 None] Delete snapshot completed successfully. Jul 11 04:46:48 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-12ac671c-035c-4c0d-b02e-d5dbc489833a tempest-ProjectReaderTests-787132287 None] Lock "cinder-b7124128-5a04-4878-a199-1df87d516614-delete_snapshot" released by "delete_snapshot" :: held 3.179s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:46:49 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-66c911d1-cb0d-43bc-832b-e15bf2685a14 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301.info" returned: 0 in 0.657s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:49 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-66c911d1-cb0d-43bc-832b-e15bf2685a14 tempest-ProjectMemberTests-908908227 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301.info is being set with open permissions: ugo+rw Jul 11 04:46:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-66c911d1-cb0d-43bc-832b-e15bf2685a14 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:49 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301.info Jul 11 04:46:49 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:49 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-66c911d1-cb0d-43bc-832b-e15bf2685a14 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301.info" returned: 0 in 0.656s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-66c911d1-cb0d-43bc-832b-e15bf2685a14 tempest-ProjectMemberTests-908908227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.339s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:46:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.616s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:46:49 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Acquiring lock "cinder-quobyte-6f2af6cd-43dd-425a-8ae7-45c99dae2e76-d861f777-039f-4630-a312-430441e99a0e" by "_create_volume_from_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:46:49 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Lock "cinder-quobyte-6f2af6cd-43dd-425a-8ae7-45c99dae2e76-d861f777-039f-4630-a312-430441e99a0e" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:46:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Creating volume d861f777-039f-4630-a312-430441e99a0e from snapshot 6f2af6cd-43dd-425a-8ae7-45c99dae2e76 {{(pid=86964) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 04:46:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:46:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:46:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:46:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:46:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:46:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:46:49 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Acquiring lock "cinder-quobyte-d861f777-039f-4630-a312-430441e99a0e" by "_copy_volume_from_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:46:49 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-66c911d1-cb0d-43bc-832b-e15bf2685a14 tempest-ProjectMemberTests-908908227 None] Create snapshot completed successfully Jul 11 04:46:49 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Lock "cinder-quobyte-d861f777-039f-4630-a312-430441e99a0e" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:46:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] snapshot: 6f2af6cd-43dd-425a-8ae7-45c99dae2e76, volume: d861f777-039f-4630-a312-430441e99a0e, {{(pid=86964) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 04:46:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:46:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:46:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:46:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:46:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:46:49 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bc4e4e-f94a-4e82-840b-f789d2cf9e7d]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:46:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2.6f2af6cd-43dd-425a-8ae7-45c99dae2e76 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:49 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-39dc14d4-afc2-473e-b3f2-0147220343c0 tempest-ProjectReaderTests-787132287 None] Acquiring lock "cinder-ae329244-6522-406d-b443-33ee90f03d8a-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:46:49 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-39dc14d4-afc2-473e-b3f2-0147220343c0 tempest-ProjectReaderTests-787132287 None] Lock "cinder-ae329244-6522-406d-b443-33ee90f03d8a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:46:49 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2.6f2af6cd-43dd-425a-8ae7-45c99dae2e76 Jul 11 04:46:49 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:49 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-39dc14d4-afc2-473e-b3f2-0147220343c0 tempest-ProjectReaderTests-787132287 None] Acquiring lock "cinder-quobyte-ae329244-6522-406d-b443-33ee90f03d8a" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:46:49 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-39dc14d4-afc2-473e-b3f2-0147220343c0 tempest-ProjectReaderTests-787132287 None] Lock "cinder-quobyte-ae329244-6522-406d-b443-33ee90f03d8a" acquired by "delete_volume" :: waited 0.018s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:46:49 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6545ac-6ebe-47bb-8a9d-26f2302ddae5]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:46:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-39dc14d4-afc2-473e-b3f2-0147220343c0 tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:50 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a Jul 11 04:46:50 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d495536d-201c-4af4-b5e5-560b7655472b tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-e6681c4e-36c4-448a-96ae-746842c163f0-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:46:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d495536d-201c-4af4-b5e5-560b7655472b tempest-ProjectMemberTests-908908227 None] Lock "cinder-e6681c4e-36c4-448a-96ae-746842c163f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:46:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d495536d-201c-4af4-b5e5-560b7655472b tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-quobyte-dcdd55fb-0b45-4860-b289-0453c3d3d301" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:46:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d495536d-201c-4af4-b5e5-560b7655472b tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-dcdd55fb-0b45-4860-b289-0453c3d3d301" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:46:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d495536d-201c-4af4-b5e5-560b7655472b tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-quobyte-e6681c4e-36c4-448a-96ae-746842c163f0" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:46:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d495536d-201c-4af4-b5e5-560b7655472b tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-e6681c4e-36c4-448a-96ae-746842c163f0" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:46:50 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-d495536d-201c-4af4-b5e5-560b7655472b tempest-ProjectMemberTests-908908227 None] Deleting offline snapshot e6681c4e-36c4-448a-96ae-746842c163f0 of volume dcdd55fb-0b45-4860-b289-0453c3d3d301 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:46:50 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-d495536d-201c-4af4-b5e5-560b7655472b tempest-ProjectMemberTests-908908227 None] snapshot_file for this snap is: volume-dcdd55fb-0b45-4860-b289-0453c3d3d301.e6681c4e-36c4-448a-96ae-746842c163f0 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:46:50 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2.6f2af6cd-43dd-425a-8ae7-45c99dae2e76" returned: 0 in 0.793s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:50 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:46:50 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2 {{(pid=86964) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 04:46:50 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Creating direct copy from snapshot {{(pid=86964) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 04:46:50 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[76313645-fc9a-4420-a916-3596cdc7ead3]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:46:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d495536d-201c-4af4-b5e5-560b7655472b tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301.e6681c4e-36c4-448a-96ae-746842c163f0 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:50 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d85532-be91-445e-927c-6307cdf5981f]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:46:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:50 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301.e6681c4e-36c4-448a-96ae-746842c163f0 Jul 11 04:46:50 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:50 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2 Jul 11 04:46:50 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:50 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-39dc14d4-afc2-473e-b3f2-0147220343c0 tempest-ProjectReaderTests-787132287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a" returned: 0 in 0.852s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-39dc14d4-afc2-473e-b3f2-0147220343c0 tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:50 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a Jul 11 04:46:50 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:51 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d495536d-201c-4af4-b5e5-560b7655472b tempest-ProjectMemberTests-908908227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301.e6681c4e-36c4-448a-96ae-746842c163f0" returned: 0 in 0.833s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:51 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-d495536d-201c-4af4-b5e5-560b7655472b tempest-ProjectMemberTests-908908227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcdd55fb-0b45-4860-b289-0453c3d3d301(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:46:51 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a47cb4d-a6af-47da-b2d8-1014fbbaf4aa]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:46:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d495536d-201c-4af4-b5e5-560b7655472b tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:51 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2" returned: 0 in 0.861s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:51 devstack cinder-volume[86964]: DEBUG cinder.utils [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Path /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d861f777-039f-4630-a312-430441e99a0e not found in is_blk_device check {{(pid=86964) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 04:46:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d861f777-039f-4630-a312-430441e99a0e {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:51 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-39dc14d4-afc2-473e-b3f2-0147220343c0 tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-ae329244-6522-406d-b443-33ee90f03d8a" returned: 0 in 0.668s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:51 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d861f777-039f-4630-a312-430441e99a0e Jul 11 04:46:51 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:51 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-39dc14d4-afc2-473e-b3f2-0147220343c0 tempest-ProjectReaderTests-787132287 None] Lock "cinder-quobyte-ae329244-6522-406d-b443-33ee90f03d8a" released by "delete_volume" :: held 1.585s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:46:51 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301 Jul 11 04:46:51 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:51 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-39dc14d4-afc2-473e-b3f2-0147220343c0 tempest-ProjectReaderTests-787132287 None] Created reservations ['24127ded-5872-45d0-8485-3183d28d4b2b', 'f8ae6504-ffd5-441a-8db5-50cf8be4844a', '6ef724a6-195e-4184-a800-6acbd38a2ce5', 'e7abef47-ab76-416c-a20d-230f2f4898ad'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:46:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-39dc14d4-afc2-473e-b3f2-0147220343c0 tempest-ProjectReaderTests-787132287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:46:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-39dc14d4-afc2-473e-b3f2-0147220343c0 tempest-ProjectReaderTests-787132287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:46:51 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-39dc14d4-afc2-473e-b3f2-0147220343c0 tempest-ProjectReaderTests-787132287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:46:51 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-39dc14d4-afc2-473e-b3f2-0147220343c0 tempest-ProjectReaderTests-787132287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:46:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-39dc14d4-afc2-473e-b3f2-0147220343c0 tempest-ProjectReaderTests-787132287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:46:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-39dc14d4-afc2-473e-b3f2-0147220343c0 tempest-ProjectReaderTests-787132287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:51 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:46:51 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:52 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d495536d-201c-4af4-b5e5-560b7655472b tempest-ProjectMemberTests-908908227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301" returned: 0 in 0.827s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d495536d-201c-4af4-b5e5-560b7655472b tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301.e6681c4e-36c4-448a-96ae-746842c163f0 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:52 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-39dc14d4-afc2-473e-b3f2-0147220343c0 tempest-ProjectReaderTests-787132287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.666s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:52 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-39dc14d4-afc2-473e-b3f2-0147220343c0 tempest-ProjectReaderTests-787132287 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:46:52 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301.e6681c4e-36c4-448a-96ae-746842c163f0 Jul 11 04:46:52 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:52 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-39dc14d4-afc2-473e-b3f2-0147220343c0 tempest-ProjectReaderTests-787132287 None] Deleted volume successfully. Jul 11 04:46:52 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-39dc14d4-afc2-473e-b3f2-0147220343c0 tempest-ProjectReaderTests-787132287 None] Lock "cinder-ae329244-6522-406d-b443-33ee90f03d8a-delete_volume" released by "delete_volume" :: held 2.485s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:46:54 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d495536d-201c-4af4-b5e5-560b7655472b tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301.e6681c4e-36c4-448a-96ae-746842c163f0" returned: 0 in 2.105s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d495536d-201c-4af4-b5e5-560b7655472b tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301.e6681c4e-36c4-448a-96ae-746842c163f0 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:54 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301.e6681c4e-36c4-448a-96ae-746842c163f0 Jul 11 04:46:54 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:55 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d495536d-201c-4af4-b5e5-560b7655472b tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301.e6681c4e-36c4-448a-96ae-746842c163f0" returned: 0 in 1.553s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:56 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d495536d-201c-4af4-b5e5-560b7655472b tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-e6681c4e-36c4-448a-96ae-746842c163f0" released by "_delete_snapshot" :: held 5.497s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:46:56 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d495536d-201c-4af4-b5e5-560b7655472b tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-dcdd55fb-0b45-4860-b289-0453c3d3d301" released by "delete_snapshot" :: held 5.537s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:46:56 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-d495536d-201c-4af4-b5e5-560b7655472b tempest-ProjectMemberTests-908908227 None] Created reservations ['02864c0b-b004-4db1-b9f8-0e66dd184620', '12134595-e0be-4c8a-9f6b-274cd4686175', 'd9e941a1-010f-456d-b9fa-0b7d3ea98df1', 'a5293881-6bd0-4974-b255-c3ff28c06f68'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:46:56 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-d495536d-201c-4af4-b5e5-560b7655472b tempest-ProjectMemberTests-908908227 None] Delete snapshot completed successfully. Jul 11 04:46:56 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d495536d-201c-4af4-b5e5-560b7655472b tempest-ProjectMemberTests-908908227 None] Lock "cinder-e6681c4e-36c4-448a-96ae-746842c163f0-delete_snapshot" released by "delete_snapshot" :: held 5.839s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:46:56 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d861f777-039f-4630-a312-430441e99a0e" returned: 0 in 5.506s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:56 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[d453754e-11e8-4832-8961-a3f0baf10ca4]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:46:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:57 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-052bd18f-a3e8-4692-8415-467df1f5d165 tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-dcdd55fb-0b45-4860-b289-0453c3d3d301-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:46:57 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-052bd18f-a3e8-4692-8415-467df1f5d165 tempest-ProjectMemberTests-908908227 None] Lock "cinder-dcdd55fb-0b45-4860-b289-0453c3d3d301-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:46:57 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2 Jul 11 04:46:57 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:57 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-052bd18f-a3e8-4692-8415-467df1f5d165 tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-quobyte-dcdd55fb-0b45-4860-b289-0453c3d3d301" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:46:57 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-052bd18f-a3e8-4692-8415-467df1f5d165 tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-dcdd55fb-0b45-4860-b289-0453c3d3d301" acquired by "delete_volume" :: waited 0.018s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:46:57 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ee957d-e1d9-4231-89bd-9501488a6d0c]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:46:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-052bd18f-a3e8-4692-8415-467df1f5d165 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:57 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301 Jul 11 04:46:57 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:57 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2" returned: 0 in 0.982s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:57 devstack cinder-volume[86964]: DEBUG cinder.image.image_utils [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Image conversion details: src /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2, size 1024.00 MB, duration 5.51 sec, destination /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d861f777-039f-4630-a312-430441e99a0e {{(pid=86964) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 04:46:57 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:57 devstack cinder-volume[86964]: INFO cinder.image.image_utils [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Converted 1024.00 MB image at 185.93 MB/s Jul 11 04:46:57 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d861f777-039f-4630-a312-430441e99a0e is being set with open permissions: ugo+rw Jul 11 04:46:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d861f777-039f-4630-a312-430441e99a0e {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-052bd18f-a3e8-4692-8415-467df1f5d165 tempest-ProjectMemberTests-908908227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301" returned: 0 in 0.778s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-052bd18f-a3e8-4692-8415-467df1f5d165 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:58 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d861f777-039f-4630-a312-430441e99a0e Jul 11 04:46:58 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:58 devstack sudo[107116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301 Jul 11 04:46:58 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:58 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d861f777-039f-4630-a312-430441e99a0e" returned: 0 in 0.690s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:58 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Lock "cinder-quobyte-d861f777-039f-4630-a312-430441e99a0e" released by "_copy_volume_from_snapshot" :: held 8.950s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:46:58 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Lock "cinder-quobyte-6f2af6cd-43dd-425a-8ae7-45c99dae2e76-d861f777-039f-4630-a312-430441e99a0e" released by "_create_volume_from_snapshot" :: held 8.987s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:46:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.015s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:46:58 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-052bd18f-a3e8-4692-8415-467df1f5d165 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-dcdd55fb-0b45-4860-b289-0453c3d3d301" returned: 0 in 0.716s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:58 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-052bd18f-a3e8-4692-8415-467df1f5d165 tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-dcdd55fb-0b45-4860-b289-0453c3d3d301" released by "delete_volume" :: held 1.598s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:46:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f05f27-0003-4980-b7a1-8ffd08267fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d861f777-039f-4630-a312-430441e99a0e', 'volume_size': 1, 'snapshot_id': '6f2af6cd-43dd-425a-8ae7-45c99dae2e76'}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bd726ea-1556-4cd0-b32b-19ddc34a3c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:46:58 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Volume volume-d861f777-039f-4630-a312-430441e99a0e (d861f777-039f-4630-a312-430441e99a0e): created successfully Jul 11 04:46:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bd726ea-1556-4cd0-b32b-19ddc34a3c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:46:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Flow 'volume_create_manager' (8fd3ccdd-9ab0-456f-8eb8-93f2a9b5e9ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:46:58 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-e0571786-9c8c-454c-845f-c73c035a8a21 tempest-SnapshotDependencyTests-1400697379 None] Created volume successfully. Jul 11 04:46:58 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-052bd18f-a3e8-4692-8415-467df1f5d165 tempest-ProjectMemberTests-908908227 None] Created reservations ['fe7cf59e-8e93-41bd-8f7c-6a197f97a10b', 'd27345ff-fa9b-4b01-85d7-e0fc1ac240df', '0b9fa8b2-c304-41ff-abc2-f6ba8e3600d2', '5e858cf8-9d28-4fc3-9f07-d25ce29e6087'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:46:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-052bd18f-a3e8-4692-8415-467df1f5d165 tempest-ProjectMemberTests-908908227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:46:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-052bd18f-a3e8-4692-8415-467df1f5d165 tempest-ProjectMemberTests-908908227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:46:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-052bd18f-a3e8-4692-8415-467df1f5d165 tempest-ProjectMemberTests-908908227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:46:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-052bd18f-a3e8-4692-8415-467df1f5d165 tempest-ProjectMemberTests-908908227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:46:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-052bd18f-a3e8-4692-8415-467df1f5d165 tempest-ProjectMemberTests-908908227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:46:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-052bd18f-a3e8-4692-8415-467df1f5d165 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:58 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:46:58 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:59 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:46:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:46:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:46:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:46:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:46:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:46:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:59 devstack sudo[107123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:46:59 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:59 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d1120c23-d1cd-4734-afd0-5261f8656fb7 tempest-SnapshotDependencyTests-1400697379 None] Acquiring lock "cinder-6f2af6cd-43dd-425a-8ae7-45c99dae2e76-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:46:59 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d1120c23-d1cd-4734-afd0-5261f8656fb7 tempest-SnapshotDependencyTests-1400697379 None] Lock "cinder-6f2af6cd-43dd-425a-8ae7-45c99dae2e76-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:46:59 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d1120c23-d1cd-4734-afd0-5261f8656fb7 tempest-SnapshotDependencyTests-1400697379 None] Acquiring lock "cinder-quobyte-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:46:59 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Jul 11 04:46:59 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d1120c23-d1cd-4734-afd0-5261f8656fb7 tempest-SnapshotDependencyTests-1400697379 None] Lock "cinder-quobyte-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:46:59 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d1120c23-d1cd-4734-afd0-5261f8656fb7 tempest-SnapshotDependencyTests-1400697379 None] Acquiring lock "cinder-quobyte-6f2af6cd-43dd-425a-8ae7-45c99dae2e76" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:46:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-052bd18f-a3e8-4692-8415-467df1f5d165 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.666s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:46:59 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-052bd18f-a3e8-4692-8415-467df1f5d165 tempest-ProjectMemberTests-908908227 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:46:59 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-052bd18f-a3e8-4692-8415-467df1f5d165 tempest-ProjectMemberTests-908908227 None] Deleted volume successfully. Jul 11 04:46:59 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d1120c23-d1cd-4734-afd0-5261f8656fb7 tempest-SnapshotDependencyTests-1400697379 None] Lock "cinder-quobyte-6f2af6cd-43dd-425a-8ae7-45c99dae2e76" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:46:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-d1120c23-d1cd-4734-afd0-5261f8656fb7 tempest-SnapshotDependencyTests-1400697379 None] Deleting offline snapshot 6f2af6cd-43dd-425a-8ae7-45c99dae2e76 of volume 2ee11091-2749-4bd4-b3ea-ff5f531a2fd2 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:46:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-d1120c23-d1cd-4734-afd0-5261f8656fb7 tempest-SnapshotDependencyTests-1400697379 None] snapshot_file for this snap is: volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2.6f2af6cd-43dd-425a-8ae7-45c99dae2e76 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:46:59 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d481921-9eb0-4fb3-ace7-5247a9868516]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:46:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d1120c23-d1cd-4734-afd0-5261f8656fb7 tempest-SnapshotDependencyTests-1400697379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2.6f2af6cd-43dd-425a-8ae7-45c99dae2e76 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:46:59 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-052bd18f-a3e8-4692-8415-467df1f5d165 tempest-ProjectMemberTests-908908227 None] Lock "cinder-dcdd55fb-0b45-4860-b289-0453c3d3d301-delete_volume" released by "delete_volume" :: held 2.553s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:46:59 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2.6f2af6cd-43dd-425a-8ae7-45c99dae2e76 Jul 11 04:46:59 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:46:59 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7e474bd-3229-40a5-90c4-b4eae066193d tempest-ProjectMemberTests-908908227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:46:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e7e474bd-3229-40a5-90c4-b4eae066193d tempest-ProjectMemberTests-908908227 None] Flow 'volume_create_manager' (ab4ac980-1f92-4e65-a043-41bb78910165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:46:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e7e474bd-3229-40a5-90c4-b4eae066193d tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f0cf4c2-8e54-44fb-b9ad-bd2658ad1f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e7e474bd-3229-40a5-90c4-b4eae066193d tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f0cf4c2-8e54-44fb-b9ad-bd2658ad1f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1297505707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3d84cdd-45cf-4074-b0f2-f02b7b450856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab7832e09784b2e931b228228b2c95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:47:00Z,use_quota=True,user_id='dc1e9d4141f14bd6a58aebc9231b6fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e7e474bd-3229-40a5-90c4-b4eae066193d tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f58554-bf65-4173-ac4a-be10dd2bc513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e7e474bd-3229-40a5-90c4-b4eae066193d tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f58554-bf65-4173-ac4a-be10dd2bc513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e7e474bd-3229-40a5-90c4-b4eae066193d tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92036c05-7435-45c1-b61f-07206edcddac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e7e474bd-3229-40a5-90c4-b4eae066193d tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92036c05-7435-45c1-b61f-07206edcddac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3d84cdd-45cf-4074-b0f2-f02b7b450856', 'volume_name': 'volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e7e474bd-3229-40a5-90c4-b4eae066193d tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5dd7e63-d0dd-4e11-892e-a39f3ad1d4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e7e474bd-3229-40a5-90c4-b4eae066193d tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5dd7e63-d0dd-4e11-892e-a39f3ad1d4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e7e474bd-3229-40a5-90c4-b4eae066193d tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1954828-2ae3-4a05-a040-8b8d360b3c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:00 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-e7e474bd-3229-40a5-90c4-b4eae066193d tempest-ProjectMemberTests-908908227 None] Volume b3d84cdd-45cf-4074-b0f2-f02b7b450856: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856', 'volume_size': 1} Jul 11 04:47:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e7e474bd-3229-40a5-90c4-b4eae066193d tempest-ProjectMemberTests-908908227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:47:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e7e474bd-3229-40a5-90c4-b4eae066193d tempest-ProjectMemberTests-908908227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:47:00 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e7e474bd-3229-40a5-90c4-b4eae066193d tempest-ProjectMemberTests-908908227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1297505707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3d84cdd-45cf-4074-b0f2-f02b7b450856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab7832e09784b2e931b228228b2c95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:47:00Z,use_quota=True,user_id='dc1e9d4141f14bd6a58aebc9231b6fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:47:00 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-e7e474bd-3229-40a5-90c4-b4eae066193d tempest-ProjectMemberTests-908908227 None] Creating volume b3d84cdd-45cf-4074-b0f2-f02b7b450856 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:47:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e7e474bd-3229-40a5-90c4-b4eae066193d tempest-ProjectMemberTests-908908227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:47:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e7e474bd-3229-40a5-90c4-b4eae066193d tempest-ProjectMemberTests-908908227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:47:00 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e7e474bd-3229-40a5-90c4-b4eae066193d tempest-ProjectMemberTests-908908227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:47:00 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e7e474bd-3229-40a5-90c4-b4eae066193d tempest-ProjectMemberTests-908908227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:47:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e7e474bd-3229-40a5-90c4-b4eae066193d tempest-ProjectMemberTests-908908227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:47:00 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e7e474bd-3229-40a5-90c4-b4eae066193d tempest-ProjectMemberTests-908908227 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:47:00 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-e7e474bd-3229-40a5-90c4-b4eae066193d tempest-ProjectMemberTests-908908227 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:47:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e7e474bd-3229-40a5-90c4-b4eae066193d tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:00 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856 1073741824 Jul 11 04:47:00 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:00 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.951s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:00 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:47:00 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager._thread_info {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:47:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread count: 28 {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:47:00 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread info: [<_MainThread(MainThread, started 124675027595392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:47:00 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d1120c23-d1cd-4734-afd0-5261f8656fb7 tempest-SnapshotDependencyTests-1400697379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2.6f2af6cd-43dd-425a-8ae7-45c99dae2e76" returned: 0 in 1.011s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:00 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-d1120c23-d1cd-4734-afd0-5261f8656fb7 tempest-SnapshotDependencyTests-1400697379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:47:00 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27ef32f-d231-4be4-9dd6-5d2cccf7e392]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:47:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d1120c23-d1cd-4734-afd0-5261f8656fb7 tempest-SnapshotDependencyTests-1400697379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:00 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2 Jul 11 04:47:00 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:00 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e7e474bd-3229-40a5-90c4-b4eae066193d tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856 1073741824" returned: 0 in 0.896s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e7e474bd-3229-40a5-90c4-b4eae066193d tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:01 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856 Jul 11 04:47:01 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:01 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d1120c23-d1cd-4734-afd0-5261f8656fb7 tempest-SnapshotDependencyTests-1400697379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2" returned: 0 in 0.796s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d1120c23-d1cd-4734-afd0-5261f8656fb7 tempest-SnapshotDependencyTests-1400697379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2.6f2af6cd-43dd-425a-8ae7-45c99dae2e76 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:01 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2.6f2af6cd-43dd-425a-8ae7-45c99dae2e76 Jul 11 04:47:01 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:01 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e7e474bd-3229-40a5-90c4-b4eae066193d tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856" returned: 0 in 0.629s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:01 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e7e474bd-3229-40a5-90c4-b4eae066193d tempest-ProjectMemberTests-908908227 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:47:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e7e474bd-3229-40a5-90c4-b4eae066193d tempest-ProjectMemberTests-908908227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:47:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e7e474bd-3229-40a5-90c4-b4eae066193d tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1954828-2ae3-4a05-a040-8b8d360b3c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e7e474bd-3229-40a5-90c4-b4eae066193d tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e417321-caf3-4538-abbe-52328eafed4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:01 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-e7e474bd-3229-40a5-90c4-b4eae066193d tempest-ProjectMemberTests-908908227 None] Volume volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856 (b3d84cdd-45cf-4074-b0f2-f02b7b450856): created successfully Jul 11 04:47:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e7e474bd-3229-40a5-90c4-b4eae066193d tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e417321-caf3-4538-abbe-52328eafed4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:01 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e7e474bd-3229-40a5-90c4-b4eae066193d tempest-ProjectMemberTests-908908227 None] Flow 'volume_create_manager' (ab4ac980-1f92-4e65-a043-41bb78910165) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:47:01 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-e7e474bd-3229-40a5-90c4-b4eae066193d tempest-ProjectMemberTests-908908227 None] Created volume successfully. Jul 11 04:47:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9b71da6c-3bd6-47c5-83c0-f602a7639e60 tempest-ProjectMemberTests-908908227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:47:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9b71da6c-3bd6-47c5-83c0-f602a7639e60 tempest-ProjectMemberTests-908908227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:47:02 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-9b71da6c-3bd6-47c5-83c0-f602a7639e60 tempest-ProjectMemberTests-908908227 None] Creating offline snapshot e8330180-f987-4bc3-b4b0-0d10cba7ddac of volume b3d84cdd-45cf-4074-b0f2-f02b7b450856 {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:47:02 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ab33e8-20d2-44e9-a3c4-48ef4d351e3d]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:47:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9b71da6c-3bd6-47c5-83c0-f602a7639e60 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:02 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d1120c23-d1cd-4734-afd0-5261f8656fb7 tempest-SnapshotDependencyTests-1400697379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2.6f2af6cd-43dd-425a-8ae7-45c99dae2e76" returned: 0 in 0.821s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d1120c23-d1cd-4734-afd0-5261f8656fb7 tempest-SnapshotDependencyTests-1400697379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2.6f2af6cd-43dd-425a-8ae7-45c99dae2e76 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:02 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2.6f2af6cd-43dd-425a-8ae7-45c99dae2e76 Jul 11 04:47:02 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:02 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856 Jul 11 04:47:02 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:02 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d1120c23-d1cd-4734-afd0-5261f8656fb7 tempest-SnapshotDependencyTests-1400697379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2.6f2af6cd-43dd-425a-8ae7-45c99dae2e76" returned: 0 in 0.676s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:02 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d1120c23-d1cd-4734-afd0-5261f8656fb7 tempest-SnapshotDependencyTests-1400697379 None] Lock "cinder-quobyte-6f2af6cd-43dd-425a-8ae7-45c99dae2e76" released by "_delete_snapshot" :: held 3.436s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:47:03 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:03 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d1120c23-d1cd-4734-afd0-5261f8656fb7 tempest-SnapshotDependencyTests-1400697379 None] Lock "cinder-quobyte-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2" released by "delete_snapshot" :: held 3.468s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:47:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9b71da6c-3bd6-47c5-83c0-f602a7639e60 tempest-ProjectMemberTests-908908227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856" returned: 0 in 0.793s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9b71da6c-3bd6-47c5-83c0-f602a7639e60 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856.e8330180-f987-4bc3-b4b0-0d10cba7ddac 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:03 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856.e8330180-f987-4bc3-b4b0-0d10cba7ddac 1G Jul 11 04:47:03 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:03 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-d1120c23-d1cd-4734-afd0-5261f8656fb7 tempest-SnapshotDependencyTests-1400697379 None] Created reservations ['719924cf-5353-442c-8f57-cb2241c827cd', '756a4114-091a-4ab7-8b79-0473882f6936', '80a41885-4e7b-4476-a854-96260c1bab15', '983ed976-0464-478b-bcdc-e0edcecbd3bf'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:47:03 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-d1120c23-d1cd-4734-afd0-5261f8656fb7 tempest-SnapshotDependencyTests-1400697379 None] Delete snapshot completed successfully. Jul 11 04:47:03 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d1120c23-d1cd-4734-afd0-5261f8656fb7 tempest-SnapshotDependencyTests-1400697379 None] Lock "cinder-6f2af6cd-43dd-425a-8ae7-45c99dae2e76-delete_snapshot" released by "delete_snapshot" :: held 3.629s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:47:03 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c79e46d9-88dc-4955-8ca0-2b7899392e29 tempest-SnapshotDependencyTests-1400697379 None] Acquiring lock "cinder-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:47:03 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c79e46d9-88dc-4955-8ca0-2b7899392e29 tempest-SnapshotDependencyTests-1400697379 None] Lock "cinder-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:47:03 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c79e46d9-88dc-4955-8ca0-2b7899392e29 tempest-SnapshotDependencyTests-1400697379 None] Acquiring lock "cinder-quobyte-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:47:03 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9b71da6c-3bd6-47c5-83c0-f602a7639e60 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856.e8330180-f987-4bc3-b4b0-0d10cba7ddac 1G" returned: 0 in 0.831s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9b71da6c-3bd6-47c5-83c0-f602a7639e60 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856.e8330180-f987-4bc3-b4b0-0d10cba7ddac {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:03 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c79e46d9-88dc-4955-8ca0-2b7899392e29 tempest-SnapshotDependencyTests-1400697379 None] Lock "cinder-quobyte-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2" acquired by "delete_volume" :: waited 0.031s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:47:03 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856.e8330180-f987-4bc3-b4b0-0d10cba7ddac Jul 11 04:47:03 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:03 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[0853352e-ebae-4fd5-9993-a0b0be53ae2e]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:47:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c79e46d9-88dc-4955-8ca0-2b7899392e29 tempest-SnapshotDependencyTests-1400697379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:04 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2 Jul 11 04:47:04 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:04 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9b71da6c-3bd6-47c5-83c0-f602a7639e60 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856.e8330180-f987-4bc3-b4b0-0d10cba7ddac" returned: 0 in 0.727s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:04 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-9b71da6c-3bd6-47c5-83c0-f602a7639e60 tempest-ProjectMemberTests-908908227 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856.e8330180-f987-4bc3-b4b0-0d10cba7ddac is being set with open permissions: ugo+rw Jul 11 04:47:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9b71da6c-3bd6-47c5-83c0-f602a7639e60 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856.e8330180-f987-4bc3-b4b0-0d10cba7ddac {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:04 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856.e8330180-f987-4bc3-b4b0-0d10cba7ddac Jul 11 04:47:04 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:04 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c79e46d9-88dc-4955-8ca0-2b7899392e29 tempest-SnapshotDependencyTests-1400697379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2" returned: 0 in 0.811s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c79e46d9-88dc-4955-8ca0-2b7899392e29 tempest-SnapshotDependencyTests-1400697379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:04 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2 Jul 11 04:47:04 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:05 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9b71da6c-3bd6-47c5-83c0-f602a7639e60 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856.e8330180-f987-4bc3-b4b0-0d10cba7ddac" returned: 0 in 0.677s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9b71da6c-3bd6-47c5-83c0-f602a7639e60 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:05 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856.info Jul 11 04:47:05 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:05 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c79e46d9-88dc-4955-8ca0-2b7899392e29 tempest-SnapshotDependencyTests-1400697379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2" returned: 0 in 0.762s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:05 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c79e46d9-88dc-4955-8ca0-2b7899392e29 tempest-SnapshotDependencyTests-1400697379 None] Lock "cinder-quobyte-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2" released by "delete_volume" :: held 1.645s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:47:05 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-c79e46d9-88dc-4955-8ca0-2b7899392e29 tempest-SnapshotDependencyTests-1400697379 None] Created reservations ['bd88a57f-d3f1-451d-8bc1-38531a105ca2', '46d4f9bc-f338-411a-a161-96c8000d4f3e', '7ae88adf-e0fc-442c-93ff-d5bd63851174', '51a95d98-4359-4416-9822-28b4bb29c2f7'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:47:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c79e46d9-88dc-4955-8ca0-2b7899392e29 tempest-SnapshotDependencyTests-1400697379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:47:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c79e46d9-88dc-4955-8ca0-2b7899392e29 tempest-SnapshotDependencyTests-1400697379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:47:05 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c79e46d9-88dc-4955-8ca0-2b7899392e29 tempest-SnapshotDependencyTests-1400697379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:47:05 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c79e46d9-88dc-4955-8ca0-2b7899392e29 tempest-SnapshotDependencyTests-1400697379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:47:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c79e46d9-88dc-4955-8ca0-2b7899392e29 tempest-SnapshotDependencyTests-1400697379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:47:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c79e46d9-88dc-4955-8ca0-2b7899392e29 tempest-SnapshotDependencyTests-1400697379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:05 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:47:05 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:06 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9b71da6c-3bd6-47c5-83c0-f602a7639e60 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856.info" returned: 0 in 0.747s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:06 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-9b71da6c-3bd6-47c5-83c0-f602a7639e60 tempest-ProjectMemberTests-908908227 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856.info is being set with open permissions: ugo+rw Jul 11 04:47:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9b71da6c-3bd6-47c5-83c0-f602a7639e60 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:06 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856.info Jul 11 04:47:06 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:06 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-551f3e53-f127-47ee-9b5c-b716de1bce4d tempest-SnapshotDependencyTests-1400697379 None] Acquiring lock "cinder-d861f777-039f-4630-a312-430441e99a0e-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:47:06 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-551f3e53-f127-47ee-9b5c-b716de1bce4d tempest-SnapshotDependencyTests-1400697379 None] Lock "cinder-d861f777-039f-4630-a312-430441e99a0e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:47:06 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-551f3e53-f127-47ee-9b5c-b716de1bce4d tempest-SnapshotDependencyTests-1400697379 None] Acquiring lock "cinder-quobyte-d861f777-039f-4630-a312-430441e99a0e" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:47:06 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-551f3e53-f127-47ee-9b5c-b716de1bce4d tempest-SnapshotDependencyTests-1400697379 None] Lock "cinder-quobyte-d861f777-039f-4630-a312-430441e99a0e" acquired by "delete_volume" :: waited 0.016s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:47:06 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf1c7d9-df1c-4860-afb2-d0fe1c59b824]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:47:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-551f3e53-f127-47ee-9b5c-b716de1bce4d tempest-SnapshotDependencyTests-1400697379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d861f777-039f-4630-a312-430441e99a0e {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:06 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d861f777-039f-4630-a312-430441e99a0e Jul 11 04:47:06 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:06 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c79e46d9-88dc-4955-8ca0-2b7899392e29 tempest-SnapshotDependencyTests-1400697379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.799s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:06 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-c79e46d9-88dc-4955-8ca0-2b7899392e29 tempest-SnapshotDependencyTests-1400697379 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:47:06 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-c79e46d9-88dc-4955-8ca0-2b7899392e29 tempest-SnapshotDependencyTests-1400697379 None] Deleted volume successfully. Jul 11 04:47:06 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-c79e46d9-88dc-4955-8ca0-2b7899392e29 tempest-SnapshotDependencyTests-1400697379 None] Lock "cinder-2ee11091-2749-4bd4-b3ea-ff5f531a2fd2-delete_volume" released by "delete_volume" :: held 2.711s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:47:06 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9b71da6c-3bd6-47c5-83c0-f602a7639e60 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856.info" returned: 0 in 0.752s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9b71da6c-3bd6-47c5-83c0-f602a7639e60 tempest-ProjectMemberTests-908908227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.626s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:47:06 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-9b71da6c-3bd6-47c5-83c0-f602a7639e60 tempest-ProjectMemberTests-908908227 None] Create snapshot completed successfully Jul 11 04:47:07 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-551f3e53-f127-47ee-9b5c-b716de1bce4d tempest-SnapshotDependencyTests-1400697379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d861f777-039f-4630-a312-430441e99a0e" returned: 0 in 0.844s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-551f3e53-f127-47ee-9b5c-b716de1bce4d tempest-SnapshotDependencyTests-1400697379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d861f777-039f-4630-a312-430441e99a0e {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:07 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d861f777-039f-4630-a312-430441e99a0e Jul 11 04:47:07 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:07 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f36908e3-2cb3-47b2-bc4a-1ce358ddfc1e tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-e8330180-f987-4bc3-b4b0-0d10cba7ddac-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:47:07 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f36908e3-2cb3-47b2-bc4a-1ce358ddfc1e tempest-ProjectMemberTests-908908227 None] Lock "cinder-e8330180-f987-4bc3-b4b0-0d10cba7ddac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:47:07 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f36908e3-2cb3-47b2-bc4a-1ce358ddfc1e tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-quobyte-b3d84cdd-45cf-4074-b0f2-f02b7b450856" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:47:07 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f36908e3-2cb3-47b2-bc4a-1ce358ddfc1e tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-b3d84cdd-45cf-4074-b0f2-f02b7b450856" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:47:07 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f36908e3-2cb3-47b2-bc4a-1ce358ddfc1e tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-quobyte-e8330180-f987-4bc3-b4b0-0d10cba7ddac" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:47:07 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f36908e3-2cb3-47b2-bc4a-1ce358ddfc1e tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-e8330180-f987-4bc3-b4b0-0d10cba7ddac" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:47:07 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-f36908e3-2cb3-47b2-bc4a-1ce358ddfc1e tempest-ProjectMemberTests-908908227 None] Deleting offline snapshot e8330180-f987-4bc3-b4b0-0d10cba7ddac of volume b3d84cdd-45cf-4074-b0f2-f02b7b450856 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:47:07 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-f36908e3-2cb3-47b2-bc4a-1ce358ddfc1e tempest-ProjectMemberTests-908908227 None] snapshot_file for this snap is: volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856.e8330180-f987-4bc3-b4b0-0d10cba7ddac {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:47:07 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[4030a85e-8f54-450e-a2c5-809bee703e3f]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:47:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f36908e3-2cb3-47b2-bc4a-1ce358ddfc1e tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856.e8330180-f987-4bc3-b4b0-0d10cba7ddac {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:07 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856.e8330180-f987-4bc3-b4b0-0d10cba7ddac Jul 11 04:47:07 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:07 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-551f3e53-f127-47ee-9b5c-b716de1bce4d tempest-SnapshotDependencyTests-1400697379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-d861f777-039f-4630-a312-430441e99a0e" returned: 0 in 0.712s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:07 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-551f3e53-f127-47ee-9b5c-b716de1bce4d tempest-SnapshotDependencyTests-1400697379 None] Lock "cinder-quobyte-d861f777-039f-4630-a312-430441e99a0e" released by "delete_volume" :: held 1.604s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:47:07 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-551f3e53-f127-47ee-9b5c-b716de1bce4d tempest-SnapshotDependencyTests-1400697379 None] Created reservations ['e81ec252-419a-4ef7-af68-a44786f5a6aa', '6c990d90-b0b8-47ed-a8ee-64715c4801d5', 'd9400438-03d6-4c69-8595-1210089c212b', '81e9adfe-47b4-4ef8-b9d8-211e98f66fc1'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:47:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-551f3e53-f127-47ee-9b5c-b716de1bce4d tempest-SnapshotDependencyTests-1400697379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:47:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-551f3e53-f127-47ee-9b5c-b716de1bce4d tempest-SnapshotDependencyTests-1400697379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:47:07 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-551f3e53-f127-47ee-9b5c-b716de1bce4d tempest-SnapshotDependencyTests-1400697379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:47:07 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-551f3e53-f127-47ee-9b5c-b716de1bce4d tempest-SnapshotDependencyTests-1400697379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:47:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-551f3e53-f127-47ee-9b5c-b716de1bce4d tempest-SnapshotDependencyTests-1400697379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:47:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-551f3e53-f127-47ee-9b5c-b716de1bce4d tempest-SnapshotDependencyTests-1400697379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:07 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:47:07 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:08 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-2416ab40-78ce-4f59-abce-08d54e727118 tempest-ProjectReaderTests-759668919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:47:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2416ab40-78ce-4f59-abce-08d54e727118 tempest-ProjectReaderTests-759668919 None] Flow 'volume_create_manager' (8b7ea9ec-d7aa-47c4-8731-1c66c103b34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:47:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2416ab40-78ce-4f59-abce-08d54e727118 tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e38e753-d89c-43aa-9100-4ad28c0623e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2416ab40-78ce-4f59-abce-08d54e727118 tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e38e753-d89c-43aa-9100-4ad28c0623e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1490082893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50251e36-2b94-435a-8a2d-c18704660c23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b9b380736324a19aadd16e361673d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:47:08Z,use_quota=True,user_id='7ee8507866654be6a39402147bde3978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2416ab40-78ce-4f59-abce-08d54e727118 tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ff48405-4299-4414-9b45-7f90d6787f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2416ab40-78ce-4f59-abce-08d54e727118 tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ff48405-4299-4414-9b45-7f90d6787f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2416ab40-78ce-4f59-abce-08d54e727118 tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (585392a5-f1af-444b-b2fe-ff124ba8e094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2416ab40-78ce-4f59-abce-08d54e727118 tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (585392a5-f1af-444b-b2fe-ff124ba8e094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50251e36-2b94-435a-8a2d-c18704660c23', 'volume_name': 'volume-50251e36-2b94-435a-8a2d-c18704660c23', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2416ab40-78ce-4f59-abce-08d54e727118 tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bdfd9d7-d69e-4e1c-9e5e-e2e06308c7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2416ab40-78ce-4f59-abce-08d54e727118 tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bdfd9d7-d69e-4e1c-9e5e-e2e06308c7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:08 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2416ab40-78ce-4f59-abce-08d54e727118 tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08db41e5-a161-4c4a-bde0-35560f2b06b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:08 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-2416ab40-78ce-4f59-abce-08d54e727118 tempest-ProjectReaderTests-759668919 None] Volume 50251e36-2b94-435a-8a2d-c18704660c23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50251e36-2b94-435a-8a2d-c18704660c23', 'volume_size': 1} Jul 11 04:47:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2416ab40-78ce-4f59-abce-08d54e727118 tempest-ProjectReaderTests-759668919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:47:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2416ab40-78ce-4f59-abce-08d54e727118 tempest-ProjectReaderTests-759668919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:47:08 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2416ab40-78ce-4f59-abce-08d54e727118 tempest-ProjectReaderTests-759668919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1490082893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50251e36-2b94-435a-8a2d-c18704660c23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b9b380736324a19aadd16e361673d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:47:08Z,use_quota=True,user_id='7ee8507866654be6a39402147bde3978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:47:08 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-2416ab40-78ce-4f59-abce-08d54e727118 tempest-ProjectReaderTests-759668919 None] Creating volume 50251e36-2b94-435a-8a2d-c18704660c23 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:47:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2416ab40-78ce-4f59-abce-08d54e727118 tempest-ProjectReaderTests-759668919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:47:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2416ab40-78ce-4f59-abce-08d54e727118 tempest-ProjectReaderTests-759668919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:47:08 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2416ab40-78ce-4f59-abce-08d54e727118 tempest-ProjectReaderTests-759668919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:47:08 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:08 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2416ab40-78ce-4f59-abce-08d54e727118 tempest-ProjectReaderTests-759668919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:47:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2416ab40-78ce-4f59-abce-08d54e727118 tempest-ProjectReaderTests-759668919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:47:08 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2416ab40-78ce-4f59-abce-08d54e727118 tempest-ProjectReaderTests-759668919 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:47:08 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-2416ab40-78ce-4f59-abce-08d54e727118 tempest-ProjectReaderTests-759668919 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:47:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2416ab40-78ce-4f59-abce-08d54e727118 tempest-ProjectReaderTests-759668919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-50251e36-2b94-435a-8a2d-c18704660c23 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f36908e3-2cb3-47b2-bc4a-1ce358ddfc1e tempest-ProjectMemberTests-908908227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856.e8330180-f987-4bc3-b4b0-0d10cba7ddac" returned: 0 in 0.842s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:08 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-f36908e3-2cb3-47b2-bc4a-1ce358ddfc1e tempest-ProjectMemberTests-908908227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:47:08 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-50251e36-2b94-435a-8a2d-c18704660c23 1073741824 Jul 11 04:47:08 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:08 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54594b1-587f-4d3b-ad5f-53709de5f4e2]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:47:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f36908e3-2cb3-47b2-bc4a-1ce358ddfc1e tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:08 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856 Jul 11 04:47:08 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:08 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-551f3e53-f127-47ee-9b5c-b716de1bce4d tempest-SnapshotDependencyTests-1400697379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.693s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:08 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-551f3e53-f127-47ee-9b5c-b716de1bce4d tempest-SnapshotDependencyTests-1400697379 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:47:08 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-551f3e53-f127-47ee-9b5c-b716de1bce4d tempest-SnapshotDependencyTests-1400697379 None] Deleted volume successfully. Jul 11 04:47:08 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-551f3e53-f127-47ee-9b5c-b716de1bce4d tempest-SnapshotDependencyTests-1400697379 None] Lock "cinder-d861f777-039f-4630-a312-430441e99a0e-delete_volume" released by "delete_volume" :: held 2.555s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:47:09 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f36908e3-2cb3-47b2-bc4a-1ce358ddfc1e tempest-ProjectMemberTests-908908227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856" returned: 0 in 0.870s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f36908e3-2cb3-47b2-bc4a-1ce358ddfc1e tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856.e8330180-f987-4bc3-b4b0-0d10cba7ddac {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:09 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2416ab40-78ce-4f59-abce-08d54e727118 tempest-ProjectReaderTests-759668919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-50251e36-2b94-435a-8a2d-c18704660c23 1073741824" returned: 0 in 0.943s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:09 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856.e8330180-f987-4bc3-b4b0-0d10cba7ddac Jul 11 04:47:09 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2416ab40-78ce-4f59-abce-08d54e727118 tempest-ProjectReaderTests-759668919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-50251e36-2b94-435a-8a2d-c18704660c23 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:09 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-50251e36-2b94-435a-8a2d-c18704660c23 Jul 11 04:47:09 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:10 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2416ab40-78ce-4f59-abce-08d54e727118 tempest-ProjectReaderTests-759668919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-50251e36-2b94-435a-8a2d-c18704660c23" returned: 0 in 0.711s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:10 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2416ab40-78ce-4f59-abce-08d54e727118 tempest-ProjectReaderTests-759668919 None] <== create_volume: return (1715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:47:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2416ab40-78ce-4f59-abce-08d54e727118 tempest-ProjectReaderTests-759668919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.719s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:47:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2416ab40-78ce-4f59-abce-08d54e727118 tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08db41e5-a161-4c4a-bde0-35560f2b06b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50251e36-2b94-435a-8a2d-c18704660c23', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2416ab40-78ce-4f59-abce-08d54e727118 tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1940a3a4-a275-4adf-a341-edfee67e7c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:10 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-2416ab40-78ce-4f59-abce-08d54e727118 tempest-ProjectReaderTests-759668919 None] Volume volume-50251e36-2b94-435a-8a2d-c18704660c23 (50251e36-2b94-435a-8a2d-c18704660c23): created successfully Jul 11 04:47:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2416ab40-78ce-4f59-abce-08d54e727118 tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1940a3a4-a275-4adf-a341-edfee67e7c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-2416ab40-78ce-4f59-abce-08d54e727118 tempest-ProjectReaderTests-759668919 None] Flow 'volume_create_manager' (8b7ea9ec-d7aa-47c4-8731-1c66c103b34b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:47:10 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f36908e3-2cb3-47b2-bc4a-1ce358ddfc1e tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856.e8330180-f987-4bc3-b4b0-0d10cba7ddac" returned: 0 in 0.849s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f36908e3-2cb3-47b2-bc4a-1ce358ddfc1e tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856.e8330180-f987-4bc3-b4b0-0d10cba7ddac {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:10 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-2416ab40-78ce-4f59-abce-08d54e727118 tempest-ProjectReaderTests-759668919 None] Created volume successfully. Jul 11 04:47:10 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856.e8330180-f987-4bc3-b4b0-0d10cba7ddac Jul 11 04:47:10 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:10 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-30d570c2-12ff-4379-8049-d5ab940f04bb tempest-ProjectReaderTests-759668919 None] Acquiring lock "cinder-50251e36-2b94-435a-8a2d-c18704660c23-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:47:10 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-30d570c2-12ff-4379-8049-d5ab940f04bb tempest-ProjectReaderTests-759668919 None] Lock "cinder-50251e36-2b94-435a-8a2d-c18704660c23-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:47:10 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-30d570c2-12ff-4379-8049-d5ab940f04bb tempest-ProjectReaderTests-759668919 None] Acquiring lock "cinder-quobyte-50251e36-2b94-435a-8a2d-c18704660c23" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:47:10 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-30d570c2-12ff-4379-8049-d5ab940f04bb tempest-ProjectReaderTests-759668919 None] Lock "cinder-quobyte-50251e36-2b94-435a-8a2d-c18704660c23" acquired by "delete_volume" :: waited 0.019s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:47:10 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[3770cc47-8f24-4c99-8b8d-b60e9e3c901e]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:47:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-30d570c2-12ff-4379-8049-d5ab940f04bb tempest-ProjectReaderTests-759668919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-50251e36-2b94-435a-8a2d-c18704660c23 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:10 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-50251e36-2b94-435a-8a2d-c18704660c23 Jul 11 04:47:10 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:10 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f36908e3-2cb3-47b2-bc4a-1ce358ddfc1e tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856.e8330180-f987-4bc3-b4b0-0d10cba7ddac" returned: 0 in 0.750s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:10 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f36908e3-2cb3-47b2-bc4a-1ce358ddfc1e tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-e8330180-f987-4bc3-b4b0-0d10cba7ddac" released by "_delete_snapshot" :: held 3.441s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:47:10 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f36908e3-2cb3-47b2-bc4a-1ce358ddfc1e tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-b3d84cdd-45cf-4074-b0f2-f02b7b450856" released by "delete_snapshot" :: held 3.471s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:47:10 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-f36908e3-2cb3-47b2-bc4a-1ce358ddfc1e tempest-ProjectMemberTests-908908227 None] Created reservations ['8a045b66-8419-4802-92b7-06612b5c19b1', '0b3db0a3-7612-4431-8b8f-eef5dee65635', 'aa78414a-9288-415d-8739-dbbbdf52fdce', '4f2bbdcd-5bae-4235-8402-f01f24605132'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:47:11 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-f36908e3-2cb3-47b2-bc4a-1ce358ddfc1e tempest-ProjectMemberTests-908908227 None] Delete snapshot completed successfully. Jul 11 04:47:11 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f36908e3-2cb3-47b2-bc4a-1ce358ddfc1e tempest-ProjectMemberTests-908908227 None] Lock "cinder-e8330180-f987-4bc3-b4b0-0d10cba7ddac-delete_snapshot" released by "delete_snapshot" :: held 3.629s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:47:11 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-30d570c2-12ff-4379-8049-d5ab940f04bb tempest-ProjectReaderTests-759668919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-50251e36-2b94-435a-8a2d-c18704660c23" returned: 0 in 0.950s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-30d570c2-12ff-4379-8049-d5ab940f04bb tempest-ProjectReaderTests-759668919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-50251e36-2b94-435a-8a2d-c18704660c23 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:11 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-50251e36-2b94-435a-8a2d-c18704660c23 Jul 11 04:47:11 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:11 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b8e9e334-65a7-4ad3-8784-33547fc518ea tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-b3d84cdd-45cf-4074-b0f2-f02b7b450856-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:47:11 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b8e9e334-65a7-4ad3-8784-33547fc518ea tempest-ProjectMemberTests-908908227 None] Lock "cinder-b3d84cdd-45cf-4074-b0f2-f02b7b450856-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:47:11 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b8e9e334-65a7-4ad3-8784-33547fc518ea tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-quobyte-b3d84cdd-45cf-4074-b0f2-f02b7b450856" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:47:11 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b8e9e334-65a7-4ad3-8784-33547fc518ea tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-b3d84cdd-45cf-4074-b0f2-f02b7b450856" acquired by "delete_volume" :: waited 0.017s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:47:11 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf9e1d5-b424-4c8f-beb7-17441b3e6f7b]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:47:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b8e9e334-65a7-4ad3-8784-33547fc518ea tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:12 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856 Jul 11 04:47:12 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:12 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-30d570c2-12ff-4379-8049-d5ab940f04bb tempest-ProjectReaderTests-759668919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-50251e36-2b94-435a-8a2d-c18704660c23" returned: 0 in 0.868s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:12 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-30d570c2-12ff-4379-8049-d5ab940f04bb tempest-ProjectReaderTests-759668919 None] Lock "cinder-quobyte-50251e36-2b94-435a-8a2d-c18704660c23" released by "delete_volume" :: held 1.877s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:47:12 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-30d570c2-12ff-4379-8049-d5ab940f04bb tempest-ProjectReaderTests-759668919 None] Created reservations ['03164e8d-989d-4973-ab4e-783e0801eccb', '3ea76ed1-eb9e-4324-9983-1c60e9498559', 'b43f0e70-80f5-44ad-972f-86966a06573d', '3c04368e-2245-4afd-9f9e-b43cfa41c1a4'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:47:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-30d570c2-12ff-4379-8049-d5ab940f04bb tempest-ProjectReaderTests-759668919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:47:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-30d570c2-12ff-4379-8049-d5ab940f04bb tempest-ProjectReaderTests-759668919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:47:12 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-30d570c2-12ff-4379-8049-d5ab940f04bb tempest-ProjectReaderTests-759668919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:47:12 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-30d570c2-12ff-4379-8049-d5ab940f04bb tempest-ProjectReaderTests-759668919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:47:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-30d570c2-12ff-4379-8049-d5ab940f04bb tempest-ProjectReaderTests-759668919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:47:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-30d570c2-12ff-4379-8049-d5ab940f04bb tempest-ProjectReaderTests-759668919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:12 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:47:12 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:12 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b8e9e334-65a7-4ad3-8784-33547fc518ea tempest-ProjectMemberTests-908908227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856" returned: 0 in 0.907s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b8e9e334-65a7-4ad3-8784-33547fc518ea tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:12 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856 Jul 11 04:47:12 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:13 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-dab2125e-2294-4023-9065-6e64ab0e6d4e tempest-ProjectReaderTests-759668919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:47:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-dab2125e-2294-4023-9065-6e64ab0e6d4e tempest-ProjectReaderTests-759668919 None] Flow 'volume_create_manager' (168f2eef-6d97-45f9-9b39-79c7fbf7de6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:47:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-dab2125e-2294-4023-9065-6e64ab0e6d4e tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a5c461f-2e8e-471d-bc6e-24ad08da1802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:13 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-30d570c2-12ff-4379-8049-d5ab940f04bb tempest-ProjectReaderTests-759668919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.830s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:13 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-30d570c2-12ff-4379-8049-d5ab940f04bb tempest-ProjectReaderTests-759668919 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:47:13 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-30d570c2-12ff-4379-8049-d5ab940f04bb tempest-ProjectReaderTests-759668919 None] Deleted volume successfully. Jul 11 04:47:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-dab2125e-2294-4023-9065-6e64ab0e6d4e tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a5c461f-2e8e-471d-bc6e-24ad08da1802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:47:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1031464352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6253fc30-9bc7-4c2c-8f9a-75820047f138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b9b380736324a19aadd16e361673d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:47:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:47:13Z,use_quota=True,user_id='7ee8507866654be6a39402147bde3978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-dab2125e-2294-4023-9065-6e64ab0e6d4e tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6071ea15-68ea-49c6-93df-d9edfeec34be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-dab2125e-2294-4023-9065-6e64ab0e6d4e tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6071ea15-68ea-49c6-93df-d9edfeec34be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-dab2125e-2294-4023-9065-6e64ab0e6d4e tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a17d22a-5863-4557-87ec-1c3788d8f4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-dab2125e-2294-4023-9065-6e64ab0e6d4e tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a17d22a-5863-4557-87ec-1c3788d8f4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6253fc30-9bc7-4c2c-8f9a-75820047f138', 'volume_name': 'volume-6253fc30-9bc7-4c2c-8f9a-75820047f138', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-dab2125e-2294-4023-9065-6e64ab0e6d4e tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6840fe5-a1ab-4224-a4b8-d6cb373d1a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-dab2125e-2294-4023-9065-6e64ab0e6d4e tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6840fe5-a1ab-4224-a4b8-d6cb373d1a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:13 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-dab2125e-2294-4023-9065-6e64ab0e6d4e tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea95617f-7dc4-4bd2-b78b-633e005a17d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:13 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-dab2125e-2294-4023-9065-6e64ab0e6d4e tempest-ProjectReaderTests-759668919 None] Volume 6253fc30-9bc7-4c2c-8f9a-75820047f138: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6253fc30-9bc7-4c2c-8f9a-75820047f138', 'volume_size': 1} Jul 11 04:47:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-dab2125e-2294-4023-9065-6e64ab0e6d4e tempest-ProjectReaderTests-759668919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:47:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-dab2125e-2294-4023-9065-6e64ab0e6d4e tempest-ProjectReaderTests-759668919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:47:13 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-dab2125e-2294-4023-9065-6e64ab0e6d4e tempest-ProjectReaderTests-759668919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:47:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1031464352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6253fc30-9bc7-4c2c-8f9a-75820047f138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b9b380736324a19aadd16e361673d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:47:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:47:13Z,use_quota=True,user_id='7ee8507866654be6a39402147bde3978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:47:13 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-dab2125e-2294-4023-9065-6e64ab0e6d4e tempest-ProjectReaderTests-759668919 None] Creating volume 6253fc30-9bc7-4c2c-8f9a-75820047f138 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:47:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-dab2125e-2294-4023-9065-6e64ab0e6d4e tempest-ProjectReaderTests-759668919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:47:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-dab2125e-2294-4023-9065-6e64ab0e6d4e tempest-ProjectReaderTests-759668919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:47:13 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-dab2125e-2294-4023-9065-6e64ab0e6d4e tempest-ProjectReaderTests-759668919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:47:13 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-dab2125e-2294-4023-9065-6e64ab0e6d4e tempest-ProjectReaderTests-759668919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:47:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-dab2125e-2294-4023-9065-6e64ab0e6d4e tempest-ProjectReaderTests-759668919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:47:13 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-dab2125e-2294-4023-9065-6e64ab0e6d4e tempest-ProjectReaderTests-759668919 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:47:13 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-dab2125e-2294-4023-9065-6e64ab0e6d4e tempest-ProjectReaderTests-759668919 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:47:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dab2125e-2294-4023-9065-6e64ab0e6d4e tempest-ProjectReaderTests-759668919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6253fc30-9bc7-4c2c-8f9a-75820047f138 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:13 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6253fc30-9bc7-4c2c-8f9a-75820047f138 1073741824 Jul 11 04:47:13 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:13 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-30d570c2-12ff-4379-8049-d5ab940f04bb tempest-ProjectReaderTests-759668919 None] Lock "cinder-50251e36-2b94-435a-8a2d-c18704660c23-delete_volume" released by "delete_volume" :: held 3.011s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:47:13 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b8e9e334-65a7-4ad3-8784-33547fc518ea tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b3d84cdd-45cf-4074-b0f2-f02b7b450856" returned: 0 in 0.782s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:13 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b8e9e334-65a7-4ad3-8784-33547fc518ea tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-b3d84cdd-45cf-4074-b0f2-f02b7b450856" released by "delete_volume" :: held 1.762s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:47:13 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-b8e9e334-65a7-4ad3-8784-33547fc518ea tempest-ProjectMemberTests-908908227 None] Created reservations ['d85f8240-6d49-4531-8fe3-e12351ee88b3', 'e4b1aa87-17c6-4290-a147-639c097942a8', '4a93fed6-a7db-4b9e-babf-5b033bba8ace', '4818ff13-65d2-42bc-a0ba-411c9e61cfb2'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:47:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b8e9e334-65a7-4ad3-8784-33547fc518ea tempest-ProjectMemberTests-908908227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:47:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b8e9e334-65a7-4ad3-8784-33547fc518ea tempest-ProjectMemberTests-908908227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:47:13 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b8e9e334-65a7-4ad3-8784-33547fc518ea tempest-ProjectMemberTests-908908227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:47:13 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b8e9e334-65a7-4ad3-8784-33547fc518ea tempest-ProjectMemberTests-908908227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:47:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b8e9e334-65a7-4ad3-8784-33547fc518ea tempest-ProjectMemberTests-908908227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:47:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b8e9e334-65a7-4ad3-8784-33547fc518ea tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:13 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:47:13 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:14 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b8e9e334-65a7-4ad3-8784-33547fc518ea tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.695s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:14 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-b8e9e334-65a7-4ad3-8784-33547fc518ea tempest-ProjectMemberTests-908908227 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:47:14 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-b8e9e334-65a7-4ad3-8784-33547fc518ea tempest-ProjectMemberTests-908908227 None] Deleted volume successfully. Jul 11 04:47:14 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b8e9e334-65a7-4ad3-8784-33547fc518ea tempest-ProjectMemberTests-908908227 None] Lock "cinder-b3d84cdd-45cf-4074-b0f2-f02b7b450856-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:47:14 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dab2125e-2294-4023-9065-6e64ab0e6d4e tempest-ProjectReaderTests-759668919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6253fc30-9bc7-4c2c-8f9a-75820047f138 1073741824" returned: 0 in 1.043s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dab2125e-2294-4023-9065-6e64ab0e6d4e tempest-ProjectReaderTests-759668919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6253fc30-9bc7-4c2c-8f9a-75820047f138 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:14 devstack sudo[107298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6253fc30-9bc7-4c2c-8f9a-75820047f138 Jul 11 04:47:14 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:14 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f8d210e-6aec-4d9e-9de9-94a645b30fba tempest-ProjectMemberTests-908908227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:47:14 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3f8d210e-6aec-4d9e-9de9-94a645b30fba tempest-ProjectMemberTests-908908227 None] Flow 'volume_create_manager' (a703d902-b0f7-4141-a116-a25d6a940b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:47:14 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3f8d210e-6aec-4d9e-9de9-94a645b30fba tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a3a18af-a89d-41a5-a112-a6a280ea1f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:14 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3f8d210e-6aec-4d9e-9de9-94a645b30fba tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a3a18af-a89d-41a5-a112-a6a280ea1f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1735782273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab7832e09784b2e931b228228b2c95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:47:15Z,use_quota=True,user_id='dc1e9d4141f14bd6a58aebc9231b6fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:14 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3f8d210e-6aec-4d9e-9de9-94a645b30fba tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c322ac1a-6457-4087-8fd3-64c1346f59ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:14 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3f8d210e-6aec-4d9e-9de9-94a645b30fba tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c322ac1a-6457-4087-8fd3-64c1346f59ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:14 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3f8d210e-6aec-4d9e-9de9-94a645b30fba tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5289e1bd-dae0-49f9-a7db-dad7a848776e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:14 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3f8d210e-6aec-4d9e-9de9-94a645b30fba tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5289e1bd-dae0-49f9-a7db-dad7a848776e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3', 'volume_name': 'volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:14 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3f8d210e-6aec-4d9e-9de9-94a645b30fba tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd9ce97-97d1-4304-8ea6-ce000be51efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:14 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3f8d210e-6aec-4d9e-9de9-94a645b30fba tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd9ce97-97d1-4304-8ea6-ce000be51efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:14 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3f8d210e-6aec-4d9e-9de9-94a645b30fba tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a177b225-9841-4788-89ca-4d9d8e01b36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:14 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-3f8d210e-6aec-4d9e-9de9-94a645b30fba tempest-ProjectMemberTests-908908227 None] Volume c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3', 'volume_size': 1} Jul 11 04:47:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3f8d210e-6aec-4d9e-9de9-94a645b30fba tempest-ProjectMemberTests-908908227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:47:15 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-dab2125e-2294-4023-9065-6e64ab0e6d4e tempest-ProjectReaderTests-759668919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6253fc30-9bc7-4c2c-8f9a-75820047f138" returned: 0 in 0.694s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:15 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-dab2125e-2294-4023-9065-6e64ab0e6d4e tempest-ProjectReaderTests-759668919 None] <== create_volume: return (1806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:47:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-dab2125e-2294-4023-9065-6e64ab0e6d4e tempest-ProjectReaderTests-759668919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.808s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:47:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3f8d210e-6aec-4d9e-9de9-94a645b30fba tempest-ProjectMemberTests-908908227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.517s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:47:15 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-3f8d210e-6aec-4d9e-9de9-94a645b30fba tempest-ProjectMemberTests-908908227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1735782273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab7832e09784b2e931b228228b2c95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:47:15Z,use_quota=True,user_id='dc1e9d4141f14bd6a58aebc9231b6fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:47:15 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-3f8d210e-6aec-4d9e-9de9-94a645b30fba tempest-ProjectMemberTests-908908227 None] Creating volume c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:47:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3f8d210e-6aec-4d9e-9de9-94a645b30fba tempest-ProjectMemberTests-908908227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:47:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3f8d210e-6aec-4d9e-9de9-94a645b30fba tempest-ProjectMemberTests-908908227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:47:15 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-3f8d210e-6aec-4d9e-9de9-94a645b30fba tempest-ProjectMemberTests-908908227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:47:15 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-3f8d210e-6aec-4d9e-9de9-94a645b30fba tempest-ProjectMemberTests-908908227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:47:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3f8d210e-6aec-4d9e-9de9-94a645b30fba tempest-ProjectMemberTests-908908227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:47:15 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-3f8d210e-6aec-4d9e-9de9-94a645b30fba tempest-ProjectMemberTests-908908227 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:47:15 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-3f8d210e-6aec-4d9e-9de9-94a645b30fba tempest-ProjectMemberTests-908908227 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:47:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3f8d210e-6aec-4d9e-9de9-94a645b30fba tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:15 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-dab2125e-2294-4023-9065-6e64ab0e6d4e tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea95617f-7dc4-4bd2-b78b-633e005a17d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6253fc30-9bc7-4c2c-8f9a-75820047f138', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:15 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-dab2125e-2294-4023-9065-6e64ab0e6d4e tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5917d33-86ab-4aaa-a504-e4d29f791bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:15 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3 1073741824 Jul 11 04:47:15 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:15 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-dab2125e-2294-4023-9065-6e64ab0e6d4e tempest-ProjectReaderTests-759668919 None] Volume volume-6253fc30-9bc7-4c2c-8f9a-75820047f138 (6253fc30-9bc7-4c2c-8f9a-75820047f138): created successfully Jul 11 04:47:15 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-dab2125e-2294-4023-9065-6e64ab0e6d4e tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5917d33-86ab-4aaa-a504-e4d29f791bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:15 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-dab2125e-2294-4023-9065-6e64ab0e6d4e tempest-ProjectReaderTests-759668919 None] Flow 'volume_create_manager' (168f2eef-6d97-45f9-9b39-79c7fbf7de6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:47:15 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-dab2125e-2294-4023-9065-6e64ab0e6d4e tempest-ProjectReaderTests-759668919 None] Created volume successfully. Jul 11 04:47:16 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3f8d210e-6aec-4d9e-9de9-94a645b30fba tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3 1073741824" returned: 0 in 0.917s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3f8d210e-6aec-4d9e-9de9-94a645b30fba tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:16 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3 Jul 11 04:47:16 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:16 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b436da2d-82cb-4ca9-8366-201da7f6e127 tempest-ProjectReaderTests-759668919 None] Acquiring lock "cinder-6253fc30-9bc7-4c2c-8f9a-75820047f138-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:47:16 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b436da2d-82cb-4ca9-8366-201da7f6e127 tempest-ProjectReaderTests-759668919 None] Lock "cinder-6253fc30-9bc7-4c2c-8f9a-75820047f138-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:47:16 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b436da2d-82cb-4ca9-8366-201da7f6e127 tempest-ProjectReaderTests-759668919 None] Acquiring lock "cinder-quobyte-6253fc30-9bc7-4c2c-8f9a-75820047f138" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:47:16 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b436da2d-82cb-4ca9-8366-201da7f6e127 tempest-ProjectReaderTests-759668919 None] Lock "cinder-quobyte-6253fc30-9bc7-4c2c-8f9a-75820047f138" acquired by "delete_volume" :: waited 0.018s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:47:16 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd11bd23-2c6c-42cc-b668-355fb42e0af1]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:47:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b436da2d-82cb-4ca9-8366-201da7f6e127 tempest-ProjectReaderTests-759668919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6253fc30-9bc7-4c2c-8f9a-75820047f138 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:16 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6253fc30-9bc7-4c2c-8f9a-75820047f138 Jul 11 04:47:16 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:17 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3f8d210e-6aec-4d9e-9de9-94a645b30fba tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3" returned: 0 in 0.754s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:17 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-3f8d210e-6aec-4d9e-9de9-94a645b30fba tempest-ProjectMemberTests-908908227 None] <== create_volume: return (1715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:47:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3f8d210e-6aec-4d9e-9de9-94a645b30fba tempest-ProjectMemberTests-908908227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.718s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:47:17 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3f8d210e-6aec-4d9e-9de9-94a645b30fba tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a177b225-9841-4788-89ca-4d9d8e01b36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:17 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3f8d210e-6aec-4d9e-9de9-94a645b30fba tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (292c8b20-050c-493d-8e16-a5b531d19b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:17 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-3f8d210e-6aec-4d9e-9de9-94a645b30fba tempest-ProjectMemberTests-908908227 None] Volume volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3 (c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3): created successfully Jul 11 04:47:17 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3f8d210e-6aec-4d9e-9de9-94a645b30fba tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (292c8b20-050c-493d-8e16-a5b531d19b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:17 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-3f8d210e-6aec-4d9e-9de9-94a645b30fba tempest-ProjectMemberTests-908908227 None] Flow 'volume_create_manager' (a703d902-b0f7-4141-a116-a25d6a940b9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:47:17 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-3f8d210e-6aec-4d9e-9de9-94a645b30fba tempest-ProjectMemberTests-908908227 None] Created volume successfully. Jul 11 04:47:17 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b436da2d-82cb-4ca9-8366-201da7f6e127 tempest-ProjectReaderTests-759668919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6253fc30-9bc7-4c2c-8f9a-75820047f138" returned: 0 in 0.861s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b436da2d-82cb-4ca9-8366-201da7f6e127 tempest-ProjectReaderTests-759668919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6253fc30-9bc7-4c2c-8f9a-75820047f138 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:17 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6253fc30-9bc7-4c2c-8f9a-75820047f138 Jul 11 04:47:17 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-564d4404-1f15-4ff8-8223-a4f45c9553cb tempest-ProjectMemberTests-908908227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:47:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-564d4404-1f15-4ff8-8223-a4f45c9553cb tempest-ProjectMemberTests-908908227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:47:18 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-564d4404-1f15-4ff8-8223-a4f45c9553cb tempest-ProjectMemberTests-908908227 None] Creating offline snapshot 78b5ad8e-a0c1-4d31-b5dc-e8a5a46fa3cf of volume c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3 {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:47:18 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10ef2f1-5b31-4906-abee-e03b3cf363de]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:47:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-564d4404-1f15-4ff8-8223-a4f45c9553cb tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:18 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3 Jul 11 04:47:18 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:18 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b436da2d-82cb-4ca9-8366-201da7f6e127 tempest-ProjectReaderTests-759668919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-6253fc30-9bc7-4c2c-8f9a-75820047f138" returned: 0 in 0.763s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:18 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b436da2d-82cb-4ca9-8366-201da7f6e127 tempest-ProjectReaderTests-759668919 None] Lock "cinder-quobyte-6253fc30-9bc7-4c2c-8f9a-75820047f138" released by "delete_volume" :: held 1.681s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:47:18 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-b436da2d-82cb-4ca9-8366-201da7f6e127 tempest-ProjectReaderTests-759668919 None] Created reservations ['c3faae77-3695-427c-9a2d-742f42f74815', 'ad37f897-8f84-40fa-8b0b-95ae063991a7', 'b89ee7ed-2779-41be-b50a-ac0c149f7592', 'c828c0a9-e6f7-4504-99d8-eb201abf90a7'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:47:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b436da2d-82cb-4ca9-8366-201da7f6e127 tempest-ProjectReaderTests-759668919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:47:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b436da2d-82cb-4ca9-8366-201da7f6e127 tempest-ProjectReaderTests-759668919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:47:18 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b436da2d-82cb-4ca9-8366-201da7f6e127 tempest-ProjectReaderTests-759668919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:47:18 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b436da2d-82cb-4ca9-8366-201da7f6e127 tempest-ProjectReaderTests-759668919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:47:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b436da2d-82cb-4ca9-8366-201da7f6e127 tempest-ProjectReaderTests-759668919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:47:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b436da2d-82cb-4ca9-8366-201da7f6e127 tempest-ProjectReaderTests-759668919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:18 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:47:18 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:18 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-564d4404-1f15-4ff8-8223-a4f45c9553cb tempest-ProjectMemberTests-908908227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3" returned: 0 in 0.826s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-564d4404-1f15-4ff8-8223-a4f45c9553cb tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3.78b5ad8e-a0c1-4d31-b5dc-e8a5a46fa3cf 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:18 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3.78b5ad8e-a0c1-4d31-b5dc-e8a5a46fa3cf 1G Jul 11 04:47:18 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:19 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b436da2d-82cb-4ca9-8366-201da7f6e127 tempest-ProjectReaderTests-759668919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.695s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:19 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-b436da2d-82cb-4ca9-8366-201da7f6e127 tempest-ProjectReaderTests-759668919 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:47:19 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-b436da2d-82cb-4ca9-8366-201da7f6e127 tempest-ProjectReaderTests-759668919 None] Deleted volume successfully. Jul 11 04:47:19 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-b436da2d-82cb-4ca9-8366-201da7f6e127 tempest-ProjectReaderTests-759668919 None] Lock "cinder-6253fc30-9bc7-4c2c-8f9a-75820047f138-delete_volume" released by "delete_volume" :: held 2.621s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:47:19 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4dae4c5-4e53-43ce-bf9d-b2f280086234 tempest-ProjectReaderTests-759668919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:47:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b4dae4c5-4e53-43ce-bf9d-b2f280086234 tempest-ProjectReaderTests-759668919 None] Flow 'volume_create_manager' (4564357c-b2be-4853-a15f-c68656a5f0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:47:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b4dae4c5-4e53-43ce-bf9d-b2f280086234 tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61d96239-8866-410a-959e-b4f8a0ba08d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b4dae4c5-4e53-43ce-bf9d-b2f280086234 tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61d96239-8866-410a-959e-b4f8a0ba08d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1892564029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d49a4aa-5eac-4ea4-a06a-1a507b59e2f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b9b380736324a19aadd16e361673d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:47:19Z,use_quota=True,user_id='7ee8507866654be6a39402147bde3978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b4dae4c5-4e53-43ce-bf9d-b2f280086234 tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a635dcc3-16e9-45e6-9edb-039278dd6671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b4dae4c5-4e53-43ce-bf9d-b2f280086234 tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a635dcc3-16e9-45e6-9edb-039278dd6671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b4dae4c5-4e53-43ce-bf9d-b2f280086234 tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2433725-3c1c-4a60-85cb-0a6ba2899627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b4dae4c5-4e53-43ce-bf9d-b2f280086234 tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2433725-3c1c-4a60-85cb-0a6ba2899627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d49a4aa-5eac-4ea4-a06a-1a507b59e2f0', 'volume_name': 'volume-9d49a4aa-5eac-4ea4-a06a-1a507b59e2f0', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b4dae4c5-4e53-43ce-bf9d-b2f280086234 tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9ebc6cb-cf70-4ddc-9496-c818eb37178e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b4dae4c5-4e53-43ce-bf9d-b2f280086234 tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9ebc6cb-cf70-4ddc-9496-c818eb37178e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:19 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b4dae4c5-4e53-43ce-bf9d-b2f280086234 tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e20c183-fb9c-4d36-a85c-9a7b31773cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:19 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-b4dae4c5-4e53-43ce-bf9d-b2f280086234 tempest-ProjectReaderTests-759668919 None] Volume 9d49a4aa-5eac-4ea4-a06a-1a507b59e2f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d49a4aa-5eac-4ea4-a06a-1a507b59e2f0', 'volume_size': 1} Jul 11 04:47:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b4dae4c5-4e53-43ce-bf9d-b2f280086234 tempest-ProjectReaderTests-759668919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:47:19 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-564d4404-1f15-4ff8-8223-a4f45c9553cb tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3.78b5ad8e-a0c1-4d31-b5dc-e8a5a46fa3cf 1G" returned: 0 in 0.816s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-564d4404-1f15-4ff8-8223-a4f45c9553cb tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3.78b5ad8e-a0c1-4d31-b5dc-e8a5a46fa3cf {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:19 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3.78b5ad8e-a0c1-4d31-b5dc-e8a5a46fa3cf Jul 11 04:47:19 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:20 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-564d4404-1f15-4ff8-8223-a4f45c9553cb tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3.78b5ad8e-a0c1-4d31-b5dc-e8a5a46fa3cf" returned: 0 in 0.710s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:20 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-564d4404-1f15-4ff8-8223-a4f45c9553cb tempest-ProjectMemberTests-908908227 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3.78b5ad8e-a0c1-4d31-b5dc-e8a5a46fa3cf is being set with open permissions: ugo+rw Jul 11 04:47:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-564d4404-1f15-4ff8-8223-a4f45c9553cb tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3.78b5ad8e-a0c1-4d31-b5dc-e8a5a46fa3cf {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:20 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3.78b5ad8e-a0c1-4d31-b5dc-e8a5a46fa3cf Jul 11 04:47:20 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:21 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-564d4404-1f15-4ff8-8223-a4f45c9553cb tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3.78b5ad8e-a0c1-4d31-b5dc-e8a5a46fa3cf" returned: 0 in 0.671s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-564d4404-1f15-4ff8-8223-a4f45c9553cb tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:21 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3.info Jul 11 04:47:21 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:21 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-564d4404-1f15-4ff8-8223-a4f45c9553cb tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3.info" returned: 0 in 0.669s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:21 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-564d4404-1f15-4ff8-8223-a4f45c9553cb tempest-ProjectMemberTests-908908227 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3.info is being set with open permissions: ugo+rw Jul 11 04:47:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-564d4404-1f15-4ff8-8223-a4f45c9553cb tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:21 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3.info Jul 11 04:47:21 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:22 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-564d4404-1f15-4ff8-8223-a4f45c9553cb tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3.info" returned: 0 in 0.632s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-564d4404-1f15-4ff8-8223-a4f45c9553cb tempest-ProjectMemberTests-908908227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.423s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:47:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b4dae4c5-4e53-43ce-bf9d-b2f280086234 tempest-ProjectReaderTests-759668919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.054s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:47:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b4dae4c5-4e53-43ce-bf9d-b2f280086234 tempest-ProjectReaderTests-759668919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1892564029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d49a4aa-5eac-4ea4-a06a-1a507b59e2f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b9b380736324a19aadd16e361673d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:47:19Z,use_quota=True,user_id='7ee8507866654be6a39402147bde3978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:47:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-b4dae4c5-4e53-43ce-bf9d-b2f280086234 tempest-ProjectReaderTests-759668919 None] Creating volume 9d49a4aa-5eac-4ea4-a06a-1a507b59e2f0 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:47:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b4dae4c5-4e53-43ce-bf9d-b2f280086234 tempest-ProjectReaderTests-759668919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:47:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b4dae4c5-4e53-43ce-bf9d-b2f280086234 tempest-ProjectReaderTests-759668919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:47:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b4dae4c5-4e53-43ce-bf9d-b2f280086234 tempest-ProjectReaderTests-759668919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:47:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b4dae4c5-4e53-43ce-bf9d-b2f280086234 tempest-ProjectReaderTests-759668919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:47:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b4dae4c5-4e53-43ce-bf9d-b2f280086234 tempest-ProjectReaderTests-759668919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:47:22 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b4dae4c5-4e53-43ce-bf9d-b2f280086234 tempest-ProjectReaderTests-759668919 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:47:22 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-b4dae4c5-4e53-43ce-bf9d-b2f280086234 tempest-ProjectReaderTests-759668919 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:47:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b4dae4c5-4e53-43ce-bf9d-b2f280086234 tempest-ProjectReaderTests-759668919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9d49a4aa-5eac-4ea4-a06a-1a507b59e2f0 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:22 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9d49a4aa-5eac-4ea4-a06a-1a507b59e2f0 1073741824 Jul 11 04:47:22 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:22 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-564d4404-1f15-4ff8-8223-a4f45c9553cb tempest-ProjectMemberTests-908908227 None] Create snapshot completed successfully Jul 11 04:47:23 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3ee0af50-a2e5-4f6a-ac82-4e1703d6b322 tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-78b5ad8e-a0c1-4d31-b5dc-e8a5a46fa3cf-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:47:23 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3ee0af50-a2e5-4f6a-ac82-4e1703d6b322 tempest-ProjectMemberTests-908908227 None] Lock "cinder-78b5ad8e-a0c1-4d31-b5dc-e8a5a46fa3cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:47:23 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3ee0af50-a2e5-4f6a-ac82-4e1703d6b322 tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-quobyte-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:47:23 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b4dae4c5-4e53-43ce-bf9d-b2f280086234 tempest-ProjectReaderTests-759668919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9d49a4aa-5eac-4ea4-a06a-1a507b59e2f0 1073741824" returned: 0 in 0.815s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:23 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3ee0af50-a2e5-4f6a-ac82-4e1703d6b322 tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:47:23 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3ee0af50-a2e5-4f6a-ac82-4e1703d6b322 tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-quobyte-78b5ad8e-a0c1-4d31-b5dc-e8a5a46fa3cf" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:47:23 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3ee0af50-a2e5-4f6a-ac82-4e1703d6b322 tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-78b5ad8e-a0c1-4d31-b5dc-e8a5a46fa3cf" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:47:23 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-3ee0af50-a2e5-4f6a-ac82-4e1703d6b322 tempest-ProjectMemberTests-908908227 None] Deleting offline snapshot 78b5ad8e-a0c1-4d31-b5dc-e8a5a46fa3cf of volume c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:47:23 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-3ee0af50-a2e5-4f6a-ac82-4e1703d6b322 tempest-ProjectMemberTests-908908227 None] snapshot_file for this snap is: volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3.78b5ad8e-a0c1-4d31-b5dc-e8a5a46fa3cf {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:47:23 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acfff95-a96a-433a-93f8-993f2b7b677a]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:47:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3ee0af50-a2e5-4f6a-ac82-4e1703d6b322 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3.78b5ad8e-a0c1-4d31-b5dc-e8a5a46fa3cf {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b4dae4c5-4e53-43ce-bf9d-b2f280086234 tempest-ProjectReaderTests-759668919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9d49a4aa-5eac-4ea4-a06a-1a507b59e2f0 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:23 devstack sudo[107363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9d49a4aa-5eac-4ea4-a06a-1a507b59e2f0 Jul 11 04:47:23 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:23 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3.78b5ad8e-a0c1-4d31-b5dc-e8a5a46fa3cf Jul 11 04:47:23 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:24 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-b4dae4c5-4e53-43ce-bf9d-b2f280086234 tempest-ProjectReaderTests-759668919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9d49a4aa-5eac-4ea4-a06a-1a507b59e2f0" returned: 0 in 0.660s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:24 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-b4dae4c5-4e53-43ce-bf9d-b2f280086234 tempest-ProjectReaderTests-759668919 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:47:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-b4dae4c5-4e53-43ce-bf9d-b2f280086234 tempest-ProjectReaderTests-759668919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:47:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b4dae4c5-4e53-43ce-bf9d-b2f280086234 tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e20c183-fb9c-4d36-a85c-9a7b31773cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d49a4aa-5eac-4ea4-a06a-1a507b59e2f0', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b4dae4c5-4e53-43ce-bf9d-b2f280086234 tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72b6a8fd-0884-4313-a9ba-90915edbd704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:24 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-b4dae4c5-4e53-43ce-bf9d-b2f280086234 tempest-ProjectReaderTests-759668919 None] Volume volume-9d49a4aa-5eac-4ea4-a06a-1a507b59e2f0 (9d49a4aa-5eac-4ea4-a06a-1a507b59e2f0): created successfully Jul 11 04:47:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b4dae4c5-4e53-43ce-bf9d-b2f280086234 tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72b6a8fd-0884-4313-a9ba-90915edbd704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-b4dae4c5-4e53-43ce-bf9d-b2f280086234 tempest-ProjectReaderTests-759668919 None] Flow 'volume_create_manager' (4564357c-b2be-4853-a15f-c68656a5f0f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:47:24 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-b4dae4c5-4e53-43ce-bf9d-b2f280086234 tempest-ProjectReaderTests-759668919 None] Created volume successfully. Jul 11 04:47:24 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3ee0af50-a2e5-4f6a-ac82-4e1703d6b322 tempest-ProjectMemberTests-908908227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3.78b5ad8e-a0c1-4d31-b5dc-e8a5a46fa3cf" returned: 0 in 0.773s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:24 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-3ee0af50-a2e5-4f6a-ac82-4e1703d6b322 tempest-ProjectMemberTests-908908227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:47:24 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bde6fc-0358-4178-a06a-b1510f799eb7]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:47:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3ee0af50-a2e5-4f6a-ac82-4e1703d6b322 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:24 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3 Jul 11 04:47:24 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:24 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-2c827797-8fa0-4f46-9df4-c2af7ec5adb9 tempest-ProjectReaderTests-759668919 None] Acquiring lock "cinder-9d49a4aa-5eac-4ea4-a06a-1a507b59e2f0-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:47:24 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-2c827797-8fa0-4f46-9df4-c2af7ec5adb9 tempest-ProjectReaderTests-759668919 None] Lock "cinder-9d49a4aa-5eac-4ea4-a06a-1a507b59e2f0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:47:24 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-2c827797-8fa0-4f46-9df4-c2af7ec5adb9 tempest-ProjectReaderTests-759668919 None] Acquiring lock "cinder-quobyte-9d49a4aa-5eac-4ea4-a06a-1a507b59e2f0" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:47:24 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-2c827797-8fa0-4f46-9df4-c2af7ec5adb9 tempest-ProjectReaderTests-759668919 None] Lock "cinder-quobyte-9d49a4aa-5eac-4ea4-a06a-1a507b59e2f0" acquired by "delete_volume" :: waited 0.019s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:47:24 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9d9ca6-ac51-42a0-bfbe-3611c1197dad]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:47:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2c827797-8fa0-4f46-9df4-c2af7ec5adb9 tempest-ProjectReaderTests-759668919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9d49a4aa-5eac-4ea4-a06a-1a507b59e2f0 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:24 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9d49a4aa-5eac-4ea4-a06a-1a507b59e2f0 Jul 11 04:47:24 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:24 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3ee0af50-a2e5-4f6a-ac82-4e1703d6b322 tempest-ProjectMemberTests-908908227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3" returned: 0 in 0.769s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3ee0af50-a2e5-4f6a-ac82-4e1703d6b322 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3.78b5ad8e-a0c1-4d31-b5dc-e8a5a46fa3cf {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:24 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3.78b5ad8e-a0c1-4d31-b5dc-e8a5a46fa3cf Jul 11 04:47:24 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:25 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2c827797-8fa0-4f46-9df4-c2af7ec5adb9 tempest-ProjectReaderTests-759668919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9d49a4aa-5eac-4ea4-a06a-1a507b59e2f0" returned: 0 in 0.758s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2c827797-8fa0-4f46-9df4-c2af7ec5adb9 tempest-ProjectReaderTests-759668919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9d49a4aa-5eac-4ea4-a06a-1a507b59e2f0 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:25 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9d49a4aa-5eac-4ea4-a06a-1a507b59e2f0 Jul 11 04:47:25 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:25 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3ee0af50-a2e5-4f6a-ac82-4e1703d6b322 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3.78b5ad8e-a0c1-4d31-b5dc-e8a5a46fa3cf" returned: 0 in 0.744s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3ee0af50-a2e5-4f6a-ac82-4e1703d6b322 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3.78b5ad8e-a0c1-4d31-b5dc-e8a5a46fa3cf {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:25 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3.78b5ad8e-a0c1-4d31-b5dc-e8a5a46fa3cf Jul 11 04:47:25 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:26 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2c827797-8fa0-4f46-9df4-c2af7ec5adb9 tempest-ProjectReaderTests-759668919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-9d49a4aa-5eac-4ea4-a06a-1a507b59e2f0" returned: 0 in 0.661s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:26 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-2c827797-8fa0-4f46-9df4-c2af7ec5adb9 tempest-ProjectReaderTests-759668919 None] Lock "cinder-quobyte-9d49a4aa-5eac-4ea4-a06a-1a507b59e2f0" released by "delete_volume" :: held 1.461s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:47:26 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-2c827797-8fa0-4f46-9df4-c2af7ec5adb9 tempest-ProjectReaderTests-759668919 None] Created reservations ['0b0a72df-c128-4f84-a741-45329838bf04', '52e08f39-683a-4caf-bc8f-5ec94d674234', '3f906dfb-a146-4d35-a570-56d310a05ca0', '5ec05c7b-f60b-4b24-89ae-5c93e886d8ca'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:47:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2c827797-8fa0-4f46-9df4-c2af7ec5adb9 tempest-ProjectReaderTests-759668919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:47:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2c827797-8fa0-4f46-9df4-c2af7ec5adb9 tempest-ProjectReaderTests-759668919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:47:26 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2c827797-8fa0-4f46-9df4-c2af7ec5adb9 tempest-ProjectReaderTests-759668919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:47:26 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-2c827797-8fa0-4f46-9df4-c2af7ec5adb9 tempest-ProjectReaderTests-759668919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:47:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-2c827797-8fa0-4f46-9df4-c2af7ec5adb9 tempest-ProjectReaderTests-759668919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:47:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2c827797-8fa0-4f46-9df4-c2af7ec5adb9 tempest-ProjectReaderTests-759668919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:26 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3ee0af50-a2e5-4f6a-ac82-4e1703d6b322 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3.78b5ad8e-a0c1-4d31-b5dc-e8a5a46fa3cf" returned: 0 in 0.634s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:26 devstack sudo[107392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:47:26 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:26 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3ee0af50-a2e5-4f6a-ac82-4e1703d6b322 tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-78b5ad8e-a0c1-4d31-b5dc-e8a5a46fa3cf" released by "_delete_snapshot" :: held 3.013s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:47:26 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3ee0af50-a2e5-4f6a-ac82-4e1703d6b322 tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3" released by "delete_snapshot" :: held 3.037s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:47:26 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-3ee0af50-a2e5-4f6a-ac82-4e1703d6b322 tempest-ProjectMemberTests-908908227 None] Created reservations ['eaaf6a05-ce15-4708-9b26-4fb5cfb23f29', 'c4a122aa-e426-4b0c-9e2b-244b22887d4d', 'e9391508-60b1-45bd-9c80-1b8889928322', 'fec5b202-5c35-41c2-be0c-06242460dbb6'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:47:26 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-3ee0af50-a2e5-4f6a-ac82-4e1703d6b322 tempest-ProjectMemberTests-908908227 None] Delete snapshot completed successfully. Jul 11 04:47:26 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3ee0af50-a2e5-4f6a-ac82-4e1703d6b322 tempest-ProjectMemberTests-908908227 None] Lock "cinder-78b5ad8e-a0c1-4d31-b5dc-e8a5a46fa3cf-delete_snapshot" released by "delete_snapshot" :: held 3.184s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:47:26 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-2c827797-8fa0-4f46-9df4-c2af7ec5adb9 tempest-ProjectReaderTests-759668919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.627s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:26 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-2c827797-8fa0-4f46-9df4-c2af7ec5adb9 tempest-ProjectReaderTests-759668919 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:47:26 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-2c827797-8fa0-4f46-9df4-c2af7ec5adb9 tempest-ProjectReaderTests-759668919 None] Deleted volume successfully. Jul 11 04:47:26 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-2c827797-8fa0-4f46-9df4-c2af7ec5adb9 tempest-ProjectReaderTests-759668919 None] Lock "cinder-9d49a4aa-5eac-4ea4-a06a-1a507b59e2f0-delete_volume" released by "delete_volume" :: held 2.287s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:47:27 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-286f5d3c-d2fc-4143-918c-bed1bbe7b4c3 tempest-ProjectReaderTests-759668919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:47:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-286f5d3c-d2fc-4143-918c-bed1bbe7b4c3 tempest-ProjectReaderTests-759668919 None] Flow 'volume_create_manager' (efab390f-140d-4fb1-98d7-37d26ad88af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:47:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-286f5d3c-d2fc-4143-918c-bed1bbe7b4c3 tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bd59412-4849-4484-8bda-01ebddc5c7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-286f5d3c-d2fc-4143-918c-bed1bbe7b4c3 tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bd59412-4849-4484-8bda-01ebddc5c7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1480684565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77165592-e22c-4b33-ab4b-d37af238e24b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b9b380736324a19aadd16e361673d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:47:27Z,use_quota=True,user_id='7ee8507866654be6a39402147bde3978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-286f5d3c-d2fc-4143-918c-bed1bbe7b4c3 tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2595e82f-f01b-4cd5-a932-48055d15f403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-286f5d3c-d2fc-4143-918c-bed1bbe7b4c3 tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2595e82f-f01b-4cd5-a932-48055d15f403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-286f5d3c-d2fc-4143-918c-bed1bbe7b4c3 tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdfe48a2-03c2-4af7-9a44-bb3257c4a1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-286f5d3c-d2fc-4143-918c-bed1bbe7b4c3 tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdfe48a2-03c2-4af7-9a44-bb3257c4a1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77165592-e22c-4b33-ab4b-d37af238e24b', 'volume_name': 'volume-77165592-e22c-4b33-ab4b-d37af238e24b', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-286f5d3c-d2fc-4143-918c-bed1bbe7b4c3 tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5670f100-e133-4dcb-a072-602d14a89b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-286f5d3c-d2fc-4143-918c-bed1bbe7b4c3 tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5670f100-e133-4dcb-a072-602d14a89b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:27 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-286f5d3c-d2fc-4143-918c-bed1bbe7b4c3 tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67975a9f-2c53-4f20-a26e-7675ab62ba6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:27 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-286f5d3c-d2fc-4143-918c-bed1bbe7b4c3 tempest-ProjectReaderTests-759668919 None] Volume 77165592-e22c-4b33-ab4b-d37af238e24b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77165592-e22c-4b33-ab4b-d37af238e24b', 'volume_size': 1} Jul 11 04:47:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-286f5d3c-d2fc-4143-918c-bed1bbe7b4c3 tempest-ProjectReaderTests-759668919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:47:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-286f5d3c-d2fc-4143-918c-bed1bbe7b4c3 tempest-ProjectReaderTests-759668919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:47:27 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-286f5d3c-d2fc-4143-918c-bed1bbe7b4c3 tempest-ProjectReaderTests-759668919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1480684565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77165592-e22c-4b33-ab4b-d37af238e24b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b9b380736324a19aadd16e361673d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:47:27Z,use_quota=True,user_id='7ee8507866654be6a39402147bde3978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:47:27 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-286f5d3c-d2fc-4143-918c-bed1bbe7b4c3 tempest-ProjectReaderTests-759668919 None] Creating volume 77165592-e22c-4b33-ab4b-d37af238e24b {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:47:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-286f5d3c-d2fc-4143-918c-bed1bbe7b4c3 tempest-ProjectReaderTests-759668919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:47:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-286f5d3c-d2fc-4143-918c-bed1bbe7b4c3 tempest-ProjectReaderTests-759668919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:47:27 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-286f5d3c-d2fc-4143-918c-bed1bbe7b4c3 tempest-ProjectReaderTests-759668919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:47:27 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-286f5d3c-d2fc-4143-918c-bed1bbe7b4c3 tempest-ProjectReaderTests-759668919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:47:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-286f5d3c-d2fc-4143-918c-bed1bbe7b4c3 tempest-ProjectReaderTests-759668919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:47:27 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-286f5d3c-d2fc-4143-918c-bed1bbe7b4c3 tempest-ProjectReaderTests-759668919 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:47:27 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-286f5d3c-d2fc-4143-918c-bed1bbe7b4c3 tempest-ProjectReaderTests-759668919 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:47:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-286f5d3c-d2fc-4143-918c-bed1bbe7b4c3 tempest-ProjectReaderTests-759668919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77165592-e22c-4b33-ab4b-d37af238e24b 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:27 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77165592-e22c-4b33-ab4b-d37af238e24b 1073741824 Jul 11 04:47:27 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:27 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-7466ed3a-ddf8-4ba9-b8cd-3509c9878db4 tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:47:27 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-7466ed3a-ddf8-4ba9-b8cd-3509c9878db4 tempest-ProjectMemberTests-908908227 None] Lock "cinder-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:47:27 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-7466ed3a-ddf8-4ba9-b8cd-3509c9878db4 tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-quobyte-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:47:27 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-7466ed3a-ddf8-4ba9-b8cd-3509c9878db4 tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3" acquired by "delete_volume" :: waited 0.017s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:47:27 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ae4bc7-fecc-45e0-bdf2-1aa37d1e7474]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:47:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7466ed3a-ddf8-4ba9-b8cd-3509c9878db4 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:27 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3 Jul 11 04:47:27 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:28 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-286f5d3c-d2fc-4143-918c-bed1bbe7b4c3 tempest-ProjectReaderTests-759668919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77165592-e22c-4b33-ab4b-d37af238e24b 1073741824" returned: 0 in 0.806s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-286f5d3c-d2fc-4143-918c-bed1bbe7b4c3 tempest-ProjectReaderTests-759668919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77165592-e22c-4b33-ab4b-d37af238e24b {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:28 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77165592-e22c-4b33-ab4b-d37af238e24b Jul 11 04:47:28 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:28 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7466ed3a-ddf8-4ba9-b8cd-3509c9878db4 tempest-ProjectMemberTests-908908227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3" returned: 0 in 0.776s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7466ed3a-ddf8-4ba9-b8cd-3509c9878db4 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:28 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3 Jul 11 04:47:28 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:28 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-286f5d3c-d2fc-4143-918c-bed1bbe7b4c3 tempest-ProjectReaderTests-759668919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77165592-e22c-4b33-ab4b-d37af238e24b" returned: 0 in 0.629s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:28 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-286f5d3c-d2fc-4143-918c-bed1bbe7b4c3 tempest-ProjectReaderTests-759668919 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:47:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-286f5d3c-d2fc-4143-918c-bed1bbe7b4c3 tempest-ProjectReaderTests-759668919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:47:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-286f5d3c-d2fc-4143-918c-bed1bbe7b4c3 tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67975a9f-2c53-4f20-a26e-7675ab62ba6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77165592-e22c-4b33-ab4b-d37af238e24b', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-286f5d3c-d2fc-4143-918c-bed1bbe7b4c3 tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67e3e9b4-1453-4ae5-bd5d-5765423b5464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:28 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-286f5d3c-d2fc-4143-918c-bed1bbe7b4c3 tempest-ProjectReaderTests-759668919 None] Volume volume-77165592-e22c-4b33-ab4b-d37af238e24b (77165592-e22c-4b33-ab4b-d37af238e24b): created successfully Jul 11 04:47:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-286f5d3c-d2fc-4143-918c-bed1bbe7b4c3 tempest-ProjectReaderTests-759668919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67e3e9b4-1453-4ae5-bd5d-5765423b5464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-286f5d3c-d2fc-4143-918c-bed1bbe7b4c3 tempest-ProjectReaderTests-759668919 None] Flow 'volume_create_manager' (efab390f-140d-4fb1-98d7-37d26ad88af5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:47:28 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-286f5d3c-d2fc-4143-918c-bed1bbe7b4c3 tempest-ProjectReaderTests-759668919 None] Created volume successfully. Jul 11 04:47:29 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7466ed3a-ddf8-4ba9-b8cd-3509c9878db4 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3" returned: 0 in 0.652s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:29 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-7466ed3a-ddf8-4ba9-b8cd-3509c9878db4 tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3" released by "delete_volume" :: held 1.489s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:47:29 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-7466ed3a-ddf8-4ba9-b8cd-3509c9878db4 tempest-ProjectMemberTests-908908227 None] Created reservations ['28bdcd59-b248-49d6-8ad8-0408b1196c42', 'c288b9ef-b519-480f-8e15-c76648520d5f', 'b00d2496-069d-407d-927a-5bdc30d6b4d8', '2295bc73-8e7f-4071-9bd2-380a176f1f5a'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:47:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7466ed3a-ddf8-4ba9-b8cd-3509c9878db4 tempest-ProjectMemberTests-908908227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:47:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7466ed3a-ddf8-4ba9-b8cd-3509c9878db4 tempest-ProjectMemberTests-908908227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:47:29 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7466ed3a-ddf8-4ba9-b8cd-3509c9878db4 tempest-ProjectMemberTests-908908227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:47:29 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7466ed3a-ddf8-4ba9-b8cd-3509c9878db4 tempest-ProjectMemberTests-908908227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:47:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7466ed3a-ddf8-4ba9-b8cd-3509c9878db4 tempest-ProjectMemberTests-908908227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:47:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7466ed3a-ddf8-4ba9-b8cd-3509c9878db4 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:29 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:47:29 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:29 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-06985c05-3e7d-469e-9ac8-7aa494c9b92f tempest-ProjectReaderTests-759668919 None] Acquiring lock "cinder-77165592-e22c-4b33-ab4b-d37af238e24b-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:47:29 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-06985c05-3e7d-469e-9ac8-7aa494c9b92f tempest-ProjectReaderTests-759668919 None] Lock "cinder-77165592-e22c-4b33-ab4b-d37af238e24b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:47:29 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-06985c05-3e7d-469e-9ac8-7aa494c9b92f tempest-ProjectReaderTests-759668919 None] Acquiring lock "cinder-quobyte-77165592-e22c-4b33-ab4b-d37af238e24b" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:47:29 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-06985c05-3e7d-469e-9ac8-7aa494c9b92f tempest-ProjectReaderTests-759668919 None] Lock "cinder-quobyte-77165592-e22c-4b33-ab4b-d37af238e24b" acquired by "delete_volume" :: waited 0.017s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:47:29 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[336a173f-e9fe-460e-b6ea-25e5b79a0c32]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:47:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-06985c05-3e7d-469e-9ac8-7aa494c9b92f tempest-ProjectReaderTests-759668919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77165592-e22c-4b33-ab4b-d37af238e24b {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:29 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77165592-e22c-4b33-ab4b-d37af238e24b Jul 11 04:47:29 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:29 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7466ed3a-ddf8-4ba9-b8cd-3509c9878db4 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.663s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:29 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-7466ed3a-ddf8-4ba9-b8cd-3509c9878db4 tempest-ProjectMemberTests-908908227 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:47:29 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-7466ed3a-ddf8-4ba9-b8cd-3509c9878db4 tempest-ProjectMemberTests-908908227 None] Deleted volume successfully. Jul 11 04:47:29 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-7466ed3a-ddf8-4ba9-b8cd-3509c9878db4 tempest-ProjectMemberTests-908908227 None] Lock "cinder-c3c7d9ba-dcfa-489d-b7e5-741459dcd1c3-delete_volume" released by "delete_volume" :: held 2.350s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:47:30 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-c28ca152-0272-461a-8336-81f6d19d8b65 tempest-ProjectMemberTests-908908227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:47:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c28ca152-0272-461a-8336-81f6d19d8b65 tempest-ProjectMemberTests-908908227 None] Flow 'volume_create_manager' (5dae5d60-6c46-4530-8d44-3a8295b33fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:47:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c28ca152-0272-461a-8336-81f6d19d8b65 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b66d074f-f0c5-45ed-a616-bb8169a59b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c28ca152-0272-461a-8336-81f6d19d8b65 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b66d074f-f0c5-45ed-a616-bb8169a59b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-373546001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b85a4926-172f-4b21-89ff-58fa02521f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab7832e09784b2e931b228228b2c95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:47:30Z,use_quota=True,user_id='dc1e9d4141f14bd6a58aebc9231b6fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c28ca152-0272-461a-8336-81f6d19d8b65 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ddc4f77-ff4b-4b9b-9161-3b8ad30b2dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c28ca152-0272-461a-8336-81f6d19d8b65 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ddc4f77-ff4b-4b9b-9161-3b8ad30b2dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c28ca152-0272-461a-8336-81f6d19d8b65 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (537bf197-fc35-4712-a3a2-658136b932f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c28ca152-0272-461a-8336-81f6d19d8b65 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (537bf197-fc35-4712-a3a2-658136b932f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b85a4926-172f-4b21-89ff-58fa02521f50', 'volume_name': 'volume-b85a4926-172f-4b21-89ff-58fa02521f50', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c28ca152-0272-461a-8336-81f6d19d8b65 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22cbe97c-b59d-4ec3-baca-a8ddb0dded08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c28ca152-0272-461a-8336-81f6d19d8b65 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22cbe97c-b59d-4ec3-baca-a8ddb0dded08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:30 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c28ca152-0272-461a-8336-81f6d19d8b65 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4ee5206-c28f-4b3b-93c8-7a41ea75ee9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:30 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-c28ca152-0272-461a-8336-81f6d19d8b65 tempest-ProjectMemberTests-908908227 None] Volume b85a4926-172f-4b21-89ff-58fa02521f50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b85a4926-172f-4b21-89ff-58fa02521f50', 'volume_size': 1} Jul 11 04:47:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c28ca152-0272-461a-8336-81f6d19d8b65 tempest-ProjectMemberTests-908908227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:47:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c28ca152-0272-461a-8336-81f6d19d8b65 tempest-ProjectMemberTests-908908227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:47:30 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c28ca152-0272-461a-8336-81f6d19d8b65 tempest-ProjectMemberTests-908908227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-373546001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b85a4926-172f-4b21-89ff-58fa02521f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab7832e09784b2e931b228228b2c95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:47:30Z,use_quota=True,user_id='dc1e9d4141f14bd6a58aebc9231b6fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:47:30 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-c28ca152-0272-461a-8336-81f6d19d8b65 tempest-ProjectMemberTests-908908227 None] Creating volume b85a4926-172f-4b21-89ff-58fa02521f50 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:47:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c28ca152-0272-461a-8336-81f6d19d8b65 tempest-ProjectMemberTests-908908227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:47:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c28ca152-0272-461a-8336-81f6d19d8b65 tempest-ProjectMemberTests-908908227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:47:30 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c28ca152-0272-461a-8336-81f6d19d8b65 tempest-ProjectMemberTests-908908227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:47:30 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c28ca152-0272-461a-8336-81f6d19d8b65 tempest-ProjectMemberTests-908908227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:47:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c28ca152-0272-461a-8336-81f6d19d8b65 tempest-ProjectMemberTests-908908227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:47:30 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c28ca152-0272-461a-8336-81f6d19d8b65 tempest-ProjectMemberTests-908908227 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:47:30 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-c28ca152-0272-461a-8336-81f6d19d8b65 tempest-ProjectMemberTests-908908227 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:47:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c28ca152-0272-461a-8336-81f6d19d8b65 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:30 devstack sudo[107419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50 1073741824 Jul 11 04:47:30 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:30 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-06985c05-3e7d-469e-9ac8-7aa494c9b92f tempest-ProjectReaderTests-759668919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77165592-e22c-4b33-ab4b-d37af238e24b" returned: 0 in 0.830s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-06985c05-3e7d-469e-9ac8-7aa494c9b92f tempest-ProjectReaderTests-759668919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77165592-e22c-4b33-ab4b-d37af238e24b {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:30 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77165592-e22c-4b33-ab4b-d37af238e24b Jul 11 04:47:30 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:31 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-06985c05-3e7d-469e-9ac8-7aa494c9b92f tempest-ProjectReaderTests-759668919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-77165592-e22c-4b33-ab4b-d37af238e24b" returned: 0 in 0.661s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:31 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-06985c05-3e7d-469e-9ac8-7aa494c9b92f tempest-ProjectReaderTests-759668919 None] Lock "cinder-quobyte-77165592-e22c-4b33-ab4b-d37af238e24b" released by "delete_volume" :: held 1.536s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:47:31 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c28ca152-0272-461a-8336-81f6d19d8b65 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50 1073741824" returned: 0 in 0.794s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:31 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-06985c05-3e7d-469e-9ac8-7aa494c9b92f tempest-ProjectReaderTests-759668919 None] Created reservations ['1291ceb1-7e99-4f8f-928d-7059bf0f69af', '289e12b9-de80-41f5-a258-cc11ed2f34ca', '47e4f8a0-97f5-4268-8947-aec1778eb106', '1443f4b2-23cd-4e09-8c22-862ebf1a422b'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:47:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c28ca152-0272-461a-8336-81f6d19d8b65 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:31 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50 Jul 11 04:47:31 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-06985c05-3e7d-469e-9ac8-7aa494c9b92f tempest-ProjectReaderTests-759668919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:47:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-06985c05-3e7d-469e-9ac8-7aa494c9b92f tempest-ProjectReaderTests-759668919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:47:31 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-06985c05-3e7d-469e-9ac8-7aa494c9b92f tempest-ProjectReaderTests-759668919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:47:31 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-06985c05-3e7d-469e-9ac8-7aa494c9b92f tempest-ProjectReaderTests-759668919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:47:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-06985c05-3e7d-469e-9ac8-7aa494c9b92f tempest-ProjectReaderTests-759668919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:47:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-06985c05-3e7d-469e-9ac8-7aa494c9b92f tempest-ProjectReaderTests-759668919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:31 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:47:31 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:31 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-c28ca152-0272-461a-8336-81f6d19d8b65 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50" returned: 0 in 0.697s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:31 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-c28ca152-0272-461a-8336-81f6d19d8b65 tempest-ProjectMemberTests-908908227 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:47:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-c28ca152-0272-461a-8336-81f6d19d8b65 tempest-ProjectMemberTests-908908227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:47:31 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:31 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c28ca152-0272-461a-8336-81f6d19d8b65 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4ee5206-c28f-4b3b-93c8-7a41ea75ee9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b85a4926-172f-4b21-89ff-58fa02521f50', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:31 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c28ca152-0272-461a-8336-81f6d19d8b65 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a1a5fc9-6f01-4277-afb4-cea5f776aaee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-06985c05-3e7d-469e-9ac8-7aa494c9b92f tempest-ProjectReaderTests-759668919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.668s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:31 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-06985c05-3e7d-469e-9ac8-7aa494c9b92f tempest-ProjectReaderTests-759668919 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:47:31 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-06985c05-3e7d-469e-9ac8-7aa494c9b92f tempest-ProjectReaderTests-759668919 None] Deleted volume successfully. Jul 11 04:47:31 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-c28ca152-0272-461a-8336-81f6d19d8b65 tempest-ProjectMemberTests-908908227 None] Volume volume-b85a4926-172f-4b21-89ff-58fa02521f50 (b85a4926-172f-4b21-89ff-58fa02521f50): created successfully Jul 11 04:47:31 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c28ca152-0272-461a-8336-81f6d19d8b65 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a1a5fc9-6f01-4277-afb4-cea5f776aaee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:31 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-c28ca152-0272-461a-8336-81f6d19d8b65 tempest-ProjectMemberTests-908908227 None] Flow 'volume_create_manager' (5dae5d60-6c46-4530-8d44-3a8295b33fc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:47:31 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-c28ca152-0272-461a-8336-81f6d19d8b65 tempest-ProjectMemberTests-908908227 None] Created volume successfully. Jul 11 04:47:31 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-06985c05-3e7d-469e-9ac8-7aa494c9b92f tempest-ProjectReaderTests-759668919 None] Lock "cinder-77165592-e22c-4b33-ab4b-d37af238e24b-delete_volume" released by "delete_volume" :: held 2.451s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:47:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d0e2b68e-ac2a-4eab-9ae9-d14d28589ac5 tempest-ProjectMemberTests-908908227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:47:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d0e2b68e-ac2a-4eab-9ae9-d14d28589ac5 tempest-ProjectMemberTests-908908227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:47:32 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-d0e2b68e-ac2a-4eab-9ae9-d14d28589ac5 tempest-ProjectMemberTests-908908227 None] Creating offline snapshot 42080f9c-cf75-4f74-a105-04b8f6a66eb5 of volume b85a4926-172f-4b21-89ff-58fa02521f50 {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:47:32 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da71447-13a2-43ef-9218-fca6ec4a923e]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:47:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d0e2b68e-ac2a-4eab-9ae9-d14d28589ac5 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:32 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50 Jul 11 04:47:32 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:33 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d0e2b68e-ac2a-4eab-9ae9-d14d28589ac5 tempest-ProjectMemberTests-908908227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50" returned: 0 in 0.814s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d0e2b68e-ac2a-4eab-9ae9-d14d28589ac5 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50.42080f9c-cf75-4f74-a105-04b8f6a66eb5 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:33 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50.42080f9c-cf75-4f74-a105-04b8f6a66eb5 1G Jul 11 04:47:33 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:34 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d0e2b68e-ac2a-4eab-9ae9-d14d28589ac5 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50.42080f9c-cf75-4f74-a105-04b8f6a66eb5 1G" returned: 0 in 0.783s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d0e2b68e-ac2a-4eab-9ae9-d14d28589ac5 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b85a4926-172f-4b21-89ff-58fa02521f50 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50.42080f9c-cf75-4f74-a105-04b8f6a66eb5 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:34 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b85a4926-172f-4b21-89ff-58fa02521f50 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50.42080f9c-cf75-4f74-a105-04b8f6a66eb5 Jul 11 04:47:34 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:34 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d0e2b68e-ac2a-4eab-9ae9-d14d28589ac5 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b85a4926-172f-4b21-89ff-58fa02521f50 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50.42080f9c-cf75-4f74-a105-04b8f6a66eb5" returned: 0 in 0.679s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:34 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-d0e2b68e-ac2a-4eab-9ae9-d14d28589ac5 tempest-ProjectMemberTests-908908227 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50.42080f9c-cf75-4f74-a105-04b8f6a66eb5 is being set with open permissions: ugo+rw Jul 11 04:47:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d0e2b68e-ac2a-4eab-9ae9-d14d28589ac5 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50.42080f9c-cf75-4f74-a105-04b8f6a66eb5 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:34 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50.42080f9c-cf75-4f74-a105-04b8f6a66eb5 Jul 11 04:47:34 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:35 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d0e2b68e-ac2a-4eab-9ae9-d14d28589ac5 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50.42080f9c-cf75-4f74-a105-04b8f6a66eb5" returned: 0 in 0.638s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:35 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:UPDATE=140,cinder:SELECT=105,cinder:INSERT=43,cinder:DELETE=18 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:47:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d0e2b68e-ac2a-4eab-9ae9-d14d28589ac5 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:35 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50.info Jul 11 04:47:35 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:36 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d0e2b68e-ac2a-4eab-9ae9-d14d28589ac5 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50.info" returned: 0 in 0.625s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:36 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-d0e2b68e-ac2a-4eab-9ae9-d14d28589ac5 tempest-ProjectMemberTests-908908227 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50.info is being set with open permissions: ugo+rw Jul 11 04:47:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d0e2b68e-ac2a-4eab-9ae9-d14d28589ac5 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:36 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50.info Jul 11 04:47:36 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:36 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d0e2b68e-ac2a-4eab-9ae9-d14d28589ac5 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50.info" returned: 0 in 0.659s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d0e2b68e-ac2a-4eab-9ae9-d14d28589ac5 tempest-ProjectMemberTests-908908227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.278s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:47:36 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:UPDATE=144,cinder:DELETE=6,cinder:SELECT=111,cinder:INSERT=30 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:47:36 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-d0e2b68e-ac2a-4eab-9ae9-d14d28589ac5 tempest-ProjectMemberTests-908908227 None] Create snapshot completed successfully Jul 11 04:47:37 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-88390be8-70ac-4fa7-964f-f610d2299595 tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-42080f9c-cf75-4f74-a105-04b8f6a66eb5-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:47:37 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-88390be8-70ac-4fa7-964f-f610d2299595 tempest-ProjectMemberTests-908908227 None] Lock "cinder-42080f9c-cf75-4f74-a105-04b8f6a66eb5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:47:37 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-88390be8-70ac-4fa7-964f-f610d2299595 tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-quobyte-b85a4926-172f-4b21-89ff-58fa02521f50" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:47:37 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-88390be8-70ac-4fa7-964f-f610d2299595 tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-b85a4926-172f-4b21-89ff-58fa02521f50" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:47:37 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-88390be8-70ac-4fa7-964f-f610d2299595 tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-quobyte-42080f9c-cf75-4f74-a105-04b8f6a66eb5" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:47:37 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-88390be8-70ac-4fa7-964f-f610d2299595 tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-42080f9c-cf75-4f74-a105-04b8f6a66eb5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:47:37 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-88390be8-70ac-4fa7-964f-f610d2299595 tempest-ProjectMemberTests-908908227 None] Deleting offline snapshot 42080f9c-cf75-4f74-a105-04b8f6a66eb5 of volume b85a4926-172f-4b21-89ff-58fa02521f50 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:47:37 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-88390be8-70ac-4fa7-964f-f610d2299595 tempest-ProjectMemberTests-908908227 None] snapshot_file for this snap is: volume-b85a4926-172f-4b21-89ff-58fa02521f50.42080f9c-cf75-4f74-a105-04b8f6a66eb5 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:47:37 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[61aea228-c81d-415e-9cba-e0d8b7dbca03]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:47:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-88390be8-70ac-4fa7-964f-f610d2299595 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50.42080f9c-cf75-4f74-a105-04b8f6a66eb5 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:37 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50.42080f9c-cf75-4f74-a105-04b8f6a66eb5 Jul 11 04:47:37 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:38 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-88390be8-70ac-4fa7-964f-f610d2299595 tempest-ProjectMemberTests-908908227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50.42080f9c-cf75-4f74-a105-04b8f6a66eb5" returned: 0 in 0.748s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:38 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-88390be8-70ac-4fa7-964f-f610d2299595 tempest-ProjectMemberTests-908908227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b85a4926-172f-4b21-89ff-58fa02521f50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:47:38 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3e0124-9c1f-4c59-920c-0f0b48f1fbd6]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:47:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-88390be8-70ac-4fa7-964f-f610d2299595 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:38 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50 Jul 11 04:47:38 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:39 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-88390be8-70ac-4fa7-964f-f610d2299595 tempest-ProjectMemberTests-908908227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50" returned: 0 in 0.733s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-88390be8-70ac-4fa7-964f-f610d2299595 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50.42080f9c-cf75-4f74-a105-04b8f6a66eb5 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:39 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50.42080f9c-cf75-4f74-a105-04b8f6a66eb5 Jul 11 04:47:39 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:39 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-88390be8-70ac-4fa7-964f-f610d2299595 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50.42080f9c-cf75-4f74-a105-04b8f6a66eb5" returned: 0 in 0.719s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-88390be8-70ac-4fa7-964f-f610d2299595 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50.42080f9c-cf75-4f74-a105-04b8f6a66eb5 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:39 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50.42080f9c-cf75-4f74-a105-04b8f6a66eb5 Jul 11 04:47:39 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:40 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-88390be8-70ac-4fa7-964f-f610d2299595 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50.42080f9c-cf75-4f74-a105-04b8f6a66eb5" returned: 0 in 0.620s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:40 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-88390be8-70ac-4fa7-964f-f610d2299595 tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-42080f9c-cf75-4f74-a105-04b8f6a66eb5" released by "_delete_snapshot" :: held 2.901s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:47:40 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-88390be8-70ac-4fa7-964f-f610d2299595 tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-b85a4926-172f-4b21-89ff-58fa02521f50" released by "delete_snapshot" :: held 2.921s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:47:40 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-88390be8-70ac-4fa7-964f-f610d2299595 tempest-ProjectMemberTests-908908227 None] Created reservations ['fc3fae08-f93e-4ca0-991b-f13f4cb6d53f', '0f4b3668-fd6e-4304-9c22-505ec413621d', 'baa3dec3-7406-43ea-aa5c-7295065c82c1', '3719aecc-9d1f-4348-84a1-e1879b33a124'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:47:40 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-88390be8-70ac-4fa7-964f-f610d2299595 tempest-ProjectMemberTests-908908227 None] Delete snapshot completed successfully. Jul 11 04:47:40 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-88390be8-70ac-4fa7-964f-f610d2299595 tempest-ProjectMemberTests-908908227 None] Lock "cinder-42080f9c-cf75-4f74-a105-04b8f6a66eb5-delete_snapshot" released by "delete_snapshot" :: held 3.045s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:47:40 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ca73917e-d954-48c5-8e10-4cf08856b55c tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-b85a4926-172f-4b21-89ff-58fa02521f50-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:47:40 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ca73917e-d954-48c5-8e10-4cf08856b55c tempest-ProjectMemberTests-908908227 None] Lock "cinder-b85a4926-172f-4b21-89ff-58fa02521f50-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:47:40 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ca73917e-d954-48c5-8e10-4cf08856b55c tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-quobyte-b85a4926-172f-4b21-89ff-58fa02521f50" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:47:40 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ca73917e-d954-48c5-8e10-4cf08856b55c tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-b85a4926-172f-4b21-89ff-58fa02521f50" acquired by "delete_volume" :: waited 0.014s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:47:40 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d7ac09-d1fa-4d63-85d3-2549ac72b407]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:47:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ca73917e-d954-48c5-8e10-4cf08856b55c tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:41 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50 Jul 11 04:47:41 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:41 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ca73917e-d954-48c5-8e10-4cf08856b55c tempest-ProjectMemberTests-908908227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50" returned: 0 in 0.731s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ca73917e-d954-48c5-8e10-4cf08856b55c tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:41 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50 Jul 11 04:47:41 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:42 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ca73917e-d954-48c5-8e10-4cf08856b55c tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-b85a4926-172f-4b21-89ff-58fa02521f50" returned: 0 in 0.638s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:42 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ca73917e-d954-48c5-8e10-4cf08856b55c tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-b85a4926-172f-4b21-89ff-58fa02521f50" released by "delete_volume" :: held 1.423s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:47:42 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-ca73917e-d954-48c5-8e10-4cf08856b55c tempest-ProjectMemberTests-908908227 None] Created reservations ['4a259478-ba36-464f-ac89-eb9f4a0c4804', '81168454-0e56-4ee6-908d-c85283dca6d3', '511ab380-5c76-438b-bc81-8b222c9e3891', '0890db57-3bba-40d8-879d-10a2a173024f'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:47:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ca73917e-d954-48c5-8e10-4cf08856b55c tempest-ProjectMemberTests-908908227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:47:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ca73917e-d954-48c5-8e10-4cf08856b55c tempest-ProjectMemberTests-908908227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:47:42 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ca73917e-d954-48c5-8e10-4cf08856b55c tempest-ProjectMemberTests-908908227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:47:42 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ca73917e-d954-48c5-8e10-4cf08856b55c tempest-ProjectMemberTests-908908227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:47:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ca73917e-d954-48c5-8e10-4cf08856b55c tempest-ProjectMemberTests-908908227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:47:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ca73917e-d954-48c5-8e10-4cf08856b55c tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:42 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:47:42 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:43 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ca73917e-d954-48c5-8e10-4cf08856b55c tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.644s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:43 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-ca73917e-d954-48c5-8e10-4cf08856b55c tempest-ProjectMemberTests-908908227 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:47:43 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-ca73917e-d954-48c5-8e10-4cf08856b55c tempest-ProjectMemberTests-908908227 None] Deleted volume successfully. Jul 11 04:47:43 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-ca73917e-d954-48c5-8e10-4cf08856b55c tempest-ProjectMemberTests-908908227 None] Lock "cinder-b85a4926-172f-4b21-89ff-58fa02521f50-delete_volume" released by "delete_volume" :: held 2.261s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:47:43 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-03f14c1e-a3f8-46c5-b177-757f66d21974 tempest-ProjectMemberTests-908908227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:47:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-03f14c1e-a3f8-46c5-b177-757f66d21974 tempest-ProjectMemberTests-908908227 None] Flow 'volume_create_manager' (b4dcf979-47b5-49e3-8459-7970d4f23811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:47:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-03f14c1e-a3f8-46c5-b177-757f66d21974 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b18d34f0-6edd-44a3-a2cd-68959ab306e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-03f14c1e-a3f8-46c5-b177-757f66d21974 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b18d34f0-6edd-44a3-a2cd-68959ab306e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1557329606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab7832e09784b2e931b228228b2c95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:47:43Z,use_quota=True,user_id='dc1e9d4141f14bd6a58aebc9231b6fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-03f14c1e-a3f8-46c5-b177-757f66d21974 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29aaadf0-1f45-4957-b268-491b3b4f6a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-03f14c1e-a3f8-46c5-b177-757f66d21974 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29aaadf0-1f45-4957-b268-491b3b4f6a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-03f14c1e-a3f8-46c5-b177-757f66d21974 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e7de49-dce3-4066-8c91-204006dca10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-03f14c1e-a3f8-46c5-b177-757f66d21974 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e7de49-dce3-4066-8c91-204006dca10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b', 'volume_name': 'volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-03f14c1e-a3f8-46c5-b177-757f66d21974 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d4299ee-6eeb-4566-8dc7-6d04d948fa74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-03f14c1e-a3f8-46c5-b177-757f66d21974 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d4299ee-6eeb-4566-8dc7-6d04d948fa74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:43 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-03f14c1e-a3f8-46c5-b177-757f66d21974 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e632f0-d64e-4087-b12a-8b67da4cd9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:43 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-03f14c1e-a3f8-46c5-b177-757f66d21974 tempest-ProjectMemberTests-908908227 None] Volume 65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b', 'volume_size': 1} Jul 11 04:47:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-03f14c1e-a3f8-46c5-b177-757f66d21974 tempest-ProjectMemberTests-908908227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:47:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-03f14c1e-a3f8-46c5-b177-757f66d21974 tempest-ProjectMemberTests-908908227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:47:43 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-03f14c1e-a3f8-46c5-b177-757f66d21974 tempest-ProjectMemberTests-908908227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1557329606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab7832e09784b2e931b228228b2c95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:47:43Z,use_quota=True,user_id='dc1e9d4141f14bd6a58aebc9231b6fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:47:43 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-03f14c1e-a3f8-46c5-b177-757f66d21974 tempest-ProjectMemberTests-908908227 None] Creating volume 65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:47:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-03f14c1e-a3f8-46c5-b177-757f66d21974 tempest-ProjectMemberTests-908908227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:47:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-03f14c1e-a3f8-46c5-b177-757f66d21974 tempest-ProjectMemberTests-908908227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:47:43 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-03f14c1e-a3f8-46c5-b177-757f66d21974 tempest-ProjectMemberTests-908908227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:47:43 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-03f14c1e-a3f8-46c5-b177-757f66d21974 tempest-ProjectMemberTests-908908227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:47:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-03f14c1e-a3f8-46c5-b177-757f66d21974 tempest-ProjectMemberTests-908908227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:47:43 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-03f14c1e-a3f8-46c5-b177-757f66d21974 tempest-ProjectMemberTests-908908227 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:47:43 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-03f14c1e-a3f8-46c5-b177-757f66d21974 tempest-ProjectMemberTests-908908227 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:47:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-03f14c1e-a3f8-46c5-b177-757f66d21974 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:43 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b 1073741824 Jul 11 04:47:43 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:44 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-03f14c1e-a3f8-46c5-b177-757f66d21974 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b 1073741824" returned: 0 in 0.782s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:44 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-03f14c1e-a3f8-46c5-b177-757f66d21974 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:44 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b Jul 11 04:47:44 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:45 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-03f14c1e-a3f8-46c5-b177-757f66d21974 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b" returned: 0 in 0.644s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-03f14c1e-a3f8-46c5-b177-757f66d21974 tempest-ProjectMemberTests-908908227 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:47:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-03f14c1e-a3f8-46c5-b177-757f66d21974 tempest-ProjectMemberTests-908908227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:47:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-03f14c1e-a3f8-46c5-b177-757f66d21974 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e632f0-d64e-4087-b12a-8b67da4cd9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-03f14c1e-a3f8-46c5-b177-757f66d21974 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f633a5f2-15fe-47b9-b500-e6ddfd9bd6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:45 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-03f14c1e-a3f8-46c5-b177-757f66d21974 tempest-ProjectMemberTests-908908227 None] Volume volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b (65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b): created successfully Jul 11 04:47:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-03f14c1e-a3f8-46c5-b177-757f66d21974 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f633a5f2-15fe-47b9-b500-e6ddfd9bd6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:45 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-03f14c1e-a3f8-46c5-b177-757f66d21974 tempest-ProjectMemberTests-908908227 None] Flow 'volume_create_manager' (b4dcf979-47b5-49e3-8459-7970d4f23811) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:47:45 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-03f14c1e-a3f8-46c5-b177-757f66d21974 tempest-ProjectMemberTests-908908227 None] Created volume successfully. Jul 11 04:47:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d2b4fd69-d6f6-4564-89c7-fb33dcd81014 tempest-ProjectMemberTests-908908227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:47:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d2b4fd69-d6f6-4564-89c7-fb33dcd81014 tempest-ProjectMemberTests-908908227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:47:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-d2b4fd69-d6f6-4564-89c7-fb33dcd81014 tempest-ProjectMemberTests-908908227 None] Creating offline snapshot e1be7b1e-ec57-4de2-b922-9ce980efca63 of volume 65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:47:45 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d9d1fa-aeff-419e-976a-47b18309e04c]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:47:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d2b4fd69-d6f6-4564-89c7-fb33dcd81014 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:45 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b Jul 11 04:47:45 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:46 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d2b4fd69-d6f6-4564-89c7-fb33dcd81014 tempest-ProjectMemberTests-908908227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b" returned: 0 in 0.755s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d2b4fd69-d6f6-4564-89c7-fb33dcd81014 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b.e1be7b1e-ec57-4de2-b922-9ce980efca63 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:46 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b.e1be7b1e-ec57-4de2-b922-9ce980efca63 1G Jul 11 04:47:46 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:47 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d2b4fd69-d6f6-4564-89c7-fb33dcd81014 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b.e1be7b1e-ec57-4de2-b922-9ce980efca63 1G" returned: 0 in 0.782s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d2b4fd69-d6f6-4564-89c7-fb33dcd81014 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b.e1be7b1e-ec57-4de2-b922-9ce980efca63 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:47 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b.e1be7b1e-ec57-4de2-b922-9ce980efca63 Jul 11 04:47:47 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:47 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d2b4fd69-d6f6-4564-89c7-fb33dcd81014 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b.e1be7b1e-ec57-4de2-b922-9ce980efca63" returned: 0 in 0.696s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:47 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-d2b4fd69-d6f6-4564-89c7-fb33dcd81014 tempest-ProjectMemberTests-908908227 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b.e1be7b1e-ec57-4de2-b922-9ce980efca63 is being set with open permissions: ugo+rw Jul 11 04:47:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d2b4fd69-d6f6-4564-89c7-fb33dcd81014 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b.e1be7b1e-ec57-4de2-b922-9ce980efca63 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:48 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b.e1be7b1e-ec57-4de2-b922-9ce980efca63 Jul 11 04:47:48 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:48 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d2b4fd69-d6f6-4564-89c7-fb33dcd81014 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b.e1be7b1e-ec57-4de2-b922-9ce980efca63" returned: 0 in 0.628s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d2b4fd69-d6f6-4564-89c7-fb33dcd81014 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:48 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b.info Jul 11 04:47:48 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:49 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d2b4fd69-d6f6-4564-89c7-fb33dcd81014 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b.info" returned: 0 in 0.648s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:49 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-d2b4fd69-d6f6-4564-89c7-fb33dcd81014 tempest-ProjectMemberTests-908908227 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b.info is being set with open permissions: ugo+rw Jul 11 04:47:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d2b4fd69-d6f6-4564-89c7-fb33dcd81014 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:49 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b.info Jul 11 04:47:49 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:49 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d2b4fd69-d6f6-4564-89c7-fb33dcd81014 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b.info" returned: 0 in 0.648s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d2b4fd69-d6f6-4564-89c7-fb33dcd81014 tempest-ProjectMemberTests-908908227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.289s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:47:49 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-d2b4fd69-d6f6-4564-89c7-fb33dcd81014 tempest-ProjectMemberTests-908908227 None] Create snapshot completed successfully Jul 11 04:47:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-631365f1-2391-4354-a8ab-117c92575e1e tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-e1be7b1e-ec57-4de2-b922-9ce980efca63-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:47:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-631365f1-2391-4354-a8ab-117c92575e1e tempest-ProjectMemberTests-908908227 None] Lock "cinder-e1be7b1e-ec57-4de2-b922-9ce980efca63-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:47:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-631365f1-2391-4354-a8ab-117c92575e1e tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-quobyte-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:47:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-631365f1-2391-4354-a8ab-117c92575e1e tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:47:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-631365f1-2391-4354-a8ab-117c92575e1e tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-quobyte-e1be7b1e-ec57-4de2-b922-9ce980efca63" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:47:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-631365f1-2391-4354-a8ab-117c92575e1e tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-e1be7b1e-ec57-4de2-b922-9ce980efca63" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:47:50 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-631365f1-2391-4354-a8ab-117c92575e1e tempest-ProjectMemberTests-908908227 None] Deleting offline snapshot e1be7b1e-ec57-4de2-b922-9ce980efca63 of volume 65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:47:50 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-631365f1-2391-4354-a8ab-117c92575e1e tempest-ProjectMemberTests-908908227 None] snapshot_file for this snap is: volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b.e1be7b1e-ec57-4de2-b922-9ce980efca63 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:47:50 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[b935e980-380b-4149-a680-8922d4461a93]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:47:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-631365f1-2391-4354-a8ab-117c92575e1e tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b.e1be7b1e-ec57-4de2-b922-9ce980efca63 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:51 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b.e1be7b1e-ec57-4de2-b922-9ce980efca63 Jul 11 04:47:51 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:51 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-631365f1-2391-4354-a8ab-117c92575e1e tempest-ProjectMemberTests-908908227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b.e1be7b1e-ec57-4de2-b922-9ce980efca63" returned: 0 in 0.736s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:51 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-631365f1-2391-4354-a8ab-117c92575e1e tempest-ProjectMemberTests-908908227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:47:51 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e632254-149b-4865-bd2b-416d553bd22d]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:47:51 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-631365f1-2391-4354-a8ab-117c92575e1e tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:51 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b Jul 11 04:47:51 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:52 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-631365f1-2391-4354-a8ab-117c92575e1e tempest-ProjectMemberTests-908908227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b" returned: 0 in 0.750s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:52 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-631365f1-2391-4354-a8ab-117c92575e1e tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b.e1be7b1e-ec57-4de2-b922-9ce980efca63 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:52 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b.e1be7b1e-ec57-4de2-b922-9ce980efca63 Jul 11 04:47:52 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:53 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-631365f1-2391-4354-a8ab-117c92575e1e tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b.e1be7b1e-ec57-4de2-b922-9ce980efca63" returned: 0 in 0.724s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-631365f1-2391-4354-a8ab-117c92575e1e tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b.e1be7b1e-ec57-4de2-b922-9ce980efca63 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:53 devstack sudo[107538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b.e1be7b1e-ec57-4de2-b922-9ce980efca63 Jul 11 04:47:53 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:53 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:53 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-631365f1-2391-4354-a8ab-117c92575e1e tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b.e1be7b1e-ec57-4de2-b922-9ce980efca63" returned: 0 in 0.623s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:53 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-631365f1-2391-4354-a8ab-117c92575e1e tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-e1be7b1e-ec57-4de2-b922-9ce980efca63" released by "_delete_snapshot" :: held 2.923s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:47:53 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-631365f1-2391-4354-a8ab-117c92575e1e tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b" released by "delete_snapshot" :: held 2.946s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:47:53 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-631365f1-2391-4354-a8ab-117c92575e1e tempest-ProjectMemberTests-908908227 None] Created reservations ['a32b1064-0755-47f4-acfb-504ad1e89b9a', 'e6d5dfdc-cec9-4a6b-acfb-9aa015382054', '8f659a33-cbc8-4b74-a300-2dcaff562591', '3309fa44-52a1-4ff2-a0df-49b969bb1385'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:47:53 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-631365f1-2391-4354-a8ab-117c92575e1e tempest-ProjectMemberTests-908908227 None] Delete snapshot completed successfully. Jul 11 04:47:53 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-631365f1-2391-4354-a8ab-117c92575e1e tempest-ProjectMemberTests-908908227 None] Lock "cinder-e1be7b1e-ec57-4de2-b922-9ce980efca63-delete_snapshot" released by "delete_snapshot" :: held 3.075s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:47:54 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d1153c53-402d-49c2-abdb-b652fe94d344 tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:47:54 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d1153c53-402d-49c2-abdb-b652fe94d344 tempest-ProjectMemberTests-908908227 None] Lock "cinder-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:47:54 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d1153c53-402d-49c2-abdb-b652fe94d344 tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-quobyte-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:47:54 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d1153c53-402d-49c2-abdb-b652fe94d344 tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b" acquired by "delete_volume" :: waited 0.019s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:47:54 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[af27a500-0849-46ab-9e42-304c2aaf6f22]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:47:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d1153c53-402d-49c2-abdb-b652fe94d344 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:54 devstack sudo[107541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b Jul 11 04:47:54 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:54 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d1153c53-402d-49c2-abdb-b652fe94d344 tempest-ProjectMemberTests-908908227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b" returned: 0 in 0.733s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:54 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d1153c53-402d-49c2-abdb-b652fe94d344 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:54 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b Jul 11 04:47:54 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:55 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d1153c53-402d-49c2-abdb-b652fe94d344 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b" returned: 0 in 0.632s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:55 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d1153c53-402d-49c2-abdb-b652fe94d344 tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b" released by "delete_volume" :: held 1.423s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:47:55 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-d1153c53-402d-49c2-abdb-b652fe94d344 tempest-ProjectMemberTests-908908227 None] Created reservations ['5f03f9b4-acec-472d-b3b3-3c78423e1b8c', 'd72cac7f-409b-4d93-b96f-0856c7605893', '5f215a32-3794-438e-984c-5078e23dc6c4', 'e8b66d34-9606-46a6-a353-b94cda91ccb9'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:47:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d1153c53-402d-49c2-abdb-b652fe94d344 tempest-ProjectMemberTests-908908227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:47:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d1153c53-402d-49c2-abdb-b652fe94d344 tempest-ProjectMemberTests-908908227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:47:55 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-d1153c53-402d-49c2-abdb-b652fe94d344 tempest-ProjectMemberTests-908908227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:47:55 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-d1153c53-402d-49c2-abdb-b652fe94d344 tempest-ProjectMemberTests-908908227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:47:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-d1153c53-402d-49c2-abdb-b652fe94d344 tempest-ProjectMemberTests-908908227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:47:55 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d1153c53-402d-49c2-abdb-b652fe94d344 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:55 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:47:55 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:56 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-d1153c53-402d-49c2-abdb-b652fe94d344 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.638s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:56 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-d1153c53-402d-49c2-abdb-b652fe94d344 tempest-ProjectMemberTests-908908227 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:47:56 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-d1153c53-402d-49c2-abdb-b652fe94d344 tempest-ProjectMemberTests-908908227 None] Deleted volume successfully. Jul 11 04:47:56 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-d1153c53-402d-49c2-abdb-b652fe94d344 tempest-ProjectMemberTests-908908227 None] Lock "cinder-65d599f2-ae2e-4ae7-bc47-9b14e8e2d97b-delete_volume" released by "delete_volume" :: held 2.253s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:47:56 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d19374e-57e2-4b2c-86fd-9b10258fa800 tempest-ProjectMemberTests-908908227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:47:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7d19374e-57e2-4b2c-86fd-9b10258fa800 tempest-ProjectMemberTests-908908227 None] Flow 'volume_create_manager' (fe071306-9388-4284-8768-cd36aabd8cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:47:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7d19374e-57e2-4b2c-86fd-9b10258fa800 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28ab2da2-6014-4b51-85cc-a76ba9c6cc13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7d19374e-57e2-4b2c-86fd-9b10258fa800 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28ab2da2-6014-4b51-85cc-a76ba9c6cc13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:47:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-23017441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f7766b7-8ad5-4297-8fe4-d3abd851aca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab7832e09784b2e931b228228b2c95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:47:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:47:57Z,use_quota=True,user_id='dc1e9d4141f14bd6a58aebc9231b6fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7d19374e-57e2-4b2c-86fd-9b10258fa800 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acc76c15-931f-4e3b-bc4d-7ff43506130d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7d19374e-57e2-4b2c-86fd-9b10258fa800 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acc76c15-931f-4e3b-bc4d-7ff43506130d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7d19374e-57e2-4b2c-86fd-9b10258fa800 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9a93b12-f259-4659-be40-f812da52736c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7d19374e-57e2-4b2c-86fd-9b10258fa800 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9a93b12-f259-4659-be40-f812da52736c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f7766b7-8ad5-4297-8fe4-d3abd851aca0', 'volume_name': 'volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7d19374e-57e2-4b2c-86fd-9b10258fa800 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ec2549-9eb5-43fd-9dcb-14279ba36711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7d19374e-57e2-4b2c-86fd-9b10258fa800 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ec2549-9eb5-43fd-9dcb-14279ba36711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:56 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7d19374e-57e2-4b2c-86fd-9b10258fa800 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e44227bc-00c0-426d-a7f4-23bc1cffe064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:56 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-7d19374e-57e2-4b2c-86fd-9b10258fa800 tempest-ProjectMemberTests-908908227 None] Volume 5f7766b7-8ad5-4297-8fe4-d3abd851aca0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0', 'volume_size': 1} Jul 11 04:47:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7d19374e-57e2-4b2c-86fd-9b10258fa800 tempest-ProjectMemberTests-908908227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:47:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7d19374e-57e2-4b2c-86fd-9b10258fa800 tempest-ProjectMemberTests-908908227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:47:56 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7d19374e-57e2-4b2c-86fd-9b10258fa800 tempest-ProjectMemberTests-908908227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:47:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-23017441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f7766b7-8ad5-4297-8fe4-d3abd851aca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab7832e09784b2e931b228228b2c95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:47:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:47:57Z,use_quota=True,user_id='dc1e9d4141f14bd6a58aebc9231b6fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:47:56 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-7d19374e-57e2-4b2c-86fd-9b10258fa800 tempest-ProjectMemberTests-908908227 None] Creating volume 5f7766b7-8ad5-4297-8fe4-d3abd851aca0 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:47:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7d19374e-57e2-4b2c-86fd-9b10258fa800 tempest-ProjectMemberTests-908908227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:47:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7d19374e-57e2-4b2c-86fd-9b10258fa800 tempest-ProjectMemberTests-908908227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:47:56 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7d19374e-57e2-4b2c-86fd-9b10258fa800 tempest-ProjectMemberTests-908908227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:47:56 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7d19374e-57e2-4b2c-86fd-9b10258fa800 tempest-ProjectMemberTests-908908227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:47:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7d19374e-57e2-4b2c-86fd-9b10258fa800 tempest-ProjectMemberTests-908908227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:47:56 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7d19374e-57e2-4b2c-86fd-9b10258fa800 tempest-ProjectMemberTests-908908227 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:47:56 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-7d19374e-57e2-4b2c-86fd-9b10258fa800 tempest-ProjectMemberTests-908908227 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:47:56 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7d19374e-57e2-4b2c-86fd-9b10258fa800 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:56 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0 1073741824 Jul 11 04:47:56 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:57 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7d19374e-57e2-4b2c-86fd-9b10258fa800 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0 1073741824" returned: 0 in 0.793s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:57 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7d19374e-57e2-4b2c-86fd-9b10258fa800 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:57 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0 Jul 11 04:47:57 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:58 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-7d19374e-57e2-4b2c-86fd-9b10258fa800 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0" returned: 0 in 0.650s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-7d19374e-57e2-4b2c-86fd-9b10258fa800 tempest-ProjectMemberTests-908908227 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:47:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-7d19374e-57e2-4b2c-86fd-9b10258fa800 tempest-ProjectMemberTests-908908227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:47:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7d19374e-57e2-4b2c-86fd-9b10258fa800 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e44227bc-00c0-426d-a7f4-23bc1cffe064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7d19374e-57e2-4b2c-86fd-9b10258fa800 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (181857ee-44ab-44cc-84d1-a46083b92e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:47:58 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-7d19374e-57e2-4b2c-86fd-9b10258fa800 tempest-ProjectMemberTests-908908227 None] Volume volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0 (5f7766b7-8ad5-4297-8fe4-d3abd851aca0): created successfully Jul 11 04:47:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7d19374e-57e2-4b2c-86fd-9b10258fa800 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (181857ee-44ab-44cc-84d1-a46083b92e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:47:58 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-7d19374e-57e2-4b2c-86fd-9b10258fa800 tempest-ProjectMemberTests-908908227 None] Flow 'volume_create_manager' (fe071306-9388-4284-8768-cd36aabd8cb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:47:58 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-7d19374e-57e2-4b2c-86fd-9b10258fa800 tempest-ProjectMemberTests-908908227 None] Created volume successfully. Jul 11 04:47:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a36f0fce-75a8-4c2f-8b8d-19d6ec98f001 tempest-ProjectMemberTests-908908227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:47:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a36f0fce-75a8-4c2f-8b8d-19d6ec98f001 tempest-ProjectMemberTests-908908227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:47:58 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-a36f0fce-75a8-4c2f-8b8d-19d6ec98f001 tempest-ProjectMemberTests-908908227 None] Creating offline snapshot 97d6e8eb-a64f-4053-9b15-cdb29c5ec5c8 of volume 5f7766b7-8ad5-4297-8fe4-d3abd851aca0 {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:47:58 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8feff6-92a1-43d2-909f-39ffddccde31]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:47:58 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a36f0fce-75a8-4c2f-8b8d-19d6ec98f001 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:59 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0 Jul 11 04:47:59 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:59 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:47:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:47:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:47:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:47:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:47:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:47:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:59 devstack sudo[107564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:47:59 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:59 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a36f0fce-75a8-4c2f-8b8d-19d6ec98f001 tempest-ProjectMemberTests-908908227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0" returned: 0 in 0.741s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a36f0fce-75a8-4c2f-8b8d-19d6ec98f001 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0.97d6e8eb-a64f-4053-9b15-cdb29c5ec5c8 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:47:59 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0.97d6e8eb-a64f-4053-9b15-cdb29c5ec5c8 1G Jul 11 04:47:59 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:47:59 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root Jul 11 04:47:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.631s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:47:59 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:47:59 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager._thread_info {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:47:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread count: 28 {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:47:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread info: [<_MainThread(MainThread, started 124675027595392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:48:00 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a36f0fce-75a8-4c2f-8b8d-19d6ec98f001 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0.97d6e8eb-a64f-4053-9b15-cdb29c5ec5c8 1G" returned: 0 in 0.800s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:00 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a36f0fce-75a8-4c2f-8b8d-19d6ec98f001 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0.97d6e8eb-a64f-4053-9b15-cdb29c5ec5c8 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:00 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0.97d6e8eb-a64f-4053-9b15-cdb29c5ec5c8 Jul 11 04:48:00 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:01 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a36f0fce-75a8-4c2f-8b8d-19d6ec98f001 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0.97d6e8eb-a64f-4053-9b15-cdb29c5ec5c8" returned: 0 in 0.665s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:01 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-a36f0fce-75a8-4c2f-8b8d-19d6ec98f001 tempest-ProjectMemberTests-908908227 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0.97d6e8eb-a64f-4053-9b15-cdb29c5ec5c8 is being set with open permissions: ugo+rw Jul 11 04:48:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a36f0fce-75a8-4c2f-8b8d-19d6ec98f001 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0.97d6e8eb-a64f-4053-9b15-cdb29c5ec5c8 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:01 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0.97d6e8eb-a64f-4053-9b15-cdb29c5ec5c8 Jul 11 04:48:01 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:01 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a36f0fce-75a8-4c2f-8b8d-19d6ec98f001 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0.97d6e8eb-a64f-4053-9b15-cdb29c5ec5c8" returned: 0 in 0.610s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:01 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a36f0fce-75a8-4c2f-8b8d-19d6ec98f001 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:01 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0.info Jul 11 04:48:01 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:02 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a36f0fce-75a8-4c2f-8b8d-19d6ec98f001 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0.info" returned: 0 in 0.627s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:02 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-a36f0fce-75a8-4c2f-8b8d-19d6ec98f001 tempest-ProjectMemberTests-908908227 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0.info is being set with open permissions: ugo+rw Jul 11 04:48:02 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a36f0fce-75a8-4c2f-8b8d-19d6ec98f001 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:02 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0.info Jul 11 04:48:02 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:03 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a36f0fce-75a8-4c2f-8b8d-19d6ec98f001 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0.info" returned: 0 in 0.627s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:03 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-a36f0fce-75a8-4c2f-8b8d-19d6ec98f001 tempest-ProjectMemberTests-908908227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.144s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:48:03 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-a36f0fce-75a8-4c2f-8b8d-19d6ec98f001 tempest-ProjectMemberTests-908908227 None] Create snapshot completed successfully Jul 11 04:48:04 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1c576af3-1c96-4619-9721-cbee475b9c66 tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-97d6e8eb-a64f-4053-9b15-cdb29c5ec5c8-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:48:04 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1c576af3-1c96-4619-9721-cbee475b9c66 tempest-ProjectMemberTests-908908227 None] Lock "cinder-97d6e8eb-a64f-4053-9b15-cdb29c5ec5c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:48:04 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1c576af3-1c96-4619-9721-cbee475b9c66 tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-quobyte-5f7766b7-8ad5-4297-8fe4-d3abd851aca0" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:48:04 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1c576af3-1c96-4619-9721-cbee475b9c66 tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-5f7766b7-8ad5-4297-8fe4-d3abd851aca0" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:48:04 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1c576af3-1c96-4619-9721-cbee475b9c66 tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-quobyte-97d6e8eb-a64f-4053-9b15-cdb29c5ec5c8" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:48:04 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1c576af3-1c96-4619-9721-cbee475b9c66 tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-97d6e8eb-a64f-4053-9b15-cdb29c5ec5c8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:48:04 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-1c576af3-1c96-4619-9721-cbee475b9c66 tempest-ProjectMemberTests-908908227 None] Deleting offline snapshot 97d6e8eb-a64f-4053-9b15-cdb29c5ec5c8 of volume 5f7766b7-8ad5-4297-8fe4-d3abd851aca0 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:48:04 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-1c576af3-1c96-4619-9721-cbee475b9c66 tempest-ProjectMemberTests-908908227 None] snapshot_file for this snap is: volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0.97d6e8eb-a64f-4053-9b15-cdb29c5ec5c8 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:48:04 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f87c20a-cc43-481d-baaf-52d73756026b]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:48:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1c576af3-1c96-4619-9721-cbee475b9c66 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0.97d6e8eb-a64f-4053-9b15-cdb29c5ec5c8 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:04 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0.97d6e8eb-a64f-4053-9b15-cdb29c5ec5c8 Jul 11 04:48:04 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:04 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1c576af3-1c96-4619-9721-cbee475b9c66 tempest-ProjectMemberTests-908908227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0.97d6e8eb-a64f-4053-9b15-cdb29c5ec5c8" returned: 0 in 0.726s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:04 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-1c576af3-1c96-4619-9721-cbee475b9c66 tempest-ProjectMemberTests-908908227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:48:04 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8275040-9ed4-481a-b234-1ddaab408d5b]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:48:04 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1c576af3-1c96-4619-9721-cbee475b9c66 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:05 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0 Jul 11 04:48:05 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:05 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1c576af3-1c96-4619-9721-cbee475b9c66 tempest-ProjectMemberTests-908908227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0" returned: 0 in 0.732s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:05 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1c576af3-1c96-4619-9721-cbee475b9c66 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0.97d6e8eb-a64f-4053-9b15-cdb29c5ec5c8 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:05 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0.97d6e8eb-a64f-4053-9b15-cdb29c5ec5c8 Jul 11 04:48:05 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:06 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1c576af3-1c96-4619-9721-cbee475b9c66 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0.97d6e8eb-a64f-4053-9b15-cdb29c5ec5c8" returned: 0 in 0.708s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:06 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1c576af3-1c96-4619-9721-cbee475b9c66 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0.97d6e8eb-a64f-4053-9b15-cdb29c5ec5c8 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:06 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0.97d6e8eb-a64f-4053-9b15-cdb29c5ec5c8 Jul 11 04:48:06 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:07 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-1c576af3-1c96-4619-9721-cbee475b9c66 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0.97d6e8eb-a64f-4053-9b15-cdb29c5ec5c8" returned: 0 in 0.626s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:07 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1c576af3-1c96-4619-9721-cbee475b9c66 tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-97d6e8eb-a64f-4053-9b15-cdb29c5ec5c8" released by "_delete_snapshot" :: held 2.877s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:48:07 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1c576af3-1c96-4619-9721-cbee475b9c66 tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-5f7766b7-8ad5-4297-8fe4-d3abd851aca0" released by "delete_snapshot" :: held 2.899s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:48:07 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-1c576af3-1c96-4619-9721-cbee475b9c66 tempest-ProjectMemberTests-908908227 None] Created reservations ['99be9663-4c9a-4505-967d-a0c5016bac31', '9f93a8aa-c671-4eb3-9f13-a68cca78f359', '12ce9f24-654b-4aba-bbe2-e15e4bdcb8b7', '53b7695d-3bf3-404e-ab8c-789ad467fb07'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:48:07 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-1c576af3-1c96-4619-9721-cbee475b9c66 tempest-ProjectMemberTests-908908227 None] Delete snapshot completed successfully. Jul 11 04:48:07 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-1c576af3-1c96-4619-9721-cbee475b9c66 tempest-ProjectMemberTests-908908227 None] Lock "cinder-97d6e8eb-a64f-4053-9b15-cdb29c5ec5c8-delete_snapshot" released by "delete_snapshot" :: held 3.034s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:48:07 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3bf90605-b890-48d4-8f6d-236aa72c36ef tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-5f7766b7-8ad5-4297-8fe4-d3abd851aca0-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:48:07 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3bf90605-b890-48d4-8f6d-236aa72c36ef tempest-ProjectMemberTests-908908227 None] Lock "cinder-5f7766b7-8ad5-4297-8fe4-d3abd851aca0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:48:07 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3bf90605-b890-48d4-8f6d-236aa72c36ef tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-quobyte-5f7766b7-8ad5-4297-8fe4-d3abd851aca0" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:48:07 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3bf90605-b890-48d4-8f6d-236aa72c36ef tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-5f7766b7-8ad5-4297-8fe4-d3abd851aca0" acquired by "delete_volume" :: waited 0.014s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:48:07 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2dd964-6c5d-43d1-860e-e6d6b49776d7]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:48:07 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3bf90605-b890-48d4-8f6d-236aa72c36ef tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:07 devstack sudo[107609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0 Jul 11 04:48:07 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:08 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3bf90605-b890-48d4-8f6d-236aa72c36ef tempest-ProjectMemberTests-908908227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0" returned: 0 in 0.726s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3bf90605-b890-48d4-8f6d-236aa72c36ef tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:08 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0 Jul 11 04:48:08 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:08 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3bf90605-b890-48d4-8f6d-236aa72c36ef tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-5f7766b7-8ad5-4297-8fe4-d3abd851aca0" returned: 0 in 0.629s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:08 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3bf90605-b890-48d4-8f6d-236aa72c36ef tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-5f7766b7-8ad5-4297-8fe4-d3abd851aca0" released by "delete_volume" :: held 1.408s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:48:08 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-3bf90605-b890-48d4-8f6d-236aa72c36ef tempest-ProjectMemberTests-908908227 None] Created reservations ['a7d2c3f8-8f43-4663-abdd-d59ce3a7e5a0', '02b45957-20f8-4c12-a9a0-0dd5753da7f4', '2c69507e-3c66-4a01-bd5e-78bddaea2c4c', 'c095d071-4083-4119-b311-cbe1f8a8707c'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:48:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3bf90605-b890-48d4-8f6d-236aa72c36ef tempest-ProjectMemberTests-908908227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:48:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3bf90605-b890-48d4-8f6d-236aa72c36ef tempest-ProjectMemberTests-908908227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:48:08 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-3bf90605-b890-48d4-8f6d-236aa72c36ef tempest-ProjectMemberTests-908908227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:48:08 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-3bf90605-b890-48d4-8f6d-236aa72c36ef tempest-ProjectMemberTests-908908227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:48:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-3bf90605-b890-48d4-8f6d-236aa72c36ef tempest-ProjectMemberTests-908908227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:48:08 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3bf90605-b890-48d4-8f6d-236aa72c36ef tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:08 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:48:08 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:09 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:09 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-3bf90605-b890-48d4-8f6d-236aa72c36ef tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.628s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:09 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-3bf90605-b890-48d4-8f6d-236aa72c36ef tempest-ProjectMemberTests-908908227 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:48:09 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-3bf90605-b890-48d4-8f6d-236aa72c36ef tempest-ProjectMemberTests-908908227 None] Deleted volume successfully. Jul 11 04:48:09 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-3bf90605-b890-48d4-8f6d-236aa72c36ef tempest-ProjectMemberTests-908908227 None] Lock "cinder-5f7766b7-8ad5-4297-8fe4-d3abd851aca0-delete_volume" released by "delete_volume" :: held 2.222s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:48:09 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2f0b696-be64-409b-a5a7-9e5503c0c2c7 tempest-ProjectMemberTests-908908227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:48:09 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e2f0b696-be64-409b-a5a7-9e5503c0c2c7 tempest-ProjectMemberTests-908908227 None] Flow 'volume_create_manager' (c91da5b5-a0e0-47cf-a122-c2a62bb3dae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:48:09 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e2f0b696-be64-409b-a5a7-9e5503c0c2c7 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61b77d00-ce66-4d1d-af31-8b7b3c6b3731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:48:09 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e2f0b696-be64-409b-a5a7-9e5503c0c2c7 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61b77d00-ce66-4d1d-af31-8b7b3c6b3731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1581418130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd3c6e5f-9b81-4f71-8ce9-64f5ef862934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab7832e09784b2e931b228228b2c95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:48:10Z,use_quota=True,user_id='dc1e9d4141f14bd6a58aebc9231b6fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:48:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e2f0b696-be64-409b-a5a7-9e5503c0c2c7 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f3c312b-eeb7-48c8-a378-0d60470e85d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:48:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e2f0b696-be64-409b-a5a7-9e5503c0c2c7 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f3c312b-eeb7-48c8-a378-0d60470e85d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:48:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e2f0b696-be64-409b-a5a7-9e5503c0c2c7 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cf8a16c-95de-465b-a879-1118e12a4dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:48:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e2f0b696-be64-409b-a5a7-9e5503c0c2c7 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cf8a16c-95de-465b-a879-1118e12a4dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd3c6e5f-9b81-4f71-8ce9-64f5ef862934', 'volume_name': 'volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:48:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e2f0b696-be64-409b-a5a7-9e5503c0c2c7 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dea35aa-9e78-4122-873d-075d1d95da8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:48:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e2f0b696-be64-409b-a5a7-9e5503c0c2c7 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dea35aa-9e78-4122-873d-075d1d95da8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:48:10 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e2f0b696-be64-409b-a5a7-9e5503c0c2c7 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b520fccf-a0a3-4e34-85c5-a55fc352bc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:48:10 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-e2f0b696-be64-409b-a5a7-9e5503c0c2c7 tempest-ProjectMemberTests-908908227 None] Volume fd3c6e5f-9b81-4f71-8ce9-64f5ef862934: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934', 'volume_size': 1} Jul 11 04:48:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e2f0b696-be64-409b-a5a7-9e5503c0c2c7 tempest-ProjectMemberTests-908908227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:48:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e2f0b696-be64-409b-a5a7-9e5503c0c2c7 tempest-ProjectMemberTests-908908227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:48:10 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e2f0b696-be64-409b-a5a7-9e5503c0c2c7 tempest-ProjectMemberTests-908908227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1581418130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd3c6e5f-9b81-4f71-8ce9-64f5ef862934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab7832e09784b2e931b228228b2c95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:48:10Z,use_quota=True,user_id='dc1e9d4141f14bd6a58aebc9231b6fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:48:10 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-e2f0b696-be64-409b-a5a7-9e5503c0c2c7 tempest-ProjectMemberTests-908908227 None] Creating volume fd3c6e5f-9b81-4f71-8ce9-64f5ef862934 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:48:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e2f0b696-be64-409b-a5a7-9e5503c0c2c7 tempest-ProjectMemberTests-908908227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:48:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e2f0b696-be64-409b-a5a7-9e5503c0c2c7 tempest-ProjectMemberTests-908908227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:48:10 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e2f0b696-be64-409b-a5a7-9e5503c0c2c7 tempest-ProjectMemberTests-908908227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:48:10 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e2f0b696-be64-409b-a5a7-9e5503c0c2c7 tempest-ProjectMemberTests-908908227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:48:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e2f0b696-be64-409b-a5a7-9e5503c0c2c7 tempest-ProjectMemberTests-908908227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:48:10 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e2f0b696-be64-409b-a5a7-9e5503c0c2c7 tempest-ProjectMemberTests-908908227 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:48:10 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-e2f0b696-be64-409b-a5a7-9e5503c0c2c7 tempest-ProjectMemberTests-908908227 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:48:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e2f0b696-be64-409b-a5a7-9e5503c0c2c7 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:10 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934 1073741824 Jul 11 04:48:10 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:10 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e2f0b696-be64-409b-a5a7-9e5503c0c2c7 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934 1073741824" returned: 0 in 0.782s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:10 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e2f0b696-be64-409b-a5a7-9e5503c0c2c7 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:10 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934 Jul 11 04:48:10 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:11 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-e2f0b696-be64-409b-a5a7-9e5503c0c2c7 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934" returned: 0 in 0.625s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:11 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-e2f0b696-be64-409b-a5a7-9e5503c0c2c7 tempest-ProjectMemberTests-908908227 None] <== create_volume: return (1447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:48:11 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-e2f0b696-be64-409b-a5a7-9e5503c0c2c7 tempest-ProjectMemberTests-908908227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.449s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:48:11 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e2f0b696-be64-409b-a5a7-9e5503c0c2c7 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b520fccf-a0a3-4e34-85c5-a55fc352bc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:48:11 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e2f0b696-be64-409b-a5a7-9e5503c0c2c7 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (291a6450-e2c6-4766-82c2-4db2d8e97bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:48:11 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-e2f0b696-be64-409b-a5a7-9e5503c0c2c7 tempest-ProjectMemberTests-908908227 None] Volume volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934 (fd3c6e5f-9b81-4f71-8ce9-64f5ef862934): created successfully Jul 11 04:48:11 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e2f0b696-be64-409b-a5a7-9e5503c0c2c7 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (291a6450-e2c6-4766-82c2-4db2d8e97bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:48:11 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-e2f0b696-be64-409b-a5a7-9e5503c0c2c7 tempest-ProjectMemberTests-908908227 None] Flow 'volume_create_manager' (c91da5b5-a0e0-47cf-a122-c2a62bb3dae5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:48:11 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-e2f0b696-be64-409b-a5a7-9e5503c0c2c7 tempest-ProjectMemberTests-908908227 None] Created volume successfully. Jul 11 04:48:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4a2f7350-3396-4c23-a2e0-efb870c0041b tempest-ProjectMemberTests-908908227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:48:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4a2f7350-3396-4c23-a2e0-efb870c0041b tempest-ProjectMemberTests-908908227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:48:12 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-4a2f7350-3396-4c23-a2e0-efb870c0041b tempest-ProjectMemberTests-908908227 None] Creating offline snapshot 43195cf9-a885-4fc7-9dcb-fa89db887cbb of volume fd3c6e5f-9b81-4f71-8ce9-64f5ef862934 {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:48:12 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[43422fd1-e188-4eea-847b-723d686aa228]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:48:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4a2f7350-3396-4c23-a2e0-efb870c0041b tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:12 devstack sudo[107665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934 Jul 11 04:48:12 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:12 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4a2f7350-3396-4c23-a2e0-efb870c0041b tempest-ProjectMemberTests-908908227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934" returned: 0 in 0.734s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:12 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4a2f7350-3396-4c23-a2e0-efb870c0041b tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934.43195cf9-a885-4fc7-9dcb-fa89db887cbb 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:12 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934.43195cf9-a885-4fc7-9dcb-fa89db887cbb 1G Jul 11 04:48:12 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:13 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4a2f7350-3396-4c23-a2e0-efb870c0041b tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934.43195cf9-a885-4fc7-9dcb-fa89db887cbb 1G" returned: 0 in 0.776s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:13 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4a2f7350-3396-4c23-a2e0-efb870c0041b tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934.43195cf9-a885-4fc7-9dcb-fa89db887cbb {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:13 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934.43195cf9-a885-4fc7-9dcb-fa89db887cbb Jul 11 04:48:13 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:14 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4a2f7350-3396-4c23-a2e0-efb870c0041b tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934.43195cf9-a885-4fc7-9dcb-fa89db887cbb" returned: 0 in 0.701s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:14 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-4a2f7350-3396-4c23-a2e0-efb870c0041b tempest-ProjectMemberTests-908908227 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934.43195cf9-a885-4fc7-9dcb-fa89db887cbb is being set with open permissions: ugo+rw Jul 11 04:48:14 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4a2f7350-3396-4c23-a2e0-efb870c0041b tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934.43195cf9-a885-4fc7-9dcb-fa89db887cbb {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:14 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934.43195cf9-a885-4fc7-9dcb-fa89db887cbb Jul 11 04:48:14 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:15 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4a2f7350-3396-4c23-a2e0-efb870c0041b tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934.43195cf9-a885-4fc7-9dcb-fa89db887cbb" returned: 0 in 0.617s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4a2f7350-3396-4c23-a2e0-efb870c0041b tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:15 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934.info Jul 11 04:48:15 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:15 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4a2f7350-3396-4c23-a2e0-efb870c0041b tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934.info" returned: 0 in 0.667s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:15 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-4a2f7350-3396-4c23-a2e0-efb870c0041b tempest-ProjectMemberTests-908908227 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934.info is being set with open permissions: ugo+rw Jul 11 04:48:15 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4a2f7350-3396-4c23-a2e0-efb870c0041b tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:15 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934.info Jul 11 04:48:15 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:16 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-4a2f7350-3396-4c23-a2e0-efb870c0041b tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934.info" returned: 0 in 0.636s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:16 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-4a2f7350-3396-4c23-a2e0-efb870c0041b tempest-ProjectMemberTests-908908227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.214s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:48:16 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-4a2f7350-3396-4c23-a2e0-efb870c0041b tempest-ProjectMemberTests-908908227 None] Create snapshot completed successfully Jul 11 04:48:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a36ec5cf-b5b2-419f-abbe-e90ffd96672d tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-43195cf9-a885-4fc7-9dcb-fa89db887cbb-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:48:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a36ec5cf-b5b2-419f-abbe-e90ffd96672d tempest-ProjectMemberTests-908908227 None] Lock "cinder-43195cf9-a885-4fc7-9dcb-fa89db887cbb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:48:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a36ec5cf-b5b2-419f-abbe-e90ffd96672d tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-quobyte-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:48:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a36ec5cf-b5b2-419f-abbe-e90ffd96672d tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934" acquired by "delete_snapshot" :: waited 0.012s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:48:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a36ec5cf-b5b2-419f-abbe-e90ffd96672d tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-quobyte-43195cf9-a885-4fc7-9dcb-fa89db887cbb" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:48:17 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a36ec5cf-b5b2-419f-abbe-e90ffd96672d tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-43195cf9-a885-4fc7-9dcb-fa89db887cbb" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:48:17 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-a36ec5cf-b5b2-419f-abbe-e90ffd96672d tempest-ProjectMemberTests-908908227 None] Deleting offline snapshot 43195cf9-a885-4fc7-9dcb-fa89db887cbb of volume fd3c6e5f-9b81-4f71-8ce9-64f5ef862934 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:48:17 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-a36ec5cf-b5b2-419f-abbe-e90ffd96672d tempest-ProjectMemberTests-908908227 None] snapshot_file for this snap is: volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934.43195cf9-a885-4fc7-9dcb-fa89db887cbb {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:48:17 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[2154ac43-48bf-4065-9f6c-bfb5509e27a5]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:48:17 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a36ec5cf-b5b2-419f-abbe-e90ffd96672d tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934.43195cf9-a885-4fc7-9dcb-fa89db887cbb {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:17 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934.43195cf9-a885-4fc7-9dcb-fa89db887cbb Jul 11 04:48:17 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:18 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a36ec5cf-b5b2-419f-abbe-e90ffd96672d tempest-ProjectMemberTests-908908227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934.43195cf9-a885-4fc7-9dcb-fa89db887cbb" returned: 0 in 0.781s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:18 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-a36ec5cf-b5b2-419f-abbe-e90ffd96672d tempest-ProjectMemberTests-908908227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:48:18 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7e16f4-6a1b-4de6-b5c6-e752cb0b1f17]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:48:18 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a36ec5cf-b5b2-419f-abbe-e90ffd96672d tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:18 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934 Jul 11 04:48:18 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:19 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a36ec5cf-b5b2-419f-abbe-e90ffd96672d tempest-ProjectMemberTests-908908227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934" returned: 0 in 0.747s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a36ec5cf-b5b2-419f-abbe-e90ffd96672d tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934.43195cf9-a885-4fc7-9dcb-fa89db887cbb {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:19 devstack sudo[107702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934.43195cf9-a885-4fc7-9dcb-fa89db887cbb Jul 11 04:48:19 devstack sudo[107702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:19 devstack sudo[107702]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a36ec5cf-b5b2-419f-abbe-e90ffd96672d tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934.43195cf9-a885-4fc7-9dcb-fa89db887cbb" returned: 0 in 0.716s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:19 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a36ec5cf-b5b2-419f-abbe-e90ffd96672d tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934.43195cf9-a885-4fc7-9dcb-fa89db887cbb {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:19 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934.43195cf9-a885-4fc7-9dcb-fa89db887cbb Jul 11 04:48:19 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:20 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:20 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-a36ec5cf-b5b2-419f-abbe-e90ffd96672d tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934.43195cf9-a885-4fc7-9dcb-fa89db887cbb" returned: 0 in 0.664s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:20 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a36ec5cf-b5b2-419f-abbe-e90ffd96672d tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-43195cf9-a885-4fc7-9dcb-fa89db887cbb" released by "_delete_snapshot" :: held 3.001s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:48:20 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a36ec5cf-b5b2-419f-abbe-e90ffd96672d tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934" released by "delete_snapshot" :: held 3.021s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:48:20 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-a36ec5cf-b5b2-419f-abbe-e90ffd96672d tempest-ProjectMemberTests-908908227 None] Created reservations ['437aa066-8947-4f86-b3ce-c267828b1da4', '65b6a06b-5cf5-421d-b6b2-0f6390335e88', '37e3caf9-666c-49a5-8b72-e3c07fedb279', 'b4fcb80b-1f24-45ba-b4ae-d7e3182e83c9'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:48:20 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-a36ec5cf-b5b2-419f-abbe-e90ffd96672d tempest-ProjectMemberTests-908908227 None] Delete snapshot completed successfully. Jul 11 04:48:20 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-a36ec5cf-b5b2-419f-abbe-e90ffd96672d tempest-ProjectMemberTests-908908227 None] Lock "cinder-43195cf9-a885-4fc7-9dcb-fa89db887cbb-delete_snapshot" released by "delete_snapshot" :: held 3.143s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:48:21 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-8695f9cf-3fe8-466b-8cb2-21101fc3d68d tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:48:21 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-8695f9cf-3fe8-466b-8cb2-21101fc3d68d tempest-ProjectMemberTests-908908227 None] Lock "cinder-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:48:21 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-8695f9cf-3fe8-466b-8cb2-21101fc3d68d tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-quobyte-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:48:21 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-8695f9cf-3fe8-466b-8cb2-21101fc3d68d tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934" acquired by "delete_volume" :: waited 0.013s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:48:21 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d73071-3d97-4625-a770-bd085a618ef9]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:48:21 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8695f9cf-3fe8-466b-8cb2-21101fc3d68d tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:21 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934 Jul 11 04:48:21 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:22 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8695f9cf-3fe8-466b-8cb2-21101fc3d68d tempest-ProjectMemberTests-908908227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934" returned: 0 in 0.759s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:22 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8695f9cf-3fe8-466b-8cb2-21101fc3d68d tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:22 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934 Jul 11 04:48:22 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:23 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8695f9cf-3fe8-466b-8cb2-21101fc3d68d tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934" returned: 0 in 0.632s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:23 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-8695f9cf-3fe8-466b-8cb2-21101fc3d68d tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934" released by "delete_volume" :: held 1.449s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:48:23 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-8695f9cf-3fe8-466b-8cb2-21101fc3d68d tempest-ProjectMemberTests-908908227 None] Created reservations ['61c3e829-9fdf-4f8f-8910-cc2f59f1778f', '10d46b1c-ac82-435d-b4c1-9cbeb53cd03b', 'c0c2e89f-fcbd-4dc5-bac3-93d995d3379d', '1e08ff2d-aea9-4bc6-8c3b-7e0d63b46b51'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:48:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-8695f9cf-3fe8-466b-8cb2-21101fc3d68d tempest-ProjectMemberTests-908908227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:48:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-8695f9cf-3fe8-466b-8cb2-21101fc3d68d tempest-ProjectMemberTests-908908227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:48:23 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-8695f9cf-3fe8-466b-8cb2-21101fc3d68d tempest-ProjectMemberTests-908908227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:48:23 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-8695f9cf-3fe8-466b-8cb2-21101fc3d68d tempest-ProjectMemberTests-908908227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:48:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-8695f9cf-3fe8-466b-8cb2-21101fc3d68d tempest-ProjectMemberTests-908908227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:48:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8695f9cf-3fe8-466b-8cb2-21101fc3d68d tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:23 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:48:23 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:23 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:23 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8695f9cf-3fe8-466b-8cb2-21101fc3d68d tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.645s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:23 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-8695f9cf-3fe8-466b-8cb2-21101fc3d68d tempest-ProjectMemberTests-908908227 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:48:23 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-8695f9cf-3fe8-466b-8cb2-21101fc3d68d tempest-ProjectMemberTests-908908227 None] Deleted volume successfully. Jul 11 04:48:23 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-8695f9cf-3fe8-466b-8cb2-21101fc3d68d tempest-ProjectMemberTests-908908227 None] Lock "cinder-fd3c6e5f-9b81-4f71-8ce9-64f5ef862934-delete_volume" released by "delete_volume" :: held 2.285s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:48:24 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-8739d6eb-f3dc-4d24-ae06-99eaa9e089cb tempest-ProjectMemberTests-908908227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:48:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8739d6eb-f3dc-4d24-ae06-99eaa9e089cb tempest-ProjectMemberTests-908908227 None] Flow 'volume_create_manager' (de493499-5e2c-4c0a-beb3-3717fe42080d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:48:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8739d6eb-f3dc-4d24-ae06-99eaa9e089cb tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (578629d8-a9ac-4f1e-aac0-a364612f0f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:48:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8739d6eb-f3dc-4d24-ae06-99eaa9e089cb tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (578629d8-a9ac-4f1e-aac0-a364612f0f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1973169643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b7fdcec-dd0b-4539-976f-156224fa1aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab7832e09784b2e931b228228b2c95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:48:24Z,use_quota=True,user_id='dc1e9d4141f14bd6a58aebc9231b6fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:48:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8739d6eb-f3dc-4d24-ae06-99eaa9e089cb tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caad7658-836d-4b81-8ff6-2a4c16ccb13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:48:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8739d6eb-f3dc-4d24-ae06-99eaa9e089cb tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caad7658-836d-4b81-8ff6-2a4c16ccb13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:48:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8739d6eb-f3dc-4d24-ae06-99eaa9e089cb tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d11b1ff4-0ba0-4b49-a471-8c44d0221497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:48:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8739d6eb-f3dc-4d24-ae06-99eaa9e089cb tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d11b1ff4-0ba0-4b49-a471-8c44d0221497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b7fdcec-dd0b-4539-976f-156224fa1aaf', 'volume_name': 'volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:48:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8739d6eb-f3dc-4d24-ae06-99eaa9e089cb tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (577fbe5a-b4de-47dd-8571-893684ed7612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:48:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8739d6eb-f3dc-4d24-ae06-99eaa9e089cb tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (577fbe5a-b4de-47dd-8571-893684ed7612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:48:24 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8739d6eb-f3dc-4d24-ae06-99eaa9e089cb tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2efd479-a2c5-4c01-b069-8eb272c145c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:48:24 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-8739d6eb-f3dc-4d24-ae06-99eaa9e089cb tempest-ProjectMemberTests-908908227 None] Volume 1b7fdcec-dd0b-4539-976f-156224fa1aaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf', 'volume_size': 1} Jul 11 04:48:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-8739d6eb-f3dc-4d24-ae06-99eaa9e089cb tempest-ProjectMemberTests-908908227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:48:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-8739d6eb-f3dc-4d24-ae06-99eaa9e089cb tempest-ProjectMemberTests-908908227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:48:24 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-8739d6eb-f3dc-4d24-ae06-99eaa9e089cb tempest-ProjectMemberTests-908908227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1973169643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b7fdcec-dd0b-4539-976f-156224fa1aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab7832e09784b2e931b228228b2c95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:48:24Z,use_quota=True,user_id='dc1e9d4141f14bd6a58aebc9231b6fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:48:24 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-8739d6eb-f3dc-4d24-ae06-99eaa9e089cb tempest-ProjectMemberTests-908908227 None] Creating volume 1b7fdcec-dd0b-4539-976f-156224fa1aaf {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:48:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-8739d6eb-f3dc-4d24-ae06-99eaa9e089cb tempest-ProjectMemberTests-908908227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:48:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-8739d6eb-f3dc-4d24-ae06-99eaa9e089cb tempest-ProjectMemberTests-908908227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:48:24 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-8739d6eb-f3dc-4d24-ae06-99eaa9e089cb tempest-ProjectMemberTests-908908227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:48:24 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-8739d6eb-f3dc-4d24-ae06-99eaa9e089cb tempest-ProjectMemberTests-908908227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:48:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-8739d6eb-f3dc-4d24-ae06-99eaa9e089cb tempest-ProjectMemberTests-908908227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:48:24 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-8739d6eb-f3dc-4d24-ae06-99eaa9e089cb tempest-ProjectMemberTests-908908227 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:48:24 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-8739d6eb-f3dc-4d24-ae06-99eaa9e089cb tempest-ProjectMemberTests-908908227 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:48:24 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8739d6eb-f3dc-4d24-ae06-99eaa9e089cb tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:24 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf 1073741824 Jul 11 04:48:24 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:25 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8739d6eb-f3dc-4d24-ae06-99eaa9e089cb tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf 1073741824" returned: 0 in 0.805s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8739d6eb-f3dc-4d24-ae06-99eaa9e089cb tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:25 devstack sudo[107734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf Jul 11 04:48:25 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:25 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-8739d6eb-f3dc-4d24-ae06-99eaa9e089cb tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf" returned: 0 in 0.615s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:25 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-8739d6eb-f3dc-4d24-ae06-99eaa9e089cb tempest-ProjectMemberTests-908908227 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:48:25 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-8739d6eb-f3dc-4d24-ae06-99eaa9e089cb tempest-ProjectMemberTests-908908227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:48:25 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8739d6eb-f3dc-4d24-ae06-99eaa9e089cb tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2efd479-a2c5-4c01-b069-8eb272c145c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:48:25 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8739d6eb-f3dc-4d24-ae06-99eaa9e089cb tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebced59a-8835-49c0-8a40-1a54a2f70b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:48:25 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-8739d6eb-f3dc-4d24-ae06-99eaa9e089cb tempest-ProjectMemberTests-908908227 None] Volume volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf (1b7fdcec-dd0b-4539-976f-156224fa1aaf): created successfully Jul 11 04:48:25 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8739d6eb-f3dc-4d24-ae06-99eaa9e089cb tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebced59a-8835-49c0-8a40-1a54a2f70b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:48:25 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-8739d6eb-f3dc-4d24-ae06-99eaa9e089cb tempest-ProjectMemberTests-908908227 None] Flow 'volume_create_manager' (de493499-5e2c-4c0a-beb3-3717fe42080d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:48:25 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-8739d6eb-f3dc-4d24-ae06-99eaa9e089cb tempest-ProjectMemberTests-908908227 None] Created volume successfully. Jul 11 04:48:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-596595b7-27ac-4348-9cf4-d385bb45843a tempest-ProjectMemberTests-908908227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:48:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-596595b7-27ac-4348-9cf4-d385bb45843a tempest-ProjectMemberTests-908908227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:48:26 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-596595b7-27ac-4348-9cf4-d385bb45843a tempest-ProjectMemberTests-908908227 None] Creating offline snapshot 309806b4-ff26-4819-87ba-8681d9b272dd of volume 1b7fdcec-dd0b-4539-976f-156224fa1aaf {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:48:26 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed5d448-264b-471a-8248-746d09a6dfa7]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:48:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-596595b7-27ac-4348-9cf4-d385bb45843a tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:26 devstack sudo[107738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf Jul 11 04:48:26 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:27 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-596595b7-27ac-4348-9cf4-d385bb45843a tempest-ProjectMemberTests-908908227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf" returned: 0 in 0.752s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:27 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-596595b7-27ac-4348-9cf4-d385bb45843a tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf.309806b4-ff26-4819-87ba-8681d9b272dd 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:27 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf.309806b4-ff26-4819-87ba-8681d9b272dd 1G Jul 11 04:48:27 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:28 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-596595b7-27ac-4348-9cf4-d385bb45843a tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf.309806b4-ff26-4819-87ba-8681d9b272dd 1G" returned: 0 in 0.780s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-596595b7-27ac-4348-9cf4-d385bb45843a tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf.309806b4-ff26-4819-87ba-8681d9b272dd {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:28 devstack sudo[107748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf.309806b4-ff26-4819-87ba-8681d9b272dd Jul 11 04:48:28 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:28 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-596595b7-27ac-4348-9cf4-d385bb45843a tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf.309806b4-ff26-4819-87ba-8681d9b272dd" returned: 0 in 0.685s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:28 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-596595b7-27ac-4348-9cf4-d385bb45843a tempest-ProjectMemberTests-908908227 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf.309806b4-ff26-4819-87ba-8681d9b272dd is being set with open permissions: ugo+rw Jul 11 04:48:28 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-596595b7-27ac-4348-9cf4-d385bb45843a tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf.309806b4-ff26-4819-87ba-8681d9b272dd {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:28 devstack sudo[107753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf.309806b4-ff26-4819-87ba-8681d9b272dd Jul 11 04:48:28 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:29 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-596595b7-27ac-4348-9cf4-d385bb45843a tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf.309806b4-ff26-4819-87ba-8681d9b272dd" returned: 0 in 0.650s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:29 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-596595b7-27ac-4348-9cf4-d385bb45843a tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:29 devstack sudo[107756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf.info Jul 11 04:48:29 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:30 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-596595b7-27ac-4348-9cf4-d385bb45843a tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf.info" returned: 0 in 0.649s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:30 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-596595b7-27ac-4348-9cf4-d385bb45843a tempest-ProjectMemberTests-908908227 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf.info is being set with open permissions: ugo+rw Jul 11 04:48:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-596595b7-27ac-4348-9cf4-d385bb45843a tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:30 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf.info Jul 11 04:48:30 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:30 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-596595b7-27ac-4348-9cf4-d385bb45843a tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf.info" returned: 0 in 0.638s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:30 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-596595b7-27ac-4348-9cf4-d385bb45843a tempest-ProjectMemberTests-908908227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.229s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:48:30 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-596595b7-27ac-4348-9cf4-d385bb45843a tempest-ProjectMemberTests-908908227 None] Create snapshot completed successfully Jul 11 04:48:31 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-958779ff-ec96-4b4d-9bb4-b8a1360afb1f tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-309806b4-ff26-4819-87ba-8681d9b272dd-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:48:31 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-958779ff-ec96-4b4d-9bb4-b8a1360afb1f tempest-ProjectMemberTests-908908227 None] Lock "cinder-309806b4-ff26-4819-87ba-8681d9b272dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:48:31 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-958779ff-ec96-4b4d-9bb4-b8a1360afb1f tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-quobyte-1b7fdcec-dd0b-4539-976f-156224fa1aaf" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:48:31 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-958779ff-ec96-4b4d-9bb4-b8a1360afb1f tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-1b7fdcec-dd0b-4539-976f-156224fa1aaf" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:48:31 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-958779ff-ec96-4b4d-9bb4-b8a1360afb1f tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-quobyte-309806b4-ff26-4819-87ba-8681d9b272dd" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:48:31 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-958779ff-ec96-4b4d-9bb4-b8a1360afb1f tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-309806b4-ff26-4819-87ba-8681d9b272dd" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:48:31 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-958779ff-ec96-4b4d-9bb4-b8a1360afb1f tempest-ProjectMemberTests-908908227 None] Deleting offline snapshot 309806b4-ff26-4819-87ba-8681d9b272dd of volume 1b7fdcec-dd0b-4539-976f-156224fa1aaf {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:48:31 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-958779ff-ec96-4b4d-9bb4-b8a1360afb1f tempest-ProjectMemberTests-908908227 None] snapshot_file for this snap is: volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf.309806b4-ff26-4819-87ba-8681d9b272dd {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:48:31 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[05538956-99bc-4af6-b411-3f1c376d5f07]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:48:31 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-958779ff-ec96-4b4d-9bb4-b8a1360afb1f tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf.309806b4-ff26-4819-87ba-8681d9b272dd {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:31 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf.309806b4-ff26-4819-87ba-8681d9b272dd Jul 11 04:48:31 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:32 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-958779ff-ec96-4b4d-9bb4-b8a1360afb1f tempest-ProjectMemberTests-908908227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf.309806b4-ff26-4819-87ba-8681d9b272dd" returned: 0 in 0.735s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:32 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-958779ff-ec96-4b4d-9bb4-b8a1360afb1f tempest-ProjectMemberTests-908908227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:48:32 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef9dc74-f65b-4610-a3bd-4d2d71613971]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:48:32 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-958779ff-ec96-4b4d-9bb4-b8a1360afb1f tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:32 devstack sudo[107767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf Jul 11 04:48:32 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:33 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-958779ff-ec96-4b4d-9bb4-b8a1360afb1f tempest-ProjectMemberTests-908908227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf" returned: 0 in 0.754s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-958779ff-ec96-4b4d-9bb4-b8a1360afb1f tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf.309806b4-ff26-4819-87ba-8681d9b272dd {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:33 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf.309806b4-ff26-4819-87ba-8681d9b272dd Jul 11 04:48:33 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:33 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-958779ff-ec96-4b4d-9bb4-b8a1360afb1f tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf.309806b4-ff26-4819-87ba-8681d9b272dd" returned: 0 in 0.693s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:33 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-958779ff-ec96-4b4d-9bb4-b8a1360afb1f tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf.309806b4-ff26-4819-87ba-8681d9b272dd {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:33 devstack sudo[107778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf.309806b4-ff26-4819-87ba-8681d9b272dd Jul 11 04:48:33 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:34 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-958779ff-ec96-4b4d-9bb4-b8a1360afb1f tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf.309806b4-ff26-4819-87ba-8681d9b272dd" returned: 0 in 0.629s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-958779ff-ec96-4b4d-9bb4-b8a1360afb1f tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-309806b4-ff26-4819-87ba-8681d9b272dd" released by "_delete_snapshot" :: held 2.898s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:48:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-958779ff-ec96-4b4d-9bb4-b8a1360afb1f tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-1b7fdcec-dd0b-4539-976f-156224fa1aaf" released by "delete_snapshot" :: held 2.920s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:48:34 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-958779ff-ec96-4b4d-9bb4-b8a1360afb1f tempest-ProjectMemberTests-908908227 None] Created reservations ['8092f1fd-3268-429a-999b-45802db65ae1', 'e37b7e61-84b4-4eea-900d-0be32964aab2', '052b6cdb-163e-4784-a174-b28844df3c75', 'e3d607b5-2ae7-4eea-b68f-4f77509ef3f3'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:48:34 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-958779ff-ec96-4b4d-9bb4-b8a1360afb1f tempest-ProjectMemberTests-908908227 None] Delete snapshot completed successfully. Jul 11 04:48:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-958779ff-ec96-4b4d-9bb4-b8a1360afb1f tempest-ProjectMemberTests-908908227 None] Lock "cinder-309806b4-ff26-4819-87ba-8681d9b272dd-delete_snapshot" released by "delete_snapshot" :: held 3.045s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:48:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f58dadfd-3a1d-49f5-b392-0b670abc533b tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-1b7fdcec-dd0b-4539-976f-156224fa1aaf-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:48:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f58dadfd-3a1d-49f5-b392-0b670abc533b tempest-ProjectMemberTests-908908227 None] Lock "cinder-1b7fdcec-dd0b-4539-976f-156224fa1aaf-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:48:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f58dadfd-3a1d-49f5-b392-0b670abc533b tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-quobyte-1b7fdcec-dd0b-4539-976f-156224fa1aaf" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:48:34 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f58dadfd-3a1d-49f5-b392-0b670abc533b tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-1b7fdcec-dd0b-4539-976f-156224fa1aaf" acquired by "delete_volume" :: waited 0.015s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:48:34 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eaa8ade-9b0e-4ce3-b4cc-24c44ad929c9]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:48:34 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f58dadfd-3a1d-49f5-b392-0b670abc533b tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:35 devstack sudo[107781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf Jul 11 04:48:35 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:35 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f58dadfd-3a1d-49f5-b392-0b670abc533b tempest-ProjectMemberTests-908908227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf" returned: 0 in 0.730s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:35 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f58dadfd-3a1d-49f5-b392-0b670abc533b tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:35 devstack sudo[107786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf Jul 11 04:48:35 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:36 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f58dadfd-3a1d-49f5-b392-0b670abc533b tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-1b7fdcec-dd0b-4539-976f-156224fa1aaf" returned: 0 in 0.625s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:36 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f58dadfd-3a1d-49f5-b392-0b670abc533b tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-1b7fdcec-dd0b-4539-976f-156224fa1aaf" released by "delete_volume" :: held 1.405s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:48:36 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=63,cinder:DELETE=9,cinder:INSERT=22,cinder:UPDATE=80 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:48:36 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-f58dadfd-3a1d-49f5-b392-0b670abc533b tempest-ProjectMemberTests-908908227 None] Created reservations ['89e44ff6-d061-4951-9ffd-702e5058538d', 'd6b7136c-bba5-43b7-a692-4b1c6118db7b', 'f956671d-e28b-45c7-9268-6c102da10fb9', '2b76635a-5096-40ee-b4e6-4ede780748b7'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:48:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f58dadfd-3a1d-49f5-b392-0b670abc533b tempest-ProjectMemberTests-908908227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:48:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f58dadfd-3a1d-49f5-b392-0b670abc533b tempest-ProjectMemberTests-908908227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:48:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-f58dadfd-3a1d-49f5-b392-0b670abc533b tempest-ProjectMemberTests-908908227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:48:36 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-f58dadfd-3a1d-49f5-b392-0b670abc533b tempest-ProjectMemberTests-908908227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:48:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-f58dadfd-3a1d-49f5-b392-0b670abc533b tempest-ProjectMemberTests-908908227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:48:36 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f58dadfd-3a1d-49f5-b392-0b670abc533b tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:36 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:48:36 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:37 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f58dadfd-3a1d-49f5-b392-0b670abc533b tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.635s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:37 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-f58dadfd-3a1d-49f5-b392-0b670abc533b tempest-ProjectMemberTests-908908227 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:48:37 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-f58dadfd-3a1d-49f5-b392-0b670abc533b tempest-ProjectMemberTests-908908227 None] Deleted volume successfully. Jul 11 04:48:37 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f58dadfd-3a1d-49f5-b392-0b670abc533b tempest-ProjectMemberTests-908908227 None] Lock "cinder-1b7fdcec-dd0b-4539-976f-156224fa1aaf-delete_volume" released by "delete_volume" :: held 2.236s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:48:37 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=68,cinder:INSERT=24,cinder:UPDATE=85,cinder:DELETE=4 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:48:37 devstack cinder-volume[86964]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab19d2b0-10bf-4463-96ed-954acc4bf483 tempest-ProjectMemberTests-908908227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86964) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:48:37 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ab19d2b0-10bf-4463-96ed-954acc4bf483 tempest-ProjectMemberTests-908908227 None] Flow 'volume_create_manager' (ddd292aa-d793-4a02-b3dc-764f577cdff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:48:37 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ab19d2b0-10bf-4463-96ed-954acc4bf483 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcdf2fc9-a7a7-4ff3-83bb-4fb2196900ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:48:37 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ab19d2b0-10bf-4463-96ed-954acc4bf483 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcdf2fc9-a7a7-4ff3-83bb-4fb2196900ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1633409009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18fd4f7c-ff2a-413d-bb00-694332d62648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab7832e09784b2e931b228228b2c95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:48:37Z,use_quota=True,user_id='dc1e9d4141f14bd6a58aebc9231b6fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:48:37 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ab19d2b0-10bf-4463-96ed-954acc4bf483 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (530125a3-1924-46dc-b1b7-01a0e0cf1f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:48:37 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ab19d2b0-10bf-4463-96ed-954acc4bf483 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (530125a3-1924-46dc-b1b7-01a0e0cf1f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:48:37 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ab19d2b0-10bf-4463-96ed-954acc4bf483 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d52ad0-8c26-4a0d-b2e9-d9ef1fd7122c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:48:37 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ab19d2b0-10bf-4463-96ed-954acc4bf483 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d52ad0-8c26-4a0d-b2e9-d9ef1fd7122c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18fd4f7c-ff2a-413d-bb00-694332d62648', 'volume_name': 'volume-18fd4f7c-ff2a-413d-bb00-694332d62648', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:48:37 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ab19d2b0-10bf-4463-96ed-954acc4bf483 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e4f8f5-557e-4ef8-847c-6867f845744b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:48:37 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ab19d2b0-10bf-4463-96ed-954acc4bf483 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e4f8f5-557e-4ef8-847c-6867f845744b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:48:37 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ab19d2b0-10bf-4463-96ed-954acc4bf483 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2ca049f-bca2-40dc-aa0d-0da7609e28f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:48:37 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-ab19d2b0-10bf-4463-96ed-954acc4bf483 tempest-ProjectMemberTests-908908227 None] Volume 18fd4f7c-ff2a-413d-bb00-694332d62648: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18fd4f7c-ff2a-413d-bb00-694332d62648', 'volume_size': 1} Jul 11 04:48:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ab19d2b0-10bf-4463-96ed-954acc4bf483 tempest-ProjectMemberTests-908908227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:48:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ab19d2b0-10bf-4463-96ed-954acc4bf483 tempest-ProjectMemberTests-908908227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:48:37 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ab19d2b0-10bf-4463-96ed-954acc4bf483 tempest-ProjectMemberTests-908908227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1633409009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18fd4f7c-ff2a-413d-bb00-694332d62648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab7832e09784b2e931b228228b2c95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:48:37Z,use_quota=True,user_id='dc1e9d4141f14bd6a58aebc9231b6fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac364d7-85a3-46fc-85d5-7cb6932062b4),volume_type_id=9ac364d7-85a3-46fc-85d5-7cb6932062b4)}" {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:48:37 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-ab19d2b0-10bf-4463-96ed-954acc4bf483 tempest-ProjectMemberTests-908908227 None] Creating volume 18fd4f7c-ff2a-413d-bb00-694332d62648 {{(pid=86964) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:48:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ab19d2b0-10bf-4463-96ed-954acc4bf483 tempest-ProjectMemberTests-908908227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:48:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ab19d2b0-10bf-4463-96ed-954acc4bf483 tempest-ProjectMemberTests-908908227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:48:37 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ab19d2b0-10bf-4463-96ed-954acc4bf483 tempest-ProjectMemberTests-908908227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:48:37 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ab19d2b0-10bf-4463-96ed-954acc4bf483 tempest-ProjectMemberTests-908908227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:48:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ab19d2b0-10bf-4463-96ed-954acc4bf483 tempest-ProjectMemberTests-908908227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:48:37 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ab19d2b0-10bf-4463-96ed-954acc4bf483 tempest-ProjectMemberTests-908908227 None] Selected osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 as target Quobyte volume. {{(pid=86964) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:48:37 devstack cinder-volume[86964]: INFO cinder.volume.drivers.remotefs [None req-ab19d2b0-10bf-4463-96ed-954acc4bf483 tempest-ProjectMemberTests-908908227 None] casted to osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95 Jul 11 04:48:37 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ab19d2b0-10bf-4463-96ed-954acc4bf483 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648 1073741824 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:37 devstack sudo[107795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648 1073741824 Jul 11 04:48:37 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:38 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ab19d2b0-10bf-4463-96ed-954acc4bf483 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648 1073741824" returned: 0 in 0.794s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:38 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ab19d2b0-10bf-4463-96ed-954acc4bf483 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:38 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648 Jul 11 04:48:38 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:39 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ab19d2b0-10bf-4463-96ed-954acc4bf483 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648" returned: 0 in 0.629s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:39 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ab19d2b0-10bf-4463-96ed-954acc4bf483 tempest-ProjectMemberTests-908908227 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'} {{(pid=86964) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:48:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ab19d2b0-10bf-4463-96ed-954acc4bf483 tempest-ProjectMemberTests-908908227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:48:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ab19d2b0-10bf-4463-96ed-954acc4bf483 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2ca049f-bca2-40dc-aa0d-0da7609e28f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18fd4f7c-ff2a-413d-bb00-694332d62648', 'volume_size': 1}' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:48:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ab19d2b0-10bf-4463-96ed-954acc4bf483 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d489dcf-aa9f-405a-a5c1-a4bb4f5bf476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:48:39 devstack cinder-volume[86964]: INFO cinder.volume.flows.manager.create_volume [None req-ab19d2b0-10bf-4463-96ed-954acc4bf483 tempest-ProjectMemberTests-908908227 None] Volume volume-18fd4f7c-ff2a-413d-bb00-694332d62648 (18fd4f7c-ff2a-413d-bb00-694332d62648): created successfully Jul 11 04:48:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ab19d2b0-10bf-4463-96ed-954acc4bf483 tempest-ProjectMemberTests-908908227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d489dcf-aa9f-405a-a5c1-a4bb4f5bf476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86964) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:48:39 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ab19d2b0-10bf-4463-96ed-954acc4bf483 tempest-ProjectMemberTests-908908227 None] Flow 'volume_create_manager' (ddd292aa-d793-4a02-b3dc-764f577cdff5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86964) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:48:39 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-ab19d2b0-10bf-4463-96ed-954acc4bf483 tempest-ProjectMemberTests-908908227 None] Created volume successfully. Jul 11 04:48:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-765e92d2-7513-4fe0-b0db-601550a29f28 tempest-ProjectMemberTests-908908227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:48:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-765e92d2-7513-4fe0-b0db-601550a29f28 tempest-ProjectMemberTests-908908227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:48:39 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-765e92d2-7513-4fe0-b0db-601550a29f28 tempest-ProjectMemberTests-908908227 None] Creating offline snapshot a7105330-736d-40b8-aab0-15b12b0fd809 of volume 18fd4f7c-ff2a-413d-bb00-694332d62648 {{(pid=86964) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:48:39 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[8867cbc5-515d-4463-954f-304178d7a50e]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:48:39 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-765e92d2-7513-4fe0-b0db-601550a29f28 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:39 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648 Jul 11 04:48:39 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:40 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-765e92d2-7513-4fe0-b0db-601550a29f28 tempest-ProjectMemberTests-908908227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648" returned: 0 in 0.750s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:40 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-765e92d2-7513-4fe0-b0db-601550a29f28 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648.a7105330-736d-40b8-aab0-15b12b0fd809 1G {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:40 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648.a7105330-736d-40b8-aab0-15b12b0fd809 1G Jul 11 04:48:40 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:41 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-765e92d2-7513-4fe0-b0db-601550a29f28 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648.a7105330-736d-40b8-aab0-15b12b0fd809 1G" returned: 0 in 0.771s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-765e92d2-7513-4fe0-b0db-601550a29f28 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18fd4f7c-ff2a-413d-bb00-694332d62648 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648.a7105330-736d-40b8-aab0-15b12b0fd809 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:41 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18fd4f7c-ff2a-413d-bb00-694332d62648 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648.a7105330-736d-40b8-aab0-15b12b0fd809 Jul 11 04:48:41 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:41 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-765e92d2-7513-4fe0-b0db-601550a29f28 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18fd4f7c-ff2a-413d-bb00-694332d62648 -F qcow2 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648.a7105330-736d-40b8-aab0-15b12b0fd809" returned: 0 in 0.659s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:41 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-765e92d2-7513-4fe0-b0db-601550a29f28 tempest-ProjectMemberTests-908908227 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648.a7105330-736d-40b8-aab0-15b12b0fd809 is being set with open permissions: ugo+rw Jul 11 04:48:41 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-765e92d2-7513-4fe0-b0db-601550a29f28 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648.a7105330-736d-40b8-aab0-15b12b0fd809 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:41 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648.a7105330-736d-40b8-aab0-15b12b0fd809 Jul 11 04:48:41 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:42 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-765e92d2-7513-4fe0-b0db-601550a29f28 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648.a7105330-736d-40b8-aab0-15b12b0fd809" returned: 0 in 0.628s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:42 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-765e92d2-7513-4fe0-b0db-601550a29f28 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:42 devstack sudo[107822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648.info Jul 11 04:48:42 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:43 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-765e92d2-7513-4fe0-b0db-601550a29f28 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648.info" returned: 0 in 0.624s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:43 devstack cinder-volume[86964]: WARNING cinder.volume.drivers.remotefs [None req-765e92d2-7513-4fe0-b0db-601550a29f28 tempest-ProjectMemberTests-908908227 None] /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648.info is being set with open permissions: ugo+rw Jul 11 04:48:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-765e92d2-7513-4fe0-b0db-601550a29f28 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648.info {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:43 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648.info Jul 11 04:48:43 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:43 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-765e92d2-7513-4fe0-b0db-601550a29f28 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648.info" returned: 0 in 0.631s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:43 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-765e92d2-7513-4fe0-b0db-601550a29f28 tempest-ProjectMemberTests-908908227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.138s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:48:43 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-765e92d2-7513-4fe0-b0db-601550a29f28 tempest-ProjectMemberTests-908908227 None] Create snapshot completed successfully Jul 11 04:48:45 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f29946c9-2d40-4bc6-a707-c64b4542b98f tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-a7105330-736d-40b8-aab0-15b12b0fd809-delete_snapshot" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:48:45 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f29946c9-2d40-4bc6-a707-c64b4542b98f tempest-ProjectMemberTests-908908227 None] Lock "cinder-a7105330-736d-40b8-aab0-15b12b0fd809-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:48:45 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f29946c9-2d40-4bc6-a707-c64b4542b98f tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-quobyte-18fd4f7c-ff2a-413d-bb00-694332d62648" by "delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:48:45 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f29946c9-2d40-4bc6-a707-c64b4542b98f tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-18fd4f7c-ff2a-413d-bb00-694332d62648" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:48:45 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f29946c9-2d40-4bc6-a707-c64b4542b98f tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-quobyte-a7105330-736d-40b8-aab0-15b12b0fd809" by "_delete_snapshot" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:48:45 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f29946c9-2d40-4bc6-a707-c64b4542b98f tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-a7105330-736d-40b8-aab0-15b12b0fd809" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:48:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-f29946c9-2d40-4bc6-a707-c64b4542b98f tempest-ProjectMemberTests-908908227 None] Deleting offline snapshot a7105330-736d-40b8-aab0-15b12b0fd809 of volume 18fd4f7c-ff2a-413d-bb00-694332d62648 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:48:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-f29946c9-2d40-4bc6-a707-c64b4542b98f tempest-ProjectMemberTests-908908227 None] snapshot_file for this snap is: volume-18fd4f7c-ff2a-413d-bb00-694332d62648.a7105330-736d-40b8-aab0-15b12b0fd809 {{(pid=86964) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:48:45 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b2115f-6607-4f97-8c6c-09012b0b6eab]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:48:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f29946c9-2d40-4bc6-a707-c64b4542b98f tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648.a7105330-736d-40b8-aab0-15b12b0fd809 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:45 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648.a7105330-736d-40b8-aab0-15b12b0fd809 Jul 11 04:48:45 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:45 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f29946c9-2d40-4bc6-a707-c64b4542b98f tempest-ProjectMemberTests-908908227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648.a7105330-736d-40b8-aab0-15b12b0fd809" returned: 0 in 0.745s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:45 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.remotefs [None req-f29946c9-2d40-4bc6-a707-c64b4542b98f tempest-ProjectMemberTests-908908227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18fd4f7c-ff2a-413d-bb00-694332d62648(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86964) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:48:45 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0a5678-524a-4461-9732-a91541cb9e11]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:48:45 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f29946c9-2d40-4bc6-a707-c64b4542b98f tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:45 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648 Jul 11 04:48:45 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:46 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f29946c9-2d40-4bc6-a707-c64b4542b98f tempest-ProjectMemberTests-908908227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648" returned: 0 in 0.726s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:46 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f29946c9-2d40-4bc6-a707-c64b4542b98f tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648.a7105330-736d-40b8-aab0-15b12b0fd809 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:46 devstack sudo[107839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648.a7105330-736d-40b8-aab0-15b12b0fd809 Jul 11 04:48:46 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:47 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f29946c9-2d40-4bc6-a707-c64b4542b98f tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648.a7105330-736d-40b8-aab0-15b12b0fd809" returned: 0 in 0.711s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f29946c9-2d40-4bc6-a707-c64b4542b98f tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648.a7105330-736d-40b8-aab0-15b12b0fd809 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:47 devstack sudo[107845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648.a7105330-736d-40b8-aab0-15b12b0fd809 Jul 11 04:48:47 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:47 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:47 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-f29946c9-2d40-4bc6-a707-c64b4542b98f tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648.a7105330-736d-40b8-aab0-15b12b0fd809" returned: 0 in 0.618s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:47 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f29946c9-2d40-4bc6-a707-c64b4542b98f tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-a7105330-736d-40b8-aab0-15b12b0fd809" released by "_delete_snapshot" :: held 2.889s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:48:47 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f29946c9-2d40-4bc6-a707-c64b4542b98f tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-18fd4f7c-ff2a-413d-bb00-694332d62648" released by "delete_snapshot" :: held 2.911s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:48:48 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-f29946c9-2d40-4bc6-a707-c64b4542b98f tempest-ProjectMemberTests-908908227 None] Created reservations ['3dea4b7e-3539-4ad3-8df1-a7c88a33d471', 'c5fc5019-8484-4573-b4d0-d27c415a2af7', '9000f62c-6fb0-4146-8482-e10041e8bdf1', '7d0fe3d1-be3f-4dc1-b009-81af4d8dfabd'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:48:48 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-f29946c9-2d40-4bc6-a707-c64b4542b98f tempest-ProjectMemberTests-908908227 None] Delete snapshot completed successfully. Jul 11 04:48:48 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-f29946c9-2d40-4bc6-a707-c64b4542b98f tempest-ProjectMemberTests-908908227 None] Lock "cinder-a7105330-736d-40b8-aab0-15b12b0fd809-delete_snapshot" released by "delete_snapshot" :: held 3.035s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:48:48 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-9a1ec672-5896-416e-aa83-9e975c5152f7 tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-18fd4f7c-ff2a-413d-bb00-694332d62648-delete_volume" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:48:48 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-9a1ec672-5896-416e-aa83-9e975c5152f7 tempest-ProjectMemberTests-908908227 None] Lock "cinder-18fd4f7c-ff2a-413d-bb00-694332d62648-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:48:48 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-9a1ec672-5896-416e-aa83-9e975c5152f7 tempest-ProjectMemberTests-908908227 None] Acquiring lock "cinder-quobyte-18fd4f7c-ff2a-413d-bb00-694332d62648" by "delete_volume" {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:48:48 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-9a1ec672-5896-416e-aa83-9e975c5152f7 tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-18fd4f7c-ff2a-413d-bb00-694332d62648" acquired by "delete_volume" :: waited 0.019s {{(pid=86964) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:48:48 devstack cinder-volume[86964]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acfb260-f127-421f-9e9d-c0a0152af2d3]: (4, 'qcow2') {{(pid=87713) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:48:48 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9a1ec672-5896-416e-aa83-9e975c5152f7 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:48 devstack sudo[107848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648 Jul 11 04:48:48 devstack sudo[107848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:49 devstack sudo[107848]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9a1ec672-5896-416e-aa83-9e975c5152f7 tempest-ProjectMemberTests-908908227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648" returned: 0 in 0.726s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9a1ec672-5896-416e-aa83-9e975c5152f7 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:49 devstack sudo[107853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648 Jul 11 04:48:49 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:49 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9a1ec672-5896-416e-aa83-9e975c5152f7 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3/volume-18fd4f7c-ff2a-413d-bb00-694332d62648" returned: 0 in 0.630s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:49 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-9a1ec672-5896-416e-aa83-9e975c5152f7 tempest-ProjectMemberTests-908908227 None] Lock "cinder-quobyte-18fd4f7c-ff2a-413d-bb00-694332d62648" released by "delete_volume" :: held 1.412s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:48:49 devstack cinder-volume[86964]: DEBUG cinder.quota [None req-9a1ec672-5896-416e-aa83-9e975c5152f7 tempest-ProjectMemberTests-908908227 None] Created reservations ['50783c9b-5134-47ad-aad8-ebd2de63fd54', '852145f7-c5af-4d08-b322-ea3b2f6aa0af', '59193f4a-ef8a-4035-bf7e-5391524170cd', 'beb798d2-3893-4318-ab57-60bd963b69fe'] {{(pid=86964) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:48:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9a1ec672-5896-416e-aa83-9e975c5152f7 tempest-ProjectMemberTests-908908227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:48:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9a1ec672-5896-416e-aa83-9e975c5152f7 tempest-ProjectMemberTests-908908227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:48:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-9a1ec672-5896-416e-aa83-9e975c5152f7 tempest-ProjectMemberTests-908908227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:48:49 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-9a1ec672-5896-416e-aa83-9e975c5152f7 tempest-ProjectMemberTests-908908227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:48:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-9a1ec672-5896-416e-aa83-9e975c5152f7 tempest-ProjectMemberTests-908908227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:48:49 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9a1ec672-5896-416e-aa83-9e975c5152f7 tempest-ProjectMemberTests-908908227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:49 devstack sudo[107856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:48:49 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:50 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:50 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-9a1ec672-5896-416e-aa83-9e975c5152f7 tempest-ProjectMemberTests-908908227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.645s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:50 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-9a1ec672-5896-416e-aa83-9e975c5152f7 tempest-ProjectMemberTests-908908227 None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:48:50 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-9a1ec672-5896-416e-aa83-9e975c5152f7 tempest-ProjectMemberTests-908908227 None] Deleted volume successfully. Jul 11 04:48:50 devstack cinder-volume[86964]: DEBUG cinder.coordination [None req-9a1ec672-5896-416e-aa83-9e975c5152f7 tempest-ProjectMemberTests-908908227 None] Lock "cinder-18fd4f7c-ff2a-413d-bb00-694332d62648-delete_volume" released by "delete_volume" :: held 2.247s {{(pid=86964) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:48:59 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:48:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:48:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:48:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95': None} {{(pid=86964) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:48:59 devstack cinder-volume[86964]: DEBUG cinder.volume.drivers.quobyte [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-49acd413-87ec-42ef-8f82-f63243027b95'] {{(pid=86964) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:48:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86964) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:48:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:48:59 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3 Jul 11 04:48:59 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:48:59 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:INSERT=7,cinder:UPDATE=26,cinder:SELECT=13,cinder:DELETE=2 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:48:59 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Jul 11 04:48:59 devstack cinder-volume[86964]: DEBUG oslo_concurrency.processutils [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6cfbfe4d3586b496513dd8300f7343c3" returned: 0 in 0.684s {{(pid=86964) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:48:59 devstack cinder-volume[86964]: DEBUG cinder.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Notifying Schedulers of capabilities ... {{(pid=86964) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:48:59 devstack cinder-volume[86964]: DEBUG oslo_service.periodic_task [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] Running periodic task VolumeManager._thread_info {{(pid=86964) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:48:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread count: 28 {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:48:59 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-ef82f97d-700e-4f7d-b494-5174537609e9 None None] thread info: [<_MainThread(MainThread, started 124675027595392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86964) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:49:10 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=1 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:49:10 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=16,cinder:UPDATE=17,cinder:DELETE=2,cinder:INSERT=5 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}